Technical Report for the Forgotten-by-Design Project: Targeted Obfuscation for Machine Learning

Rickard Brännvall, Laurynas Adomaitis, Olof Görnerup, Anass Sedrati · 2025

Read Technical Report for the Forgotten-by-Design Project: Targeted Obfuscation for Machine Learning by Rickard Brännvall, Laurynas Adomaitis, Olof Görnerup, Anass Sedrati (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-11525.txt.

Introduction

Privacy for training data is built in from the start in the Forgotten-by-Design project, reported by Rickard Brännvall and co-authors in a 2025 paper. The right to be forgotten faces new strain in the age of artificial intelligence. Standard erasure deletes stored data, but a trained model may still carry traces of the data inside its weights.

Instead of unlearning after training, the method stops sensitive data from being embedded in the first place. It uses targeted obfuscation for single data points during training. A membership inference attack helps find the points most at risk. Defenses join added gradient noise with weighting schemes. On the CIFAR-10 data set, privacy risk fell by at least tenfold while accuracy held.

Catalog record

CREATORRickard Brännvall, Laurynas Adomaitis, Olof Görnerup, Anass Sedrati
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-11525

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Technical Report for the Forgotten-by-Design Project: Targeted Obfuscation for Machine Learning Rickard Brännvall, Laurynas Adomaitis, Olof Görnerup, Anass Sedrati Abstract The right to privacy, enshrined in various human rights declarations, faces new challenges in the age of artificial intelligence (AI). This paper explores the concept of the “Right to be Forgotten” (RTBF) within AI systems, contrasting it with traditional data erasure methods. We introduce “Forgotten by Design,” a proactive approach to privacy preservation that integrates instance-specific obfuscation techniques during the AI model training process. Unlike machine unlearning, which modifies models post-training, our method prevents sensitive data from being embedded in the first place. Using the LIRA membership inference attack, we identify vulnerable data points and propose defenses that combine additive gradient noise and weighting schemes. Our experiments on the CIFAR-10 dataset demonstrate that our techniques reduce privacy risks by at least an order of magnitude while maintaining model accuracy (at 95% significance). Additionally, we present visualization methods for the privacy-utility trade-off, providing a clear framework for balancing privacy risk and model accuracy. This work contributes to the development of privacy-preserving AI systems that align with human cognitive processes of motivated forgetting, offering a robust framework for safeguarding sensitive information and ensuring compliance with privacy regulations. 1 Introduction The right to privacy or private life is enshrined in the Universal Declaration of Human Rights (Article 12), the European Convention of Human Rights (Article 8), and the European Charter of Fundamental Rights (Article 7). However, the meaning of privacy protection changes with the technological landscape, and the enforcement of certain privacy principles varies. Artificial intelligence (AI) has reintroduced many themes initially addressed by the EU’s General Data Protection Regulation (GDPR). For example, the right to be forgotten has long been interpreted as the right to ask for the removal of personal data. However, AI models typically do not store data per se. They are trained on the data, and removing personal data from the original training dataset would not affect the model, which may still embed sensitive information. A famous instance of this dilemma is clearview.ai, which used images of people’s faces to train facial recognition models that remain operational despite the efforts of many individuals and civil society groups to have their faces removed from the model. The national regulators have fined the company in Europe, but the product remains available, and public versions of the same concept are now freely available. To counteract the non-consensual use of personal data, activist groups and researchers have developed techniques that fall under the general term “obfuscation.” The FAWKES project provided a tool to combat clearview.ai specifically by poisoning their publicly scraped data. Brunton and Nissenbaum have popularized the idea of obfuscation in their seminal work “Obfuscation: A User’s Guide for Privacy and Protest.” They argue for obfuscation as a way to take back control of one’s privacy. The overarching goal of this paper is to implement the general idea of obfuscation in the design of privacy-preserving AI systems so that it is not a reactionary act of protest but rather a method to protect sensitive data points by design. We employ the concept of a privacy vulnerability score, which quantifies the susceptibility of individual data points to privacy attacks based on the differences in model behavior on in-training versus out-of-training data points. With extensive testing, it is possible to validate that custom obfuscation added to a model prevents the inference of membership, thus satisfying most cases of the right to be forgotten. To systematically evaluate the privacy risks associated with AI models, we employ Membership Inference Attacks (MIA) [ 1 ] in this work, specifically the LIRA attack [ 2 ] . These attacks help identify whether specific data points were part of the training dataset, thereby assessing the model’s vulnerability to privacy breaches. By integrating LIRA into our methodology, we aim to rigorously test and validate the effectiveness of our proposed obfuscation techniques in preserving privacy. To carry out such work, we also need a machine learning task. The CIFAR-10 dataset [ 3 ] , a widely used benchmark in machine learning research, consists of 60,000 32x32-pixel color images across 10 different classes. It is particularly useful for evaluating the performance and privacy risks of image classification models due to its diversity and complexity. ResNet-18 [ 4 ] , a deep residual network with 18 layers, is designed to address the vanishing gradient problem by using shortcut connections, making it a robust choice for image classification tasks. Structure of the report. First, a general background and definitions are provided to set the context of this article. This includes an interpretation of the Right to Be Forgotten in AI environments and an explanation of machine unlearning (MU), which is one of the suggested ways to address it. A motivation is then shared as to why we decided to use another approach and its advantages compared to MU. This approach introduces elements (differential privacy, vulnerable data points, and membership inference attacks). The working method is then presented with its different steps, starting by setting metrics and identifying vulnerable data points. A numerical experiment is then conducted, leading to an analysis and discussion that concludes by demonstrating the effectiveness of our suggested techniques in reducing privacy risks while maintaining model utility. 2 Background and Definitions 2.1 Understanding the Right to Be Forgotten (RTBF) They are the souls who are destined for Reincarnation; and now at Lethe’s stream they are drinking the waters that quench man’s troubles, the deep draught of oblivion. They come in crowds to the river Lethe, so that you see, with memory washed out, they may revisit the earth above. (Virgil, Aeneid 6. 705). In these verses by Virgil, the father’s ghost explains to Aeneas one of the passages of souls from death to rebirth. According to the myth, every soul is made to drink from the river Lêthê (, forgetfulness) to forget their previous lives. Lêthê represents forgetting as an event, a sort of induced forgetting, that is brought upon people from the supernatural. This mythical understanding is in contrast to the usual meaning of forgetting as a passive and systemic process of the mind, e.g., decay, that happens without intent or explicit planning. Forgetting can be described as a “brain-wide well-regulated decay process, occurring mostly during sleep, [that] systematically removes selected memories” [ 5 ] . Other accounts of forgetting, like motivated forgetting, include an intentional element. It claims that “limiting awareness of unwanted memories makes us forget them” [ 6 ] , and that is especially true for sensitive or traumatic events that people want to forget. However, motivated forgetting still accounts for forgetting by limiting one’s attention to the target memory. There does not seem to be a mechanism in human psychology that would be similar to the effect of the river Lêthê that makes one intentionally and actively forget 1 1 1 There is some promise from neurotechnologies for memory editing [ 7 ] but that these technologies are being developed only testifies to the fact that such editing does not occur naturally. . However, when human memory is metaphorically transferred to computing, it becomes like drinking from Lêthê. It is common to refer to a computer’s

Read the complete text