Representation Unlearning: Forgetting through Information Compression

Antonio Almudévar, Alfonso Ortega · 2026

Read Representation Unlearning: Forgetting through Information Compression by Antonio Almudévar, Alfonso Ortega (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21564.txt.

Introduction

Antonio Almudévar and Alfonso Ortega remove the trace of chosen training data by compressing a model's inner representations. Unlearning is needed for privacy law and for fixing models trained on bad data. Most methods tweak the model's weights, which can be unstable and costly.

Their framework works in representation space instead of weight space. Compression squeezes out the information tied to the data to be forgotten. Working one level up may give cleaner removal with less damage to other skills. The approach offers a fresh route for honoring deletion requests in trained models.

Catalog record

CREATORAntonio Almudévar, Alfonso Ortega
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-21564

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Representation Unlearning: Forgetting through Information Compression Antonio Almudévar, Alfonso Ortega Abstract Machine unlearning seeks to remove the influence of specific training data from a model, a need driven by privacy regulations and robustness concerns. Existing approaches typically modify model parameters, but such updates can be unstable, computationally costly, and limited by local approximations. We introduce Representation Unlearning, a framework that performs unlearning directly in the model’s representation space. Instead of modifying model parameters, we learn a transformation over representations that imposes an information bottleneck: maximizing mutual information with retained data while suppressing information about data to be forgotten. We derive variational surrogates that make this objective tractable and show how they can be instantiated in two practical regimes: when both retain and forget data are available, and in a zero-shot setting where only forget data can be accessed. Experiments across several benchmarks demonstrate that Representation Unlearning achieves more reliable forgetting, better utility retention, and greater computational efficiency than parameter-centric baselines. 1 Introduction Modern machine learning systems are increasingly trained on massive, continuously evolving datasets that contain sensitive, personal, or potentially problematic information. As a consequence, there is a growing need for models that can forget specific training examples or subsets of data upon request. This requirement is amplified by regulatory frameworks such as the European Union GDPR ( 26 ) and California Consumer Privacy Act (CCPA) ( 34 ) , which enshrine a “right to be forgotten” ( 14 ) ; and by practical considerations such as the removal of mislabeled samples ( 32 ) , poisoned data ( 42 ) , or users who withdraw consent ( 36 ) . Simply deleting the raw data is insufficient: deep networks are known to memorize training information ( 3 ; 9 ; 15 ) , and their parameters often retain statistical traces of the removed samples ( 27 ; 8 ) . This has motivated a surge of interest in machine unlearning, the problem of efficiently removing the influence of designated data from a trained model ( 18 ) . More concretely, effective unlearning requires balancing two key criteria: (i) verifiability—ensuring that forget data cannot be reconstructed or detected, and (ii) utility—preserving performance on the retained data. Naively retraining a model from scratch after each deletion request guarantees perfect unlearning but is typically computationally prohibitive, especially in large-scale settings. This has motivated a growing body of work on efficient alternatives that approximate the effect of retraining without its full cost. Most existing approaches adopt a parameter-centric perspective, directly modifying model weights to remove the influence of deleted samples ( 8 ; 31 ) . While effective in some settings, this approach faces several limitations. First, many methods exhibit poor performance scalability, struggling to preserve model utility when applied to large-scale architectures and complex datasets ( 4 ; 46 ) . Second, parameter updates often require costly second-order information or multiple backward passes, narrowing their efficiency advantage over naive retraining ( 40 ) . Third, the requirement to potentially modify the entire parameter space results in heavy GPU usage, creating a computational bottleneck that scales poorly as model sizes increase ( 17 ; 28 ) . In this work, we introduce Representation Unlearning , a framework that departs from parameter-centric methods by operating directly in the model’s representation space. Rather than modifying or re-optimizing network parameters, our approach targets the internal representations, where the influence of individual samples is more localized and easier to control ( 6 ; 5 ; 29 ) . Representation Unlearning learns a transformation f_{\phi} that maps the original representation Z to a new one Z^{\prime} , enforcing an information bottleneck ( 45 ) : the transformed representation is encouraged to retain high mutual information with the data in the retain set \mathcal{D}_{r} while suppressing mutual information with the data in the forget set \mathcal{D}_{f} , as illustrated in Figure 1 . This information-theoretic objective enables targeted removal of undesired influences in the representation and preserving performance on the remaining data while sidestepping the instability and computational cost associated with parameter-level unlearning. As these mutual-information terms are generally intractable, we introduce variational approximations that yield efficient, optimizable surrogates ( 2 ; 38 ) . We then show how these surrogates can be instantiated under two complementary data-access regimes: (i) a setting where both retain and forget data are available; and (ii) a zero-shot scenario in which only the forget data can be accessed ( 12 ) . The first setting is the one implicitly assumed by most existing unlearning methods, as access to both subsets simplifies optimization ( 18 ; 8 ) . However, the second scenario, while more challenging, is equally important in practice: in many real-world applications, access to retained data may be restricted due to privacy, storage limitations, or organizational constraints ( 37 ; 25 ) . Addressing both regimes is therefore essential for developing unlearning methods that remain applicable beyond idealized experimental conditions. Figure 1 : The model is first trained on both the retain set \mathcal{D}_{r} (blue) and the forget set \mathcal{D}_{f} (red), leading the learned representation Z to encode information from both. Representation Unlearning seeks to learn a transformation f_{\phi} that maps Z to a new representation Z^{\prime} in which information attributable to \mathcal{D}_{f} is removed while information relevant to \mathcal{D}_{r} is preserved. 2 Related Work Baselines and Exact Methods in Machine Unlearning The gold standard, Retraining ( S_{\text{retrain}} ), guarantees exact unlearning by training from scratch on the retain set but is computationally prohibitive. The Baseline represents the original model trained on all data. Its naive approximation, Fine-tuning on the retain set, is efficient but often fails to fully erase information or suffers from catastrophic forgetting ( 23 ) . SISA ( 8 ) achieves exact unlearning by partitioning data into shards and retraining only the affected sub-models, though this incurs high storage and inference latency. Unlearning with Retain Data Access Most methods leverage retain data to preserve utility. Optimization-based approaches like Amnesiac ( 21 ) and UNSIR ( 43 ) reverse the learning trajectory by subtracting gradients or maximizing noise on the forget set. Distillation frameworks also prevail: SCRUB ( 24 ) alternates between maximizing forget-set error and minimizing retain-set distillation, while Bad Teacher ( 11 ) uses a competent teacher for retention and an incompetent one for forgetting. From a parameter perspective, SSD ( 16 ) masks parameters salient to the forget set. Information-theoretic methods, such as Fisher Forgetting and Variational Unlearning ( 19 ; 20 ) , utilize the Fisher Information Matrix to inject noise or constrain weights, protecting parameters crucial for the retain task. Crucially, unlike these approaches that manipulate the high-dimensional parameter space directly, our framework operates strictly in the representation space Zero-Shot and Forget-Only Unlearning In the restricted setting without retain data, Unroll ( 44 ) approximates the inverse training trajectory. Methods like GKT and EMMN ( 12 ) rely on generative models or prototypes to hallucinate retain samples, while Boundary Shrinking ( 10 ) directly shifts the decision boundary of the forget class. 3 Representation Unlearning 3.1 Problem Description We consider a learning setting in which a model receives inputs X\in\mathcal{X} and is trained to predict targets Y\in\mathcal{Y} . The model is trained on

Read the complete text