Pre-Forgettable Models: Prompt Learning as a Native Mechanism for Unlearning Conference: Proceedings of the 33rd ACM International Conference on Multimedia; October 27–31, 2025; Dublin, Ireland Proceedings of the 33rd ACM International Conference on Multimedia (MM ’25), October 27–31, 2025, Dublin,
Rutger Hendrix, Giovanni Patanè, Leonardo G. Russo, Simone Carnemolla, Federica Proietto Salanitri, Giovanni Bellitto, Concetto Spampinato, Matteo Pennisi · 2025
Read Pre-Forgettable Models: Prompt Learning as a Native Mechanism for Unlearning Conference: Proceedings of the 33rd ACM International Conference on Multimedia; October 27–31, 2025; Dublin, Ireland Proceedings of the 33rd ACM International Conference on Multimedia (MM ’25), October 27–31, 2025, Dublin, by Rutger Hendrix, Giovanni Patanè, Leonardo G. Russo, Simone Carnemolla, Federica Proietto Salanitri, Giovanni Bellitto, Concetto Spampinato, Matteo Pennisi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-15230.txt.
Introduction
Rutger Hendrix and seven co-authors design foundation models that can forget on request from the start in a 2025 machine learning paper. Privacy law, including the GDPR, can require deleting what a model learned from specific data. Retrofitting forgetting through retraining or weight editing is expensive and fragile, especially for systems that update continuously.
Their prompt learning framework makes unlearning a native capability rather than an afterthought. Class-level meaning is bound to dedicated prompt tokens instead of being baked into model weights. Training then unifies learning and removal in one phase: drop the token, and the associated knowledge goes with it. The design targets real-time and evolving deployments where deletion requests arrive as a stream, not as rare emergencies.
Catalog record
| CREATOR | Rutger Hendrix, Giovanni Patanè, Leonardo G. Russo, Simone Carnemolla, Federica Proietto Salanitri, Giovanni Bellitto, Concetto Spampinato, Matteo Pennisi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-15230
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Pre-Forgettable Models: Prompt Learning as a Native Mechanism for Unlearning Conference: Proceedings of the 33rd ACM International Conference on Multimedia; October 27–31, 2025; Dublin, Ireland Proceedings of the 33rd ACM International Conference on Multimedia (MM ’25), October 27–31, 2025, Dublin, Ireland DOI: 10.1145/3746027.3758171 ISBN: 979-8-4007-2035-2/2025/10 CCS: Computing methodologies Learning settings Rutger Hendrix, Giovanni Patanè, Leonardo G. Russo, Simone Carnemolla, Federica Proietto Salanitri, Giovanni Bellitto, Concetto Spampinato, Matteo Pennisi Abstract . Foundation models have transformed multimedia analysis by enabling robust and transferable representations across diverse modalities and tasks. However, their static deployment conflicts with growing societal and regulatory demands—particularly the need to unlearn specific data upon request, as mandated by privacy frameworks such as the GDPR. Traditional unlearning approaches, including retraining, activation editing, or distillation, are often computationally expensive, fragile, and ill-suited for real-time or continuously evolving systems. In this paper, we propose a paradigm shift: rethinking unlearning not as a retroactive intervention but as a built-in capability . We introduce a prompt-based learning framework that unifies knowledge acquisition and removal within a single training phase. Rather than encoding information in model weights, our approach binds class-level semantics to dedicated prompt tokens. This design enables instant unlearning simply by removing the corresponding prompt—without retraining, model modification, or access to original data. Experiments demonstrate that our framework preserves predictive performance on retained classes while effectively erasing forgotten ones. Beyond utility, our method exhibits strong privacy and security guarantees: it is resistant to membership inference attacks, and prompt removal prevents any residual knowledge extraction, even under adversarial conditions. This ensures compliance with data protection principles and safeguards against unauthorized access to forgotten information, making the framework suitable for deployment in sensitive and regulated environments. Overall, by embedding removability into the architecture itself, this work establishes a new foundation for designing modular, scalable and ethically responsive AI models. † † cc-license: by 1. Introduction The advent of foundation models has significantly advanced multimedia understanding by enabling robust and transferable representations across a wide range of modalities and tasks ( Dosovitskiy et al. 2021 ; Ramesh et al. 2021 ; He et al. 2022 ) . These models, often pretrained on large-scale visual, textual, or multimodal datasets, form the backbone of state-of-the-art systems in image captioning, video retrieval, speech analysis, and more. However, despite their utility, the static and opaque nature of foundation models poses a growing concern in privacy-sensitive, safety-critical, and dynamically evolving domains. In such settings, models are not only expected to learn from large volumes of data but also to unlearn—that is, to remove specific knowledge or data influence efficiently, verifiably, and on demand. Unlearning refers to the process of removing the contribution of certain data from a trained model while preserving its utility on the rest of the distribution. This is increasingly crucial in multimedia applications that involve personal, biometric, or copyrighted content. For example, removing user data from recommender systems, retracting learned associations from mistaken annotations in vision-language models, or erasing sensitive speech recordings from audio models all call for effective unlearning capabilities. Regulatory frameworks such as the GDPR ( Voigt and Von dem Bussche 2017 ) institutionalize this demand through the “right to be forgotten,” mandating systems to eliminate data traces upon request. Beyond compliance, unlearning supports fairness, adaptability, and continual learning, helping models evolve while avoiding the retention of outdated or biased knowledge ( Takshi 2020 ) . A recent survey by Nasirigerdeh et al. ( Xu et al. 2023 ) categorizes existing techniques into three main families: exact unlearning (e.g., retraining from scratch), certified removal (e.g., influence function reversal), and approximate forgetting using parameter perturbations or distillation. While these methods are theoretically sound, most rely on post hoc interventions that require retraining, auxiliary models, or access to the original training data—factors that hinder deployment in dynamic, privacy-sensitive, or real-time systems. Several more targeted strategies aim to reduce this overhead. For instance, SISA ( Bourtoule et al. 2021 ) partitions training data for selective retraining; gradient-negation techniques ( Mahadevan and Mathioudakis 2022 ) attempt to counteract specific representations; and decomposition-based methods ( Kodge et al. 2023 ) isolate class-discriminative features in latent space. Others, such as SSD ( Foster et al. 2024 ) and EU-k/CF-k ( Goel et al. 2022 ) , modify only subsets of parameters using importance-based reweighting or layer-wise resets. Teacher-student models ( Chundawat et al. 2023 ) and prompt-based strategies ( Xu et al. [n. d.] ) offer more modular mechanisms, but still require separate unlearning stages and incur nontrivial training costs. In practice, most of these methods suffer from one or more critical limitations: the need for extensive retraining, assumptions about architecture or data availability, and limited compatibility with frozen foundation models. These constraints make them difficult to adopt in real-world multimedia systems, where models must remain continuously available, adaptable, and compliant with evolving privacy requirements. To address these limitations: embedding unlearning directly into the learning process, rather than relying on post hoc corrections. Our goal is to design a mechanism that enables modular, efficient, and interpretable unlearning, aligned with the demands of real-world deployment. At a high level, our strategy leverages the emerging paradigm of prompt-based learning, but reinterprets its purpose. While prior work ( Lester et al. 2021 ; Liu et al. 2022 ; Zhou et al. 2022 ) primarily uses prompts to enhance task adaptation, we treat them as containers for class-specific knowledge that can be independently manipulated, specifically, removed. This transforms prompts into modular units of representation, decoupled from the model’s core parameters. Concretely, we introduce a class-specific prompting framework in which each class is associated with a dedicated, learnable prompt token. During training, only the prompts, adapters, and classifier head are updated, while the foundation model backbone remains frozen. This ensures that knowledge remains localized within prompts, enabling immediate and targeted unlearning by simply removing the corresponding prompt—without modifying the model’s weights, accessing training data, or triggering any retraining procedure. This design has several important implications. First, it enables a native mechanism (without requiring any retraining) for unlearning: forgetting is achieved on-the-fly, even during sequential inference. Second, it supports data-free and interpretable unlearning—removal of a prompt leads to abstention or uniform predictions, clearly indicating the absence of learned knowledge. Finally, the frozen backbone prevents interference with retained classes and ensures computational efficiency and robustness, even in continual learning or edge settings. Collectively, these properties establish our framework as a practical and scalable solution for unlearning in foundation models. To validate our approach, we conducted extensive experiments across three medical image classification tasks from the MedMNIST v2 benchmark—BloodMNIST, DermaMNIST, and OrganMNIST—using a frozen Vision Transformer (ViT) with shallow prompt tuning and LoRa adapters. We evaluated unlearning by measuring performance on retained and forgotten classes under three settings: forgetting one class, half of the classes, or all but one. Additional experiments were performed on UrbanSound8K (audio) to assess applicability across modalities. Across all datasets, our method achieves near-random accuracy on forgotten classes while maintaining high performance on retained ones—without retraining, architectural modification, or access to original data. Ablation and privacy analyses further confirm the method’s efficiency, interpretability, and robustness. These results highlight the key advantages of our framework: it is modular, retraining-free, data-free, and inherently privacy-preserving—making it uniquely suited for