Continual Unlearning for Foundational Text-to-Image Models without Generalization Erosion
Kartik Thakral, Tamar Glaser, Tal Hassner, Mayank Vatsa, Richa Singh · 2025
Read Continual Unlearning for Foundational Text-to-Image Models without Generalization Erosion by Kartik Thakral, Tamar Glaser, Tal Hassner, Mayank Vatsa, Richa Singh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-13769.txt.
Introduction
Kartik Thakral and colleagues published a computer science paper in 2025 on removing concepts from image generators. Text-to-image models sometimes produce unwanted or protected content. Retraining a huge model from scratch is impractical. The authors introduce continual unlearning: deleting concepts one after another, on demand.
Their method, called DUGE, uses three training goals together. One goal steers attention away from images containing the target concept. A second protects knowledge about related, allowed concepts. A third guards the model's general ability from wearing away. Experiments showed targeted concepts disappearing from generated images. Overall quality and unrelated concepts stayed largely intact. The approach may lower copyright and misuse risks.
Catalog record
| CREATOR | Kartik Thakral, Tamar Glaser, Tal Hassner, Mayank Vatsa, Richa Singh |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-13769
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Continual Unlearning for Foundational Text-to-Image Models without Generalization Erosion Kartik Thakral, Tamar Glaser, Tal Hassner, Mayank Vatsa, Richa Singh Abstract How can we effectively unlearn selected concepts from pre-trained generative foundation models without resorting to extensive retraining? This research introduces ‘continual unlearning’, a novel paradigm that enables the targeted removal of multiple specific concepts from foundational generative models, incrementally. We propose Decremental Unlearning without Generalization Erosion (DUGE) algorithm which selectively unlearns the generation of undesired concepts while preserving the generation of related, non-targeted concepts and alleviating generalization erosion. For this, DUGE targets three losses: a cross-attention loss that steers the focus towards images devoid of the target concept; a prior-preservation loss that safeguards knowledge related to non-target concepts; and a regularization loss that prevents the model from suffering from generalization erosion. Experimental results demonstrate the ability of the proposed approach to exclude certain concepts without compromising the overall integrity and performance of the model. This offers a pragmatic solution for refining generative models, adeptly handling the intricacies of model training and concept management lowering the risks of copyright infringement, personal or licensed material misuse, and replication of distinctive artistic styles. Importantly, it maintains the non-targeted concepts, thereby safeguarding the model’s core capabilities and effectiveness. Figure 1 : Continual Unlearning: Illustrating the methodology for selective forgetting in text-to-image foundational generative models like Midjourney, stable diffusion, and Imagen. This illustration outlines the multi-step process for the removal of specific concepts from the model’s knowledge while simultaneously ensuring that its ability to generalize over other concepts remains intact. 1 Introduction Recent advances in large-scale text-to-image models have been notable for synthesizing highly realistic images [ 31 , 28 , 35 , 33 ] . However, the training process for these models is resource-intensive, requiring extensive datasets, GPUs, and long periods of computation time. For instance, the training of Stable Diffusion on a subset of 2 billion images from the LAION-5B dataset [ 39 ] required about 250 hours using 256 GPUs. Training Imagen on the entire LAION-5B dataset took nearly 750 hours on 512 TPUs. The significant costs and environmental impact of training these foundational generative models are a growing concern. Furthermore, these training datasets, often sourced from the web [ 39 ] , may include copyrighted material, artistic works, and personal images [ 43 , 7 , 41 , 12 , 25 , 32 ] that the models learn and generate indiscriminately. This indiscriminate learning also extends to false information [ 6 , 44 , 53 ] , which can be spread through the generated images. With the emergence of AI regulations like CCPA [ 2 ] and GDPR [ 48 ] , creators should be able to get their images removed from these models. However, retraining models for each removal is not a viable option due to computational constraints. This research, therefore, focuses on effective continual unlearning to facilitate the forgetting of specific concepts in pre-trained text-to-image models [ 1 , 33 ] . We are guided by three crucial questions: (i) How can we ensure text-to-image models forget certain concepts without impairing their other functions? (ii) How can these models continually unlearn multiple concepts while maintaining their overall performance? (iii) How to assess the effectiveness of incremental unlearning in these models? To explore these research questions, we begin by defining the concept of continual unlearning in the context of text-to-image foundational generative models as: “Continual unlearning is the process of systematically and iteratively removing the knowledge of specific concepts from a generative model’s knowledge, effectively preventing it from synthesizing the previously unlearned concepts” . Since the objective is to forget multiple concepts from the model continually, the process is also interchangeably referred to as incremental unlearning . While current research has examined algorithms for correcting facts, updating concepts, and concept ablation [ 3 , 4 , 57 , 11 , 20 ] , none have discussed forgetting multiple concepts from a generative model. This paper addresses the gap by examining the complex issue of continual unlearning in text-to-image generative models. We also observe an interesting effect: as these models undergo incremental unlearning, they tend to exhibit a decline in their ability to generate images for various prompts. We refer to this phenomenon as “generalization erosion”, akin to the catastrophic forgetting observed in incremental learning of discriminative models. In addition, we propose efficient methods to assess the degree of continual unlearning in these models, both qualitatively and quantitatively. To address the challenging task of continual unlearning in generative models, we introduce DUGE: Decremental Unlearning without Generalization Erosion , a memory-centric algorithm designed to enable unlearning at each decremental step. This is accomplished by strategic intervention in the cross-attention layers of the model while concurrently applying regularization techniques to retain the model’s capability to generalize across unrelated concepts. The key contributions of this paper are as follows: 1. Canonicalization of continual unlearning concept in text-to-image foundational generative models. 2. Introduction of “Generalization Erosion,” a newly observed phenomenon in text-to-image generative models as a result of continual unlearning. 3. Formulation of DUGE , a novel memory-based algorithm tailored explicitly for decremental learning in text-to-image generative models. Experiments on our Dec-ImageNet-20 and MS-COCO datasets demonstrate that the algorithm successfully unlearns multiple concepts while retaining its ability to generalize concepts unrelated to the unlearning process. Furthermore, a user study shows an average performance of over 95% for continual unlearning. This highlights the algorithm’s effectiveness in continual unlearning and its resilience against the phenomenon of generalization erosion. 2 Related Work Recent advancements in machine learning have focused on the intertwined methods of concept editing and forgetting. Incremental learning is pivotal here, as it investigates how models can effectively assimilate new knowledge while preserving previously acquired concepts. Decremental learning, on the other hand, focuses on the intentional forgetting of target concepts without losing the generalizability over prior knowledge. The integration of both, incremental and decremental is instrumental in the progression of machine learning. Continual Learning: This focuses on creating models capable of continuously acquiring new concepts while retaining previously learned ones to address the challenge of catastrophic forgetting [ 24 , 27 ] . In this domain, class incremental learning involves introducing new classes sequentially to models, aiming to learn these new classes without compromising performance on existing ones. Class incremental learning approaches are broadly categorized into three groups: (i) regularization-based methods, which limit weight modifications to preserve knowledge [ 30 , 58 ] , (ii) dynamic architecture techniques, which adapt the model structure to accommodate new information [ 55 , 37 ] , and (iii) replay or generative replay mechanisms, designed to periodically revisit old tasks for reinforcement [ 17 , 8 ] . Recently, class-incremental learning has achieved notable advancements in computer vision, including self-supervised approaches [ 46 , 18 ] , which leverage unlabeled data, generative samplers and attention distillation methods for image classification [ 23 , 36 ] , and innovative prompt-based algorithms [ 51 , 42 , 52 ] . The ongoing progress in this field presents a promising direction for the development of adaptive systems to assimilate new visual knowledge. Generative Machine Unlearning: Concept editing and concept forgetting are two primary research threads in this domain. Foundational generative models, trained on