Model State Arithmetic for Machine Unlearning
Keivan RezaeiUniversity of Maryland [email protected], Mehrdad SaberiUniversity of Maryland [email protected], Abhilasha RavichanderUniversity of Washington [email protected], Soheil FeiziUniversity of Maryland [email protected] · 2025
Read Model State Arithmetic for Machine Unlearning by Keivan RezaeiUniversity of Maryland [email protected], Mehrdad SaberiUniversity of Maryland [email protected], Abhilasha RavichanderUniversity of Washington [email protected], Soheil FeiziUniversity of Maryland [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-20941.txt.
Introduction
Keivan Rezaei and co-authors propose a new way in 2025 to make a large language model forget the effect of set data points. Models train on huge web sets that can hold private, copied, or false text, and full retraining is far too costly.
Their method, called model state arithmetic, uses saved checkpoints from stages of the first training run. Those old states help gauge and cancel the pull of the points to be erased, while the rest of the model stays intact. Tests across benchmarks, models, and measures showed the method matched or beat other unlearning methods. The authors see it as a step toward models that can erase data on demand.
Catalog record
| CREATOR | Keivan RezaeiUniversity of Maryland [email protected], Mehrdad SaberiUniversity of Maryland [email protected], Abhilasha RavichanderUniversity of Washington [email protected], Soheil FeiziUniversity of Maryland [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-20941
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Model State Arithmetic for Machine Unlearning Keivan RezaeiUniversity of Maryland [email protected], Mehrdad SaberiUniversity of Maryland [email protected], Abhilasha RavichanderUniversity of Washington [email protected], Soheil FeiziUniversity of Maryland [email protected] Abstract Large language models are trained on massive corpora of web data, which may include private data, copyrighted material, factually inaccurate data, or data that degrades model performance. Eliminating the influence of such problematic datapoints through complete retraining—by repeatedly pretraining the model on datasets that exclude these specific instances—is computationally prohibitive. For this reason, unlearning algorithms have emerged that aim to eliminate the influence of particular datapoints, while otherwise preserving the model— at a low computational cost. However, precisely estimating and undoing the influence of individual datapoints has proved to be challenging. In this work, we propose a new algorithm, Msa , for estimating and undoing the influence of datapoints— by leveraging model checkpoints, i.e., artifacts capturing model states at different stages of pretraining. Our experimental results demonstrate that Msa consistently outperforms existing machine unlearning algorithms across multiple benchmarks, models, and evaluation metrics, suggesting that Msa could be an effective approach towards more flexible large language models that are capable of data erasure. 1 1 1 Code is available at github.com/mehrdadsaberi/MSA_unlearning . † † footnotetext: ∗ Equal contribution as first authors. † † footnotetext: † Equal contribution as last authors. 1 Introduction Modern Large Language Models (LLMs) are trained on vast web-scale corpora [ 11 , 1 , 27 , 17 ] . During training, these models encounter and encode adverse or contentious datapoints including copyrighted materials, private or sensitive information, deliberate misinformation, and other low-quality data [ 7 , 19 , 28 , 34 ] . This exposure can create a range of serious downstream risks, including legal liabilities from copyright infringement [ 12 ] , ethical violations of privacy [ 7 , 19 ] , and measurement issues from training on contaminated data [ 16 ] . Moreover, once a model has been trained on such data, it becomes computationally infeasible to remove its effects simply by retraining on datasets that exclude those instances. Yet, with the increased scale of data that is being ingested by models and to support potential regulatory frameworks such as the EU’s “Right to Be Forgotten” [ 6 ] in order to protect data privacy, it is imperative to develop tractable techniques that can undo the effect of specific data from a model. Machine unlearning methods have been proposed as one such solution, by post-hoc model updates that erase the effect of particular datapoints at low computational cost [ 36 , 22 , 35 , 21 , 12 , 29 ] . A common approach involves finetuning the model with an unlearning objective— for example, gradient ascent-based approaches that aim to increase the loss of the model on the datapoints to be forgotten [ 35 , 15 ] . Such methods should both remove the effect of the datapoints to be unlearned— including erasing any new knowledge they introduce— while preserving the integrity of the model, i.e., retaining the knowledge and capabilities the model would have had without encountering those datapoints. However, the development of effective unlearning methods to remove data has proven challenging, as evidenced by either under-forgetting or failing to preserve the integrity of the model [ 31 , 32 ] . In this work, we propose a new approach to machine unlearning, Msa , that better satisfies both of these properties, without compromising either. As shown in Figure 1 , Msa leverages intermediate model checkpoints (prior to exposure to unlearning documents) to more precisely estimate and undo the influence of individual datapoints compared to previous approaches. Model providers store such checkpoints periodically through the training process for experimentation and for better fault tolerance in case of failures during training. Msa utilizes a checkpoint C to compute a forget vector \theta_{\text{f}} , by capturing the direction of change in model parameters associated with the target datapoints \mathcal{D}_{\text{f}} to be unlearned. The forget vector is then applied to the target model \theta_{\mathcal{D}} to remove the effect of \mathcal{D}_{\text{f}} . We evaluate Msa on TOFU [ 26 ] and RESTOR [ 31 ] machine unlearning benchmarks, across a range of evaluation metrics. Empirical results demonstrate that Msa repurposes training checkpoints into useful artifacts that can help remove unwanted information from models, while preserving the integrity of the model. By framing unlearning as arithmetic over the parameter space of models, our main contributions are the following: 1. We demonstrate how Msa can help align a model \theta_{\mathcal{D}} ’s behavior to more closely match that of an ideal reference model \theta_{\mathcal{D}\setminus\mathcal{D}_{\text{f}}} , i.e., the unlearned model closely approximates a model that has not been exposed to the unlearning target. 2. Msa consistently outperforms or remains competitive with prior methods, such as NPO [ 36 ] , RMU [ 25 ] , and GradDiff [ 35 ] , across multiple unlearning scenarios and evaluation metrics. 3. Machine unlearning algorithms often require specification of a retain set to prevent model collapse [ 35 ] , a set of examples that a model must maintain its performance on. We show that Msa preserves high utility even when no retain set is provided. 4. We study how the effectiveness of Msa depends on the closeness of the checkpoint, i.e., the number of training tokens between the checkpoint C and the unlearning target. We find that closer checkpoints enable better unlearning performance, but even checkpoints that are a trillion tokens away from the unlearning target can be effective with Msa . Figure 1 : Our proposed framework Msa . Training occurs over several steps, starting from an initial checkpoint (a). At checkpoint (c), the unlearning documents \mathcal{D}_{\text{f}} are unintentionally introduced during training. At an intermediate checkpoint (b), we extract a forget vector \vec{\theta}_{\text{f}} that captures how \mathcal{D}_{\text{f}} influences the model. This vector is then merged into the final model (d) to produce an unlearned model that approximates the behavior of an ideal model trained on \mathcal{D}\setminus\mathcal{D}_{\text{f}} . Unlike existing unlearning methods that operate solely on the final model checkpoint, Msa leverages earlier training dynamics to more effectively remove the influence of \mathcal{D}_{\text{f}} . 2 Background and Related Work Machine unlearning was originally developed in order to remove privacy-sensitive information from machine learning models [ 5 ] . Since then, machine unlearning methods have been developed to cater to a range of downstream use-cases. At a high-level, these can be formulated as (i) concept-level unlearning methods that target knowledge of a particular concept within a model [ 3 , 12 , 18 , 25 , 33 ] , such as ‘hazardous’ concepts [ 25 ] , sexually explicit content [ 14 ] , or knowledge pertaining to a specific topic [ 12 , 18 ] . Informally, these problems are formulated as ’I do not want my model to generate content related to X’ , where X is a concept such as ‘Harry Potter’, (ii) data-level unlearning which aims to remove the influence of a set of target datapoints on the model, drawn from a model’s training dataset [ 22 , 26 , 21 , 36 , 29 , 4 , 13 , 24 ] , enabling the removal of sensitive or private data [