Not All Data Are Unlearned Equally
Aravind Krishnan B {}^{\text{B}}, Siva Reddy A {}^{\text{A}} C {}^{\text{C}}, Marius Mosbach A {}^{\text{A}} · 2025
Read Not All Data Are Unlearned Equally by Aravind Krishnan B {}^{\text{B}}, Siva Reddy A {}^{\text{A}} C {}^{\text{C}}, Marius Mosbach A {}^{\text{A}} (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-05058.txt.
Description
Machine unlearning promises to delete specific facts from a trained language model, for privacy or safety, but Aravind Krishnan, Siva Reddy, and Marius Mosbach show that not all facts delete equally. Forgetting that Montreal is a city in Canada is treated by today's methods exactly like forgetting a private phone number. The authors test whether the two are really alike, and find a strong pattern: how often a fact appeared in training data decides how hard it is to remove.
Frequent knowledge resists unlearning. The team also uncovered a measurement trap: judging success by the model's probabilities disagrees with judging by what it actually generates, and the gap widens in larger models. They argue unlearning methods and evaluations must account for training frequency, or privacy deletions may be declared that never really happened.
Catalog record
| CREATOR | Aravind Krishnan B {}^{\text{B}}, Siva Reddy A {}^{\text{A}} C {}^{\text{C}}, Marius Mosbach A {}^{\text{A}} |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-05058