Machine Unlearning under Overparameterization
Jacob L. Block, Aryan Mokhtari *, Sanjay Shakkottai * · 2025
Read Machine Unlearning under Overparameterization by Jacob L. Block, Aryan Mokhtari *, Sanjay Shakkottai * (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-22601.txt.
Description
Block, Mokhtari, and Shakkottai tackle machine unlearning in very large models in this two thousand twenty-five paper. Unlearning means removing the influence of specific training examples, as if the model had never seen them.
In oversized models, many different settings fit the remaining data perfectly, so the usual definition of the unlearned model breaks down and gradient tricks stop working. The team defines the target as the simplest model that still fits the kept data, and gives an algorithm that works from gradients on that kept set alone. Their method comes with guarantees for several model types and beat existing approaches in tests. The results matter for privacy requests and for fixing models trained on bad data.
Catalog record
| CREATOR | Jacob L. Block, Aryan Mokhtari *, Sanjay Shakkottai * |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 119 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-22601