Improving Unlearning with Model Updates Probably Aligned with Gradients
Virgile Dine, Teddy Furon, Charly Faure · 2025
Read Improving Unlearning with Model Updates Probably Aligned with Gradients by Virgile Dine, Teddy Furon, Charly Faure (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-02435.txt.
Description
Virgile Dine, Teddy Furon, and Charly Faure improve machine unlearning, the process of making a trained model forget specific data. They first reframe the whole problem as a constrained optimisation task, a formulation that unifies the existing family of first-order approximate unlearning methods. Within that frame they define feasible updates: directions for changing the model's parameters that advance forgetting without damaging the model's general usefulness.
Feasible updates are found by masking, carefully choosing which parameters are worth touching at all. The method also accounts for the noise in gradient estimates from each data batch, yielding a statistical guarantee that the chosen updates are locally feasible. Because the technique is an add-on, it can wrap around any first-order approximate unlearning method. Experiments with image classifiers confirmed that the plug-in improves the forgetting-versus-utility balance.
Catalog record
| CREATOR | Virgile Dine, Teddy Furon, Charly Faure |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-02435