Machine Unlearning under Overparameterization

Jacob L. Block, Aryan Mokhtari *, Sanjay Shakkottai * · 2025

Read Machine Unlearning under Overparameterization by Jacob L. Block, Aryan Mokhtari *, Sanjay Shakkottai * (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-22601.txt.

Description

Block, Mokhtari, and Shakkottai tackle machine unlearning in very large models in this two thousand twenty-five paper. Unlearning means removing the influence of specific training examples, as if the model had never seen them.

In oversized models, many different settings fit the remaining data perfectly, so the usual definition of the unlearned model breaks down and gradient tricks stop working. The team defines the target as the simplest model that still fits the kept data, and gives an algorithm that works from gradients on that kept set alone. Their method comes with guarantees for several model types and beat existing approaches in tests. The results matter for privacy requests and for fixing models trained on bad data.

Catalog record

CREATORJacob L. Block, Aryan Mokhtari *, Sanjay Shakkottai *
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE119 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-22601

Browse the full library · About the Tower of Babel