Reviving Your MNEME: Predicting The Side Effects of LLM Unlearning and Fine-Tuning via Sparse Model Diffing This paper contains text that might be offensive.
Aly M. Kassem, Zhuan Shi, Negar Rostamzadeh, Golnoosh Farnadi · 2025
Read Reviving Your MNEME: Predicting The Side Effects of LLM Unlearning and Fine-Tuning via Sparse Model Diffing This paper contains text that might be offensive. by Aly M. Kassem, Zhuan Shi, Negar Rostamzadeh, Golnoosh Farnadi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-21084.txt.
Description
Aly Kassem and co-authors present a 2025 method for spotting side effects when large language models are changed. Models are often fine tuned for new tasks or taught to unlearn unwanted content. Standard tests check the target task after such a change, but side effects on other tasks can be missed. Losing biology content, for one case, might also hurt chemistry work in ways no one expects.
Their method, called MNEME, compares the base and changed models on broad data not tied to any one task. It uses sparse diffing to pick out shifts in behavior. Across five models and three settings, it predicted side effects with up to ninety five percent accuracy. The team also show that retraining on the most active samples can partly undo those side effects.
Catalog record
| CREATOR | Aly M. Kassem, Zhuan Shi, Negar Rostamzadeh, Golnoosh Farnadi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-21084