Reviving Your MNEME: Predicting The Side Effects of LLM Unlearning and Fine-Tuning via Sparse Model Diffing This paper contains text that might be offensive.

Aly M. Kassem, Zhuan Shi, Negar Rostamzadeh, Golnoosh Farnadi · 2025

Read Reviving Your MNEME: Predicting The Side Effects of LLM Unlearning and Fine-Tuning via Sparse Model Diffing This paper contains text that might be offensive. by Aly M. Kassem, Zhuan Shi, Negar Rostamzadeh, Golnoosh Farnadi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-21084.txt.

Description

Aly Kassem and co-authors present a 2025 method for spotting side effects when large language models are changed. Models are often fine tuned for new tasks or taught to unlearn unwanted content. Standard tests check the target task after such a change, but side effects on other tasks can be missed. Losing biology content, for one case, might also hurt chemistry work in ways no one expects.

Their method, called MNEME, compares the base and changed models on broad data not tied to any one task. It uses sparse diffing to pick out shifts in behavior. Across five models and three settings, it predicted side effects with up to ninety five percent accuracy. The team also show that retraining on the most active samples can partly undo those side effects.

Catalog record

CREATORAly M. Kassem, Zhuan Shi, Negar Rostamzadeh, Golnoosh Farnadi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-21084

Browse the full library · About the Tower of Babel