Easy to Learn, Yet Hard to Forget: Towards Robust Unlearning Under Bias
JuneHyoung Kwon, MiHyeon Kim, Eunju Lee, Yoonji Lee, Seunghoon Lee, YoungBin Kim · 2026
Read Easy to Learn, Yet Hard to Forget: Towards Robust Unlearning Under Bias by JuneHyoung Kwon, MiHyeon Kim, Eunju Lee, Yoonji Lee, Seunghoon Lee, YoungBin Kim (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-21773.txt.
Description
Machine unlearning lets a model forget specific data, a key tool for privacy and reliability, yet its power can collapse when models absorb unintended biases from spurious correlations. JuneHyoung Kwon and five co-authors study unlearning from such biased models and identify shortcut unlearning. Bias-aligned samples picked up quickly prove resistant to removal. What gets erased is the bias feature rather than the class feature, so accuracy on the category targeted for erasure can unexpectedly climb.
Their CUPID framework starts from the observation that samples with different biases show distinct loss landscape sharpness. It splits the forget set into causal- and bias-approximated subsets by sample sharpness. It disentangles model parameters into causal and bias pathways, and routes refined causal and bias gradients to their matching pathways. Tests on biased datasets including Waterbirds, BAR, and Biased NICO++ show state-of-the-art forgetting and effective mitigation of shortcut unlearning.
Catalog record
| CREATOR | JuneHyoung Kwon, MiHyeon Kim, Eunju Lee, Yoonji Lee, Seunghoon Lee, YoungBin Kim |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-21773