Easy to Learn, Yet Hard to Forget: Towards Robust Unlearning Under Bias

JuneHyoung Kwon, MiHyeon Kim, Eunju Lee, Yoonji Lee, Seunghoon Lee, YoungBin Kim · 2026

Read Easy to Learn, Yet Hard to Forget: Towards Robust Unlearning Under Bias by JuneHyoung Kwon, MiHyeon Kim, Eunju Lee, Yoonji Lee, Seunghoon Lee, YoungBin Kim (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-21773.txt.

Description

Machine unlearning lets a model forget specific data, a key tool for privacy and reliability, yet its power can collapse when models absorb unintended biases from spurious correlations. JuneHyoung Kwon and five co-authors study unlearning from such biased models and identify shortcut unlearning. Bias-aligned samples picked up quickly prove resistant to removal. What gets erased is the bias feature rather than the class feature, so accuracy on the category targeted for erasure can unexpectedly climb.

Their CUPID framework starts from the observation that samples with different biases show distinct loss landscape sharpness. It splits the forget set into causal- and bias-approximated subsets by sample sharpness. It disentangles model parameters into causal and bias pathways, and routes refined causal and bias gradients to their matching pathways. Tests on biased datasets including Waterbirds, BAR, and Biased NICO++ show state-of-the-art forgetting and effective mitigation of shortcut unlearning.

Catalog record

CREATORJuneHyoung Kwon, MiHyeon Kim, Eunju Lee, Yoonji Lee, Seunghoon Lee, YoungBin Kim
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-21773

Browse the full library · About the Tower of Babel