Towards Lifecycle Unlearning Commitment Management: Measuring Sample-level Unlearning Completeness

Cheng-Long Wang 1,2 , Qi Li 1,2,3 , Zihang Xiang 1,2 , Yinzhi Cao 4 , Di Wang 1 , 2 \>\;{}^{1,2} 1 Provable Responsible AI and Data Analytics Lab 2 King Abdullah University of Science and Technology 3 National University of Singapore 4 Johns Hopkins University {chenglong.wang, zihang.xiang, di.wang} · 2025

Read Towards Lifecycle Unlearning Commitment Management: Measuring Sample-level Unlearning Completeness by Cheng-Long Wang 1,2 , Qi Li 1,2,3 , Zihang Xiang 1,2 , Yinzhi Cao 4 , Di Wang 1 , 2 \>\;{}^{1,2} 1 Provable Responsible AI and Data Analytics Lab 2 King Abdullah University of Science and Technology 3 National University of Singapore 4 Johns Hopkins University {chenglong.wang, zihang.xiang, di.wang} (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-06112.txt.

Description

Cheng-Long Wang and co-authors propose a way to measure how fully a trained model has forgotten a specific data sample. Machine unlearning matters for privacy, since removing data without full retraining saves great cost. The usual test, membership inference attacks, is costly to run well and gives only a yes-or-no answer about whether data was in training. That binary answer misses the gradual nature of most unlearning methods.

The proposed framework scores each sample by interpolating between how the model fits known data and how it handles new data. It matches attack-based tests on exact unlearning and tracks gradual unlearning closely, even for large language models, using just one extra shadow model. The authors then apply the score to recent unlearning methods. The results show risks on both sides: some methods erase too much, others too little, which argues for stronger checks on unlearning systems.

Catalog record

CREATORCheng-Long Wang 1,2 , Qi Li 1,2,3 , Zihang Xiang 1,2 , Yinzhi Cao 4 , Di Wang 1 , 2 \>\;{}^{1,2} 1 Provable Responsible AI and Data Analytics Lab 2 King Abdullah University of Science and Technology 3 National University of Singapore 4 Johns Hopkins University {chenglong.wang, zihang.xiang, di.wang}
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE99 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-06112

Browse the full library · About the Tower of Babel