Towards Lifecycle Unlearning Commitment Management: Measuring Sample-level Unlearning Completeness
Cheng-Long Wang 1,2 , Qi Li 1,2,3 , Zihang Xiang 1,2 , Yinzhi Cao 4 , Di Wang 1 , 2 \>\;{}^{1,2} 1 Provable Responsible AI and Data Analytics Lab 2 King Abdullah University of Science and Technology 3 National University of Singapore 4 Johns Hopkins University {chenglong.wang, zihang.xiang, di.wang} · 2025
Read Towards Lifecycle Unlearning Commitment Management: Measuring Sample-level Unlearning Completeness by Cheng-Long Wang 1,2 , Qi Li 1,2,3 , Zihang Xiang 1,2 , Yinzhi Cao 4 , Di Wang 1 , 2 \>\;{}^{1,2} 1 Provable Responsible AI and Data Analytics Lab 2 King Abdullah University of Science and Technology 3 National University of Singapore 4 Johns Hopkins University {chenglong.wang, zihang.xiang, di.wang} (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-06112.txt.
Description
Cheng-Long Wang and co-authors propose a way to measure how fully a trained model has forgotten a specific data sample. Machine unlearning matters for privacy, since removing data without full retraining saves great cost. The usual test, membership inference attacks, is costly to run well and gives only a yes-or-no answer about whether data was in training. That binary answer misses the gradual nature of most unlearning methods.
The proposed framework scores each sample by interpolating between how the model fits known data and how it handles new data. It matches attack-based tests on exact unlearning and tracks gradual unlearning closely, even for large language models, using just one extra shadow model. The authors then apply the score to recent unlearning methods. The results show risks on both sides: some methods erase too much, others too little, which argues for stronger checks on unlearning systems.
Catalog record
| CREATOR | Cheng-Long Wang 1,2 , Qi Li 1,2,3 , Zihang Xiang 1,2 , Yinzhi Cao 4 , Di Wang 1 , 2 \>\;{}^{1,2} 1 Provable Responsible AI and Data Analytics Lab 2 King Abdullah University of Science and Technology 3 National University of Singapore 4 Johns Hopkins University {chenglong.wang, zihang.xiang, di.wang} |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 99 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-06112