Distinguishable Deletion: Unifying Knowledge Erasure and Refusal for Large Language Model Unlearning
Puning Yang, Junchi Yu, Qizhou Wang, Philip Torr, Bo Han, Xiuying Chen · 2026
Read Distinguishable Deletion: Unifying Knowledge Erasure and Refusal for Large Language Model Unlearning by Puning Yang, Junchi Yu, Qizhou Wang, Philip Torr, Bo Han, Xiuying Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16776.txt.
Introduction
Yang and colleagues propose Distinguishable Deletion, an approach that unifies knowledge erasure and refusal for language-model removal. Erasure struggles with biased erasure from hiding token strings, while refusal risks harmful knowledge coming back because it stays intact. It restricts the response spread in latent space rather than set tokens, splitting dropped from kept knowledge so refusal can handle dropped inputs safely. An energy index tracks knowledge amount and gap, driving energy-based tuning in training and energy-based refusal at use. Tests show it clearly beats prior methods.
Catalog record
| CREATOR | Puning Yang, Junchi Yu, Qizhou Wang, Philip Torr, Bo Han, Xiuying Chen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 137282 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.16776