Distinguishable Deletion: Unifying Knowledge Erasure and Refusal for Large Language Model Unlearning

Puning Yang, Junchi Yu, Qizhou Wang, Philip Torr, Bo Han, Xiuying Chen · 2026

Read Distinguishable Deletion: Unifying Knowledge Erasure and Refusal for Large Language Model Unlearning by Puning Yang, Junchi Yu, Qizhou Wang, Philip Torr, Bo Han, Xiuying Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16776.txt.

Introduction

Yang and colleagues propose Distinguishable Deletion, an approach that unifies knowledge erasure and refusal for language-model removal. Erasure struggles with biased erasure from hiding token strings, while refusal risks harmful knowledge coming back because it stays intact. It restricts the response spread in latent space rather than set tokens, splitting dropped from kept knowledge so refusal can handle dropped inputs safely. An energy index tracks knowledge amount and gap, driving energy-based tuning in training and energy-based refusal at use. Tests show it clearly beats prior methods.

Catalog record

CREATORPuning Yang, Junchi Yu, Qizhou Wang, Philip Torr, Bo Han, Xiuying Chen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE137282
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16776

Browse the full library · About the Tower of Babel