CaTNiP : LLM Unlearning via Calibrated and Tokenized Negative Preference Alignment
Zhengbang Yang, Yisheng Zhong, Junyuan Hong, Zhuangdi Zhu · 2026
Read CaTNiP : LLM Unlearning via Calibrated and Tokenized Negative Preference Alignment by Zhengbang Yang, Yisheng Zhong, Junyuan Hong, Zhuangdi Zhu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02824.txt.
Description
Removing unwanted knowledge from large language models is the problem tackled in a 2026 paper by Zhengbang Yang and 3 co-authors. Their method, called CALIBURN, aims to erase unsafe or private material. At the same time, it tries to keep the model's general ability intact.
CALIBURN measures how confident the model is in the unwanted knowledge. It then uses that measure to adjust the unlearning updates more precisely. Tests on benchmarks named MUSE and WMDP show effective removal. The authors report a better balance between forgetting and keeping useful knowledge than earlier methods, with less need for large retention datasets.
Catalog record
| CREATOR | Zhengbang Yang, Yisheng Zhong, Junyuan Hong, Zhuangdi Zhu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-02824