CaTNiP : LLM Unlearning via Calibrated and Tokenized Negative Preference Alignment

Zhengbang Yang, Yisheng Zhong, Junyuan Hong, Zhuangdi Zhu · 2026

Read CaTNiP : LLM Unlearning via Calibrated and Tokenized Negative Preference Alignment by Zhengbang Yang, Yisheng Zhong, Junyuan Hong, Zhuangdi Zhu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02824.txt.

Description

Removing unwanted knowledge from large language models is the problem tackled in a 2026 paper by Zhengbang Yang and 3 co-authors. Their method, called CALIBURN, aims to erase unsafe or private material. At the same time, it tries to keep the model's general ability intact.

CALIBURN measures how confident the model is in the unwanted knowledge. It then uses that measure to adjust the unlearning updates more precisely. Tests on benchmarks named MUSE and WMDP show effective removal. The authors report a better balance between forgetting and keeping useful knowledge than earlier methods, with less need for large retention datasets.

Catalog record

CREATORZhengbang Yang, Yisheng Zhong, Junyuan Hong, Zhuangdi Zhu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-02824

Browse the full library · About the Tower of Babel