CiPO: Counterfactual Unlearning for Large Reasoning Models through Iterative Preference Optimization
Junyi Li, Yongqiang Chen, Ningning Ding · 2026
Read CiPO: Counterfactual Unlearning for Large Reasoning Models through Iterative Preference Optimization by Junyi Li, Yongqiang Chen, Ningning Ding (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-15847.txt.
Description
Li, Chen, and Ding introduce CiPO, a method for making large reasoning models forget facts without harming reasoning. Existing unlearning tools either leave traces in thought chains or damage reasoning itself. CiPO instead has the model write a logically valid counterfactual reasoning trace for the target answer. It then tunes preferences toward that trace, updating the tuning data in rounds to widen the gap from the original model. Tests show it removes target knowledge from both thought steps and final answers while preserving reasoning skill.
Catalog record
| CREATOR | Junyi Li, Yongqiang Chen, Ningning Ding |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57113 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.15847