Enhancing LLM Metacognition via Cognitive Pairwise Training
Weitao Li, Hao Zhou, Xuanyu Lei, Fandong Meng, Yuanhang Liu, Jingyi Ren, Ante Wang, Xiaolong Wang, Yuanchi Zhang, Fuwen Luo, Guangwen Yang, Lin Gan, Weizhi Ma, Yang Liu · 2026
Read Enhancing LLM Metacognition via Cognitive Pairwise Training by Weitao Li, Hao Zhou, Xuanyu Lei, Fandong Meng, Yuanhang Liu, Jingyi Ren, Ante Wang, Xiaolong Wang, Yuanchi Zhang, Fuwen Luo, Guangwen Yang, Lin Gan, Weizhi Ma, Yang Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00869.txt.
Description
Li and co-authors teach language models to doubt themselves well in this 2026 paper. Reward-based training sharpens reasoning, but its outcome-only rewards breed bold answers on shaky grounds. Past fixes teach refusal at the reply level. That can drill in surface habits of saying no, not real judgment.
Their method, Cognitive Pairwise Training, is a mid-training stage. The model compares pairs of reasoning traces and learns to tell sound ones from flawed ones. That contrast builds an inner boundary for reasoning quality. The signal can then be reused, not spent on one reply style. Across five model sizes and three families, the trade-off improves, they report. At 14 billion parameters, their pipeline beats the standard one by 2.2 math points and 5.6 abstention points. Trace quality rises too, and the gains hold across settings.
Catalog record
| CREATOR | Weitao Li, Hao Zhou, Xuanyu Lei, Fandong Meng, Yuanhang Liu, Jingyi Ren, Ante Wang, Xiaolong Wang, Yuanchi Zhang, Fuwen Luo, Guangwen Yang, Lin Gan, Weizhi Ma, Yang Liu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 220 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.00869