Enhancing LLM Metacognition via Cognitive Pairwise Training

Weitao Li, Hao Zhou, Xuanyu Lei, Fandong Meng, Yuanhang Liu, Jingyi Ren, Ante Wang, Xiaolong Wang, Yuanchi Zhang, Fuwen Luo, Guangwen Yang, Lin Gan, Weizhi Ma, Yang Liu · 2026

Read Enhancing LLM Metacognition via Cognitive Pairwise Training by Weitao Li, Hao Zhou, Xuanyu Lei, Fandong Meng, Yuanhang Liu, Jingyi Ren, Ante Wang, Xiaolong Wang, Yuanchi Zhang, Fuwen Luo, Guangwen Yang, Lin Gan, Weizhi Ma, Yang Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00869.txt.

Description

Li and co-authors teach language models to doubt themselves well in this 2026 paper. Reward-based training sharpens reasoning, but its outcome-only rewards breed bold answers on shaky grounds. Past fixes teach refusal at the reply level. That can drill in surface habits of saying no, not real judgment.

Their method, Cognitive Pairwise Training, is a mid-training stage. The model compares pairs of reasoning traces and learns to tell sound ones from flawed ones. That contrast builds an inner boundary for reasoning quality. The signal can then be reused, not spent on one reply style. Across five model sizes and three families, the trade-off improves, they report. At 14 billion parameters, their pipeline beats the standard one by 2.2 math points and 5.6 abstention points. Trace quality rises too, and the gains hold across settings.

Catalog record

CREATORWeitao Li, Hao Zhou, Xuanyu Lei, Fandong Meng, Yuanhang Liu, Jingyi Ren, Ante Wang, Xiaolong Wang, Yuanchi Zhang, Fuwen Luo, Guangwen Yang, Lin Gan, Weizhi Ma, Yang Liu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE220 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.00869

Browse the full library · About the Tower of Babel