Learning to Self-Verify Makes Language Models Better Reasoners

Yuxin Chen, Yu Wang, Yi Zhang, Ziang Ye, Zhengzhou Cai, Yaorui Shi, Qi Gu, Hui Su, Xunliang Cai, Xiang Wang, An Zhang, Tat-Seng Chua · 2026

Read Learning to Self-Verify Makes Language Models Better Reasoners by Yuxin Chen, Yu Wang, Yi Zhang, Ziang Ye, Zhengzhou Cai, Yaorui Shi, Qi Gu, Hui Su, Xunliang Cai, Xiang Wang, An Zhang, Tat-Seng Chua (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07594.txt.

Description

Language models generate thinking paths well but verify their own answers poorly, an asymmetry that persists even as generation improves. Yuxin Chen and eleven co-authors investigate that gap through training and find the reverse direction behaves in other ways: learning to self-verify improves generation.

Models trained to verify reach accuracy comparable to standard generation training while producing more efficient and effective thinking traces. A multi-task reinforcement approach integrates checking into generation training. The work reframes checking from a post-hoc check into a training signal. Reasoning teams get evidence that teaching models to check their work also teaches them to reason better.

Catalog record

CREATORYuxin Chen, Yu Wang, Yi Zhang, Ziang Ye, Zhengzhou Cai, Yaorui Shi, Qi Gu, Hui Su, Xunliang Cai, Xiang Wang, An Zhang, Tat-Seng Chua
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-07594

Browse the full library · About the Tower of Babel