Learning to Self-Verify Makes Language Models Better Reasoners
Yuxin Chen, Yu Wang, Yi Zhang, Ziang Ye, Zhengzhou Cai, Yaorui Shi, Qi Gu, Hui Su, Xunliang Cai, Xiang Wang, An Zhang, Tat-Seng Chua · 2026
Read Learning to Self-Verify Makes Language Models Better Reasoners by Yuxin Chen, Yu Wang, Yi Zhang, Ziang Ye, Zhengzhou Cai, Yaorui Shi, Qi Gu, Hui Su, Xunliang Cai, Xiang Wang, An Zhang, Tat-Seng Chua (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07594.txt.
Description
Language models generate thinking paths well but verify their own answers poorly, an asymmetry that persists even as generation improves. Yuxin Chen and eleven co-authors investigate that gap through training and find the reverse direction behaves in other ways: learning to self-verify improves generation.
Models trained to verify reach accuracy comparable to standard generation training while producing more efficient and effective thinking traces. A multi-task reinforcement approach integrates checking into generation training. The work reframes checking from a post-hoc check into a training signal. Reasoning teams get evidence that teaching models to check their work also teaches them to reason better.
Catalog record
| CREATOR | Yuxin Chen, Yu Wang, Yi Zhang, Ziang Ye, Zhengzhou Cai, Yaorui Shi, Qi Gu, Hui Su, Xunliang Cai, Xiang Wang, An Zhang, Tat-Seng Chua |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-07594