Peer-Predictive Self-Training for Language Model Reasoning
Shi Feng, Hanlin Zhang, Fan Nie, Sham Kakade, Yiling Chen · 2026
Read Peer-Predictive Self-Training for Language Model Reasoning by Shi Feng, Hanlin Zhang, Fan Nie, Sham Kakade, Yiling Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-13356.txt.
Description
Feng and four colleagues propose Peer-Predictive Self-Training, a label-free way for language models to improve together without external supervision. Models answer sequentially, and their aggregated answer, usually more reliable than any single response, serves as an internal reference. Each intermediate response is scored by pointwise mutual information against the aggregate, so aligned responses receive smaller updates and misaligned ones larger updates. On maths reasoning benchmarks it lifts exact-match accuracy by two to four percentage points and shrinks the generator-verifier gap substantially.
Catalog record
| CREATOR | Shi Feng, Hanlin Zhang, Fan Nie, Sham Kakade, Yiling Chen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55983 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.13356