Peer-Predictive Self-Training for Language Model Reasoning

Shi Feng, Hanlin Zhang, Fan Nie, Sham Kakade, Yiling Chen · 2026

Read Peer-Predictive Self-Training for Language Model Reasoning by Shi Feng, Hanlin Zhang, Fan Nie, Sham Kakade, Yiling Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-13356.txt.

Description

Feng and four colleagues propose Peer-Predictive Self-Training, a label-free way for language models to improve together without external supervision. Models answer sequentially, and their aggregated answer, usually more reliable than any single response, serves as an internal reference. Each intermediate response is scored by pointwise mutual information against the aggregate, so aligned responses receive smaller updates and misaligned ones larger updates. On maths reasoning benchmarks it lifts exact-match accuracy by two to four percentage points and shrinks the generator-verifier gap substantially.

Catalog record

CREATORShi Feng, Hanlin Zhang, Fan Nie, Sham Kakade, Yiling Chen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55983
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.13356

Browse the full library · About the Tower of Babel