Reliable Chain-of-Thought via Prefix Consistency
Naoto Iwase, Yuki Ichihara, Mohammad Atif Quamar, Junpei Komiyama · 2026
Read Reliable Chain-of-Thought via Prefix Consistency by Naoto Iwase, Yuki Ichihara, Mohammad Atif Quamar, Junpei Komiyama (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-07654.txt.
Description
Iwase and three colleagues offer a cheaper way to tell when a language model reasoning chain can be trusted. Models often improve by sampling several chain of thought traces and taking a majority vote, a method called self consistency. The team noticed that correct traces tend to reproduce their own answer when cut short and regenerated, while wrong traces wander.
They turn that gap into a reliability signal called prefix consistency, which weights each candidate answer by its reappearance rate when the remainder is regenerated. It works without token probabilities or model self ratings. Across five reasoning models and four maths and science benchmarks, prefix consistency predicts correctness better than rivals in most settings. Reweighting votes by it reaches standard majority vote plateau accuracy with far fewer tokens. The saving reaches up to twenty one times fewer tokens, with a median saving of four point six times.
Catalog record
| CREATOR | Naoto Iwase, Yuki Ichihara, Mohammad Atif Quamar, Junpei Komiyama |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 187 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.07654