Reliable Chain-of-Thought via Prefix Consistency

Naoto Iwase, Yuki Ichihara, Mohammad Atif Quamar, Junpei Komiyama · 2026

Read Reliable Chain-of-Thought via Prefix Consistency by Naoto Iwase, Yuki Ichihara, Mohammad Atif Quamar, Junpei Komiyama (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-07654.txt.

Description

Iwase and three colleagues offer a cheaper way to tell when a language model reasoning chain can be trusted. Models often improve by sampling several chain of thought traces and taking a majority vote, a method called self consistency. The team noticed that correct traces tend to reproduce their own answer when cut short and regenerated, while wrong traces wander.

They turn that gap into a reliability signal called prefix consistency, which weights each candidate answer by its reappearance rate when the remainder is regenerated. It works without token probabilities or model self ratings. Across five reasoning models and four maths and science benchmarks, prefix consistency predicts correctness better than rivals in most settings. Reweighting votes by it reaches standard majority vote plateau accuracy with far fewer tokens. The saving reaches up to twenty one times fewer tokens, with a median saving of four point six times.

Catalog record

CREATORNaoto Iwase, Yuki Ichihara, Mohammad Atif Quamar, Junpei Komiyama
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE187 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.07654

Browse the full library · About the Tower of Babel