Boule or Baguette? A Study on Task Topology, Length Generalization, and the Benefit of Reasoning Traces

William L. Tong, Ege Çakar, Cengiz Pehlevan · 2026

Read Boule or Baguette? A Study on Task Topology, Length Generalization, and the Benefit of Reasoning Traces by William L. Tong, Ege Çakar, Cengiz Pehlevan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-14404.txt.

Description

William L. Tong and two co-authors study a 2026 arXiv question about reasoning traces and length generalization. Reasoning models generate intermediate traces before final answers, but how those traces help, and where they fail, remains unclear. The paper introduces PITA, a dataset of over 23 million propositional logic statements with proofs.

The benchmark asks: if a model learns truth or falsity on statements with proofs up to a fixed length, how well does it handle longer proofs? Task depth counts steps to solve an example, while task breadth counts unique examples per task. Varying both across PITA subsets, reasoning-trace models generalized well on broad, shallow subsets but deteriorated on narrow, deep subsets relative to non-trace baselines, mapping the limits of trace-based reasoning.

Catalog record

CREATORWilliam L. Tong, Ege Çakar, Cengiz Pehlevan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE113 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-14404

Browse the full library · About the Tower of Babel