Boule or Baguette? A Study on Task Topology, Length Generalization, and the Benefit of Reasoning Traces
William L. Tong, Ege Çakar, Cengiz Pehlevan · 2026
Read Boule or Baguette? A Study on Task Topology, Length Generalization, and the Benefit of Reasoning Traces by William L. Tong, Ege Çakar, Cengiz Pehlevan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-14404.txt.
Description
William L. Tong and two co-authors study a 2026 arXiv question about reasoning traces and length generalization. Reasoning models generate intermediate traces before final answers, but how those traces help, and where they fail, remains unclear. The paper introduces PITA, a dataset of over 23 million propositional logic statements with proofs.
The benchmark asks: if a model learns truth or falsity on statements with proofs up to a fixed length, how well does it handle longer proofs? Task depth counts steps to solve an example, while task breadth counts unique examples per task. Varying both across PITA subsets, reasoning-trace models generalized well on broad, shallow subsets but deteriorated on narrow, deep subsets relative to non-trace baselines, mapping the limits of trace-based reasoning.
Catalog record
| CREATOR | William L. Tong, Ege Çakar, Cengiz Pehlevan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 113 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-14404