Shape of Thought: When Distribution Matters More than Correctness in Reasoning Tasks
Abhranil Chandra, Ayush Agrawal, Arian Hosseini, Sebastian Fischmeister, Rishabh Agarwal, Navin Goyal, Aaron Courville · 2025
Read Shape of Thought: When Distribution Matters More than Correctness in Reasoning Tasks by Abhranil Chandra, Ayush Agrawal, Arian Hosseini, Sebastian Fischmeister, Rishabh Agarwal, Navin Goyal, Aaron Courville (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-22255.txt.
Description
Abhranil Chandra and six co-authors report a counterintuitive recipe for teaching reasoning: train a model on chains of thought that end in wrong answers. Synthetic reasoning traces from stronger models improved performance even when every trace's final answer was incorrect, sometimes beating training on human-annotated data. The authors test two explanations for why distribution shape can matter more than correctness.
First, synthetic text sits closer to the model's own distribution, making it easier to learn from; paraphrasing human traces toward the model's style confirmed this by improving results. Second, wrong traces are often only partly flawed and still contain valid steps. Tests spanned mathematics, algorithmic reasoning, and code generation across MATH, GSM8K, Countdown, and MBPP, using models from several families.
Catalog record
| CREATOR | Abhranil Chandra, Ayush Agrawal, Arian Hosseini, Sebastian Fischmeister, Rishabh Agarwal, Navin Goyal, Aaron Courville |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-22255