Large Language Model Reasoning Failures
Peiyang Song [email protected] Institute of Technology, Stanford University, Pengrui Han [email protected] College Noah Goodman [email protected] University · 2026
Read Large Language Model Reasoning Failures by Peiyang Song [email protected] Institute of Technology, Stanford University, Pengrui Han [email protected] College Noah Goodman [email protected] University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-06176.txt.
Description
Large language models can solve hard reasoning problems, yet they still fail at surprisingly simple ones. Peiyang Song and 2 co-authors present a survey devoted entirely to these reasoning failures. They sort reasoning into embodied kinds, tied to the physical world, and non-embodied kinds, split into intuitive and formal logic.
Failures get a second sorting: deep flaws built into model design, limits that show up only in certain fields, and brittleness under small changes to a problem. For each failure type, the survey gives a definition, reviews known studies, weighs causes, and lists fixes people have tried. The authors also maintain a public collection of the research they cover.
Catalog record
| CREATOR | Peiyang Song [email protected] Institute of Technology, Stanford University, Pengrui Han [email protected] College Noah Goodman [email protected] University |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 84 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-06176