Large Language Model Reasoning Failures

Peiyang Song [email protected] Institute of Technology, Stanford University, Pengrui Han [email protected] College Noah Goodman [email protected] University · 2026

Read Large Language Model Reasoning Failures by Peiyang Song [email protected] Institute of Technology, Stanford University, Pengrui Han [email protected] College Noah Goodman [email protected] University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-06176.txt.

Description

Large language models can solve hard reasoning problems, yet they still fail at surprisingly simple ones. Peiyang Song and 2 co-authors present a survey devoted entirely to these reasoning failures. They sort reasoning into embodied kinds, tied to the physical world, and non-embodied kinds, split into intuitive and formal logic.

Failures get a second sorting: deep flaws built into model design, limits that show up only in certain fields, and brittleness under small changes to a problem. For each failure type, the survey gives a definition, reviews known studies, weighs causes, and lists fixes people have tried. The authors also maintain a public collection of the research they cover.

Catalog record

CREATORPeiyang Song [email protected] Institute of Technology, Stanford University, Pengrui Han [email protected] College Noah Goodman [email protected] University
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE84 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-06176

Browse the full library · About the Tower of Babel