Fragile Thoughts: How Large Language Models Handle Chain-of-Thought Perturbations
Ashwath Vaithinathan Aravindan, Mayank Kejriwal · 2026
Read Fragile Thoughts: How Large Language Models Handle Chain-of-Thought Perturbations by Ashwath Vaithinathan Aravindan, Mayank Kejriwal (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-03332.txt.
Description
Ashwath Vaithinathan Aravindan and Mayank Kejriwal test how fragile step-by-step reasoning is in large language models. Chain-of-thought prompting asks a model to show its work, but a single corrupted step can poison everything after it. Their 2026 study injects five kinds of damage into reasoning chains for mathematics problems, from plain arithmetic slips to flattering detours that agree with a wrong user.
Thirteen models of widely different sizes faced the corrupted chains. Arithmetic errors hurt small models badly but larger ones recover well. Unit conversion errors stayed costly at every size, while extra harmless steps barely mattered. Flattery and skipped steps fell in between. The patterns follow scaling trends, and the authors argue that deployment in multi-stage pipelines needs task-specific robustness checks, not blind trust.
Catalog record
| CREATOR | Ashwath Vaithinathan Aravindan, Mayank Kejriwal |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50944 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.03332