Fragile Thoughts: How Large Language Models Handle Chain-of-Thought Perturbations

Ashwath Vaithinathan Aravindan, Mayank Kejriwal · 2026

Read Fragile Thoughts: How Large Language Models Handle Chain-of-Thought Perturbations by Ashwath Vaithinathan Aravindan, Mayank Kejriwal (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-03332.txt.

Description

Ashwath Vaithinathan Aravindan and Mayank Kejriwal test how fragile step-by-step reasoning is in large language models. Chain-of-thought prompting asks a model to show its work, but a single corrupted step can poison everything after it. Their 2026 study injects five kinds of damage into reasoning chains for mathematics problems, from plain arithmetic slips to flattering detours that agree with a wrong user.

Thirteen models of widely different sizes faced the corrupted chains. Arithmetic errors hurt small models badly but larger ones recover well. Unit conversion errors stayed costly at every size, while extra harmless steps barely mattered. Flattery and skipped steps fell in between. The patterns follow scaling trends, and the authors argue that deployment in multi-stage pipelines needs task-specific robustness checks, not blind trust.

Catalog record

CREATORAshwath Vaithinathan Aravindan, Mayank Kejriwal
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50944
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.03332

Browse the full library · About the Tower of Babel