Are Reasoning LLMs Robust to Interventions on their Chain-of-Thought?

Alexander von Recum 1,2 Leander Girrbach 1,3 Zeynep Akata 1,3 1 Helmholtz Munich 2 Ludwig Maximilian University of Munich 3 Technical University of Munich, Munich Center for Machine Learning (MCML) · 2026

Read Are Reasoning LLMs Robust to Interventions on their Chain-of-Thought? by Alexander von Recum 1,2 Leander Girrbach 1,3 Zeynep Akata 1,3 1 Helmholtz Munich 2 Ludwig Maximilian University of Munich 3 Technical University of Munich, Munich Center for Machine Learning (MCML) (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07470.txt.

Description

Reasoning language models think step by step before answering, but how well do those chains of thought survive disruption mid-stream? Alexander von Recum and two co-authors build a controlled method that perturbs a model's own thinking trace at fixed points with seven benign, neutral, and adversarial interventions.

Across open-weight thinking models and math, science, and logic tasks, the models generally recover, with robustness growing with size and weakening for early interventions. Robustness is not style-invariant, though: paraphrasing suppresses doubt-like expressions and hurts results, while other interventions trigger doubt that aids recovery, at a cost. Evaluators get a nuanced picture of thinking robustness, not a single score.

Catalog record

CREATORAlexander von Recum 1,2 Leander Girrbach 1,3 Zeynep Akata 1,3 1 Helmholtz Munich 2 Ludwig Maximilian University of Munich 3 Technical University of Munich, Munich Center for Machine Learning (MCML)
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE124 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-07470

Browse the full library · About the Tower of Babel