Large Reasoning Models are not thinking straight: on the unreliability of thinking trajectories
Jhouben Cuesta-Ramirez, Samuel Beaussant, Mehdi Mounsif · 2025
Read Large Reasoning Models are not thinking straight: on the unreliability of thinking trajectories by Jhouben Cuesta-Ramirez, Samuel Beaussant, Mehdi Mounsif (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-00711.txt.
Introduction
Jhouben Cuesta-Ramirez and two co-authors show that reasoning models often refuse to stop thinking in a 2025 paper. Large language models trained to reason step by step now top math contests, but their chains of thought keep growing longer. The team asks whether those long chains mean better reasoning, or just more of it.
In their tests, models were handed correct solutions outright, and still kept reasoning. The extra steps often talked the model out of the right answer and into a wrong one, a failure the authors call overthinking. Three leading models showed the pattern on a hard 2024 math contest set. The results warn that benchmark scores can flatter these models, and that teaching a model to accept a good answer, and stop, is an open problem for reliable reasoning.
Catalog record
| CREATOR | Jhouben Cuesta-Ramirez, Samuel Beaussant, Mehdi Mounsif |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 14 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-00711
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Large Reasoning Models are not thinking straight: on the unreliability of thinking trajectories Jhouben Cuesta-Ramirez, Samuel Beaussant, Mehdi Mounsif Abstract Large Language Models (LLMs) trained via Reinforcement Learning (RL) have recently achieved impressive results on reasoning benchmarks. Yet, growing evidence shows that these models often generate longer but ineffective chains of thought (CoTs), calling into question whether benchmark gains reflect real reasoning improvements. We present new evidence of overthinking , where models disregard correct solutions even when explicitly provided, instead continuing to generate unnecessary reasoning steps that often lead to incorrect conclusions. Experiments on three state-of-the-art models using the AIME2024 math benchmark reveal critical limitations in these models’ ability to integrate corrective information, posing new challenges for achieving robust and interpretable reasoning. 1 Introduction Recent advancements have seen LLMs achieve impressive scores on diverse linguistic and cognitive benchmarks, suggesting significant progress in their reasoning capabilities Arora and Singh 2023 . However, this performance often degrades substantially when encountering out-of-distribution (OOD) tasks revealing limitations in their reliability and adaptive reasoning Wang et al. 2022 . Strategies such as enhanced test-time inference budgets offer potential mitigation for OOD challenges Hou et al. 2025 but a more focused approach involves specialized reasoning models trained via reinforcement learning (RL) with verifiable rewards Ankner et al. 2023 . This enables backtracking and self-revision, significantly outperforming standard LLMs. The CoT embodying these strategies are themselves a subject of intense study, offering potential blueprints for enhancing reasoning in smaller models Yao et al. 2023 . Nevertheless, concerns remain regarding the authenticity of these CoTs. Prior work Wang et al. 2023 has shown that cold-start RL can produce unconventional CoTs (often with unusual syntax or mixed languages) that still lead to correct answers. This raises doubts about whether these CoTs represent genuine reasoning or merely environment-specific artifacts anthropomorphized by researchers Gao et al. 2023 . Such phenomena may result from RL incentives that encourage retrieving known solutions from the base model, rather than fostering new cognitive skills Yue et al. 2025 . Recent evidence even suggests that disabling explicit reasoning processes in LRMs can still achieve state-of-the-art results if sampling budgets are sufficiently increased Ma et al. 2025a . We present new evidence suggesting that CoTs may not meaningfully support models’ reasoning processes. Extending prior work Wang et al. 2025 , we explore the underthinking phenomenon, where models prematurely abandon promising reasoning paths maybe due to inability to correctly identify a valid solution. We find that even explicitly injecting ground-truth solutions into reasoning sequences often fails, with models instead pursuing incorrect reasoning. This issue closely relates to overthinking Chen et al. 2025 , where models generate excessive, unproductive reasoning tokens. In this preliminary work, we demonstrate empirically that even state-of-the-art reasoning models are not apart from this issue with two main contributions: Demonstrating that LLMs often disregard externally provided correct solutions, producing redundant reasoning steps and Highlighting fundamental limitations in the integration of corrective information by models, revealing critical flaws in current reasoning dynamics. 2 Related Work Following the seminal work of Wei et al. 2022 , suggesting that LLM’s reasoning capabilities can be enhanced via Chain-of-Thought (CoT), numerous works have explored prompt augmentations Yao et al. 2023 ; Wang et al. 2022 , specific scaffolding Bairi et al. 2023 ; Cheng et al. 2024 ; Zheng et al. 2025 . Concurrently, research has also highlighted that expanding the sampling budget can lead to further performance gains Wang et al. 2024 ; Tian et al. 2024 . For instance, Brown et al. 2025 observed a strong correlation between sampling budget and benchmark performance, indicating that models may have internalized much more knowledge than what is revealed through single-shot forward pass. However, while these methods can enhance performance, their reliability often rests on the capabilities of the verifier. This challenge aligns naturally with the reinforcement learning (RL) framework, where algorithms such as Schulman et al. 2017 ; Ramesh et al. 2024 leverage ground truth rewards as training signals to optimize LLMs OpenAI 2024 ; OpenAI 2025 ; DeepSeek-AI 2025 ; Lambert et al. 2025 . Despite initial competitive metrics and hill-climbing trends Luo et al. 2025 , fundamental questions about LLMs’ planning capabilities persist Kambhampati et al. 2024 ; Valmeekam et al. 2024 , prompting skepticism about their CoTs’ relevance Wang et al. 2025 ; Chen et al. 2025 . RL optimization often leads to overfitting, unreadable CoTs, or anthropomorphic strategies Qwen-Team 2024 , emphasizing the need for robust reasoning and interpretability Dunefsky et al. 2024 ; Cunningham et al. 2023 to handle shifted distributions in inference Andriushchenko et al. 2025 . Recent works Ameisen et al. 2025 ; Lindsey et al. 2025 have identified interpretable internal circuits within transformer models, but scaling these insights remains challenging Lieberum et al. 2024 . Evidence of sycophancy and divergence between textual outputs and internal activations further complicates system trustworthiness. Our work fundamentally challenges the assumed relationship between CoT length and performance by demonstrating multiple models’ inability to recognize correct answers even when explicitly presented. Along with recent studies Muennighoff et al. 2025 ; Yeo et al. 2025 ; Ma et al. 2025b ; Tang et al. 2025 these results reveal a more complex dynamic influenced by training dynamics and task complexity, underscoring the need for a deeper understanding of LLM reasoning processes. (a) Llama-70b (b) Qwen-7b (c) DeepScalR-1.5b Figure 1: Averaged number of overthinking tokens generated for each problem from AIME2024. Amount of overthinking tokens is problem-dependent but all four models overthink. The correct/incorrect coloring is based on whether the problem was successfully solved on the first try. 3 Results and Discussion We conduct our experiments on three different models. LLaMA 70B and Qwen7B were distilled from R1 DeepSeek-AI 2025 , while DeepScalR1.5B Luo et al. 2025 was trained via RL. Our reasoning analysis focus on the AIME2024 dataset, a challenging set of mathematical problems. 3.1 Baseline Thoughts Generation Baseline solutions are generated by providing the models with a standard system prompt and problem statement. The LLM then produces CoTs enclosed in <think> tags before delivering a final answer, spontaneously exploring multiple hypotheses and engaging in self-reflection. Individual reasoning thoughts are identified using a simple heuristic based on specific keywords, with Alternatively and Wait serving as thought separators. We denote the reasoning trace up to the t^{\text{th}} thought as \mathcal{R}{[:t]} , which includes the system prompt and problem statement. For t=0 , \mathcal{R}{[:0]} contains only the prompt and statement; for t=T , \mathcal{R}_{[:T]} represents the full reasoning trajectory. This notation enables the analysis of reasoning at any intermediate step t , supporting counterfactual studies. 3.2 Ground Truth Integration We investigate the impact of integrating the ground truth solution (reasoning + answer) after each baseline thoughts, assessing whether models recognize and integrate correct answers. For each problem, we concatenate the solution \mathcal{Y} to the already generated thinking trace \mathcal{R}_{[:t]} as if it was generated by the model itself during its reasoning process. This achieved by prefixing the solution with the relevant set of tokens \mathcal{V} to mimic the model’s writing style. More formally, the prompt P_{t} sent to the model is: P_{t}=\mathcal{R}_{[:t]}\oplus\mathcal{V}\oplus\mathcal{Y}~(1) , where \oplus denotes concatenation and with \mathcal{V}=\text{"<think> Okay, so "}\,\text{if }t=0 and "Alternatively, " otherwise. Given P_{t} for each