Let LRMs Break Free from Overthinking via Self-Braking Tuning
Haoran Zhao, Yuchen Yan, Yongliang Shen, Haolei Xu, Wenqi Zhang, Kaitao Song, Jian Shao, Weiming Lu, Jun Xiao, Yueting Zhuang · 2025
Read Let LRMs Break Free from Overthinking via Self-Braking Tuning by Haoran Zhao, Yuchen Yan, Yongliang Shen, Haolei Xu, Wenqi Zhang, Kaitao Song, Jian Shao, Weiming Lu, Jun Xiao, Yueting Zhuang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-14604.txt.
Introduction
Haoran Zhao and co-authors tackle a waste problem in large reasoning models, in a 2025 paper. Such models think in long chains of steps, which lifts their scores on hard tasks. The chains also carry much redundant thought, which costs time and compute. Past fixes lean on outside controls to cut the chains short. This team instead teaches the model to brake its own thinking.
They build measures that flag needless steps by checking a chain against the known right answer. Those flags become training data with varied target lengths. A special braking prompt then helps the model learn when to stop on its own. On four math test sets, the method cut token use by up to sixty percent. Accuracy stayed close to that of models left free to think at full length.
Catalog record
| CREATOR | Haoran Zhao, Yuchen Yan, Yongliang Shen, Haolei Xu, Wenqi Zhang, Kaitao Song, Jian Shao, Weiming Lu, Jun Xiao, Yueting Zhuang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-14604
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Let LRMs Break Free from Overthinking via Self-Braking Tuning Haoran Zhao, Yuchen Yan, Yongliang Shen, Haolei Xu, Wenqi Zhang, Kaitao Song, Jian Shao, Weiming Lu, Jun Xiao, Yueting Zhuang Abstract Large reasoning models (LRMs), such as OpenAI o1 and DeepSeek-R1, have significantly enhanced their reasoning capabilities by generating longer chains of thought, demonstrating outstanding performance across a variety of tasks. However, this performance gain comes at the cost of a substantial increase in redundant reasoning during the generation process, leading to high computational overhead and exacerbating the issue of overthinking. Although numerous existing approaches aim to address the problem of overthinking, they often rely on external interventions. In this paper, we propose a novel framework, Self-Braking Tuning (SBT), which tackles overthinking from the perspective of allowing the model to regulate its own reasoning process, thus eliminating the reliance on external control mechanisms. We construct a set of overthinking identification metrics based on standard answers and design a systematic method to detect redundant reasoning. This method accurately identifies unnecessary steps within the reasoning trajectory and generates training signals for learning self-regulation behaviors. Building on this foundation, we develop a complete strategy for constructing data with adaptive reasoning lengths and introduce an innovative braking prompt mechanism that enables the model to naturally learn when to terminate reasoning at an appropriate point. Experiments across mathematical benchmarks (AIME, AMC, MATH500, GSM8K) demonstrate that our method reduces token consumption by up to 60% while maintaining comparable accuracy to unconstrained models. 1 1 footnotetext: The first two authors have equal contributions. This work was done when the first author was an intern at Zhejiang University. 2 2 footnotetext: Corresponding author. Figure 1 : Demonstration of Self-Braking Tuning Effectiveness. In the single-example case (a), the self-braking tuned model exhibits spontaneous termination of overthinking and significantly reduces token usage. On major mathematical benchmarks (b), compared to using OpenR1-Math [ 1 ] as the SFT dataset, the self-braking tuned Qwen2.5-Math-1.5B-Instruct [ 2 ] achieves a substantial reduction in tokens consumed during inference while maintaining comparable accuracy. 1 Introduction Large reasoning models (LRMs) such as OpenAI’s o1 [ 3 ] , Deepseek-R1 [ 4 ] , QwQ [ 5 ] , Gemini 2.0 Flash Thinking [ 6 ] and Kimi-1.5 [ 7 ] , excel at mathematical and logical tasks by generating detailed multi-step reasoning, boosting accuracy on complex benchmarks [ 8 ] . However, this often results in excessively long inference trajectories, frequently consuming thousands of tokens per problem [ 9 , 10 ] , leading to increased computational cost, latency, and redundant reasoning that can obscure core solutions [ 11 ] . This “overthinking” [ 12 ] poses a significant challenge for practical deployment. Many recent studies have focused on addressing the problem of overthinking [ 13 , 14 ] , which can be broadly categorized into three approaches: (1) Model optimization: Apply reinforcement learning (RL) or supervised fine-tuning (SFT) to equip models with the ability to control reasoning length [ 15 , 16 , 17 ] ; (2) Reasoning output optimization : Dynamically reducing the number of reasoning steps and output length during inference [ 18 , 19 , 20 ] ; (3) Adding external restrictions : Imposing external constraints, such as token budgets, to reduce overthinking [ 21 , 22 ] . Most existing methods follow the paradigm of external intervention, relying on complex optimization strategies or introducing additional constraint mechanisms, and have yet to fully explore the intrinsic ability of the model to mitigate overthinking on its own. This reliance on external control prompts a fundamental question: Can we enable large reasoning models to autonomously recognize excessive reasoning and terminate their thinking process appropriately? Ideally, a model should intrinsically understand when additional reasoning becomes redundant and halt its thought process without external triggers, similar to how humans naturally conclude their reasoning when reaching sufficient certainty. To address this challenge, we propose Self-Braking Tuning (SBT) , a novel framework that teaches LRMs to autonomously identify and terminate redundant reasoning. Unlike previous approaches that impose external constraints, SBT fundamentally reshapes how models perceive and regulate their own reasoning processes. Our key insight is that LRMs can be trained to develop an internal braking mechanism that recognizes when further reasoning becomes unproductive, enabling them to naturally conclude the thought process and transition to formulating the final solution. Our approach begins with a systematic methodology for identifying overthinking patterns in reasoning trajectories. By combining metrics such as reasoning efficiency ratio and overthinking label ratio, we precisely pinpoint the transition point at which the model shifts from effective reasoning to redundant computation. Based on this analysis, we develop two complementary data construction strategies: (1) Self-Braking Tuning Exact (SBT-E), which strictly removes redundant reasoning segments based on predefined braking points, allowing the model to enter the conclusion phase earlier; (2) Self-Braking Tuning Dynamic (SBT-D), which implements step-level monitoring and dynamically halts reasoning when overthinking patterns emerge. Building upon the high-quality OpenR1-Math [ 1 ] dataset of reasoning trajectories, we constructed two specialized training datasets using these strategies: OpenR1-Math-SBT-E and OpenR1-Math-SBT-D. To further enhance the model’s self-awareness of its reasoning state, we introduce braking prompts at the identified braking points, explicitly simulating the recognition of having sufficiently completed the reasoning process. These prompts enable the model to naturally express an awareness of having reached adequate reasoning depth, thus promoting autonomous termination without the need for external signals. Our experimental results demonstrate consistent improvements in reasoning efficiency across mathematical benchmarks of varying difficulty. While maintaining high accuracy, token consumption was reduced by 30% to 60%. Our contributions can be summarized as follows: • We introduce a novel tuning framework that enables LRMs to self-regulate reasoning length without external constraints. Self-Braking Tuning cultivates models’ intrinsic ability to recognize and inhibit excessive reasoning, fundamentally improving inference efficiency and response quality. • We propose a systematic methodology for identifying overthinking patterns and develop two complementary data construction strategies: SBT-E and SBT-D, resulting in specialized training datasets for addressing the overthinking problem. These datasets systematically prune redundant reasoning while preserving essential thinking steps. • We demonstrate that models trained with our SBT framework maintain original accuracy levels while reducing token consumption by up to 60% across multiple benchmarks, confirming the effectiveness and generalizability of our approach in enhancing reasoning efficiency. 2 Related Works Large reasoning models Large reasoning models (LRMs) extend traditional language models with advanced reasoning capabilities, often enabled by reinforcement learning. OpenAI’s o1 series [ 3 ] marked a key milestone, followed by DeepSeek-R1 [ 4 ] , which matched o1’s performance through a cost-efficient combination of supervised fine-tuning and RL. Subsequent models like Kimi-k1.5 [ 7 ] and QwQ-32B [ 5 ] further solidified the LRM era. Concurrently, alternative approaches have emerged to reduce reliance on RL, leveraging supervised fine-tuning and data distillation. Models such as DeepSeek-Distill [ 4 ] , OpenR1-Math-7B [ 23 ] , Sky-T1 [ 24 ] , and LIMO [ 25 ] have shown that strong reasoning performance can also be achieved without RL, broadening the design space for LRMs. In addition, recent algorithmic advances specifically target robustness and scalability of reasoning [ 26 , 27 , 28 ] : S 3 c-Math [ 29 ] introduces spontaneous step-level self-correction