Dynamic Early Exit in Reasoning Models
Chenxu Yang, Qingyi Si, Yongjie Duan, Zheliang Zhu, Chenyu Zhu, Qiaowei Li, Zheng Lin , Li Cao, Weiping Wang · 2025
Read Dynamic Early Exit in Reasoning Models by Chenxu Yang, Qingyi Si, Yongjie Duan, Zheliang Zhu, Chenyu Zhu, Qiaowei Li, Zheng Lin , Li Cao, Weiping Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-15895.txt.
Introduction
Reasoning models waste time overthinking easy steps, and a 2025 paper by Chenxu Yang and co-authors lets them stop early. Long thought chains solve hard tasks but add delay and can even drift into errors. Their method watches for moments where the model seems ready to move on.
At such points, the model drafts a trial answer. If confidence runs high, the chain stops there. No extra training is needed, and the trick drops into existing reasoning models. Tests on ten reasoning benchmarks across eleven models show steady gains in speed with accuracy kept. Shorter chains also cut computing cost for every user of these models.
Catalog record
| CREATOR | Chenxu Yang, Qingyi Si, Yongjie Duan, Zheliang Zhu, Chenyu Zhu, Qiaowei Li, Zheng Lin , Li Cao, Weiping Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-15895
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Dynamic Early Exit in Reasoning Models Chenxu Yang, Qingyi Si, Yongjie Duan, Zheliang Zhu, Chenyu Zhu, Qiaowei Li, Zheng Lin , Li Cao, Weiping Wang Abstract Recent advances in large reasoning language models (LRLMs) rely on test-time scaling, which extends long chain-of-thought (CoT) generation to solve complex tasks. However, overthinking in long CoT not only slows down the efficiency of problem solving, but also risks accuracy loss due to the extremely detailed or redundant reasoning steps. We propose a simple yet effective method that allows LLMs to self-truncate CoT sequences by early exit during generation. Instead of relying on fixed heuristics, the proposed method monitors model behavior at potential reasoning transition points (e.g.,"Wait" tokens) and dynamically terminates the next reasoning chain’s generation when the model exhibits high confidence in a trial answer. Our method requires no additional training and can be seamlessly integrated into existing o1-like reasoning LLMs. Experiments on 10 reasoning benchmarks (e.g., GSM8K, MATH-500, AMC, GPQA, AIME and LiveCodeBench) show that the proposed method is consistently effective on 11 cutting-edge reasoning LLMs of varying series and sizes, reducing the length of CoT sequences by an average of 19.1% to 80.1% while improving accuracy by 0.3% to 5.0%. 1 1 1 The code is available at https://github.com/iie-ycx/DEER. . “He who knows when he has enough is rich.” — Lao Tzu Figure 1 : Correctness statistics for early exits at various reasoning steps. 1 Introduction The emergence of large reasoning language models [ 1 ] , such as DeepSeek-R1 [ 2 ] and GPT-O1 [ 3 ] , has marked a significant breakthrough in natural language processing, particularly in solving complex and intricate tasks [ 4 ] . These models leverage the test-time scaling [ 5 ] law by generating a longer CoT [ 6 ] with rich and diverse reasoning paths, unleashing the potential of their reasoning ability. However, the generation of overlong CoT sequences also significantly increases computational overload and reasoning latency, which hinders their deployment in computationally sensitive real-life applications. Moreover, recent research [ 7 , 8 ] reveals an intrinsic overthinking problem in LRLMs: These models persistently generate verbose reasoning sequences [ 9 , 10 ] , introducing irrelevant information and unnecessary thought steps. Such redundant processing not only wastes computational resources but also leads to accuracy degradation by derailing from correct reasoning paths to erroneous ones (see Questions 11, 19 and 26 in Fig. 1 . This redundancy can be attributed to the design of the Supervised Fine-Tuning [ 11 , 12 , 13 ] or Reinforcement Learning [ 14 , 13 , 15 , 16 ] stage, where the ability to dynamically adjust its reasoning length during generation is overlooked, leaving a gap in the inference efficiency of LRLMs. Intuitively, as the number of reasoning paths increases, more information is referenced when generating conclusions. If we can identify the critical point where the reasoning information becomes just sufficient (termed Pearl Reasoning ) and force the model to stop further thinking and directly output conclusions at this point, we can achieve both accuracy and efficiency. The aim of this paper can be viewed as finding such pearls in long CoT sequences . To validate our motivation, we forced the model to switches from thinking to directly generating answers, at different transition points in the thought process. If the answers obtained are correct, the existence of such pearl reasoning is verified. As shown in Fig. 1 , about 75% samples do contain such pearls (early exit yields correct answers), even 36.7% samples required only less than half of the original reasoning paths to reach correct conclusions. Therefore, how to find the pearl reasoning is a high potential and valuable topic to achieve efficient reasoning. To this end, we propose a novel, training-free approach DEER that allows large reasoning language models to achieve D ynamic E arly E xit in R easoning. It regards the key moments when the model switches thought chains in reasoning as chances of early exit, and prompting LRLMs to stop thinking and generate trial answers at these moments. The confidence of each trial answer is the decision-making reference of early exit in reasoning. Specifically, the proposed method contains three actions: 1) Reasoning Transition Monitoring : Inspired by the budget forcing technique [ 17 ] , which extends the reasoning chain by introducing tokens like "Wait" to force deeper thinking, we identify words such as "Wait" as critical points for reasoning transitions and monitoring its appearance, but repurposed them inversely to terminate the reasoning chain. When the reasoning transition points are generated, the action of 2) Trial Answer Inducing is triggered: we replace it with "final answer" tokens to induce the model to immediately generate a trial answer, which will be used for 3) Confidence Evaluating . If the confidence is sufficiently high, set the model to stop further thinking and generate a conclusion based on the generated thoughts. Otherwise, the action of Trial Answer Inducing is revoked, and the model continues reasoning along the original path. Our method is simple yet effective, and can be seamlessly extended to eleven reasoning models of varying architectures and sizes, achieving excellent results in the ten reasoning benchmarks, including mathematical tasks (e.g., AIME 2024 [ 18 ] , AMC 2023 [ 19 ] and MATH-500 [ 20 ] ), scientific tasks (e.g., GPQA Diamond [ 21 ] ) and programming tasks (e.g., BigCodeBench [ 22 ] ). Specifically, our method, when integrated into cutting-edge reasoning models, can reduce the length of CoT sequences by an average of 19.1% to 80.1% while improving accuracy by 0.3% to 5.0% across different reasoning benchmarks. Our DEER offers a plug-and-play solution for improving both the efficiency and accuracy of large reasoning language models. 2 Motivations and Observations In this section, we analyze the overthinking problem in LRLMs and explore the impact of static early exits on model performance. We define the critical point where the reasoning information becomes just sufficient as the pearl reasoning. Fig. 1 demonstrates that approximately 75% samples contain such pearls (early exit yields correct answers), and 36.7% of the samples exhibit pearl reasoning within the first half of the reasoning path. Additionally, we observed that there are some samples for which the correct answer can only be obtained through early exits (e.g., Questions 11, 19 and 26 in Fig. 1 . These observations validate our motivation that early exiting at the pearl reasoning position and directly outputting conclusion improves accuracy while reducing computational costs. The quantitative results in Fig. 2 (a) show that for MATH-500, 60.8% of correctly answered samples remain correct with early exits using only 20% of the reasoning steps. For GPQA, 35.1% of correctly answered samples can still be correct with early exits after only 20% of the reasoning steps. Figure 2 : Quantitative pilot experiment results. Please refer to Appendix A for setups. Fig. 2 (b) illustrates that exiting at different positions corrects varying proportions of wrong answers. For the MATH dataset, the highest correction rate is achieved when exiting at 40% of the reasoning steps, whereas for the GPQA dataset, the optimal correction occurs when exiting at 50%. It seems that the optimal early exit point varies for each problem and