SmartThinker: Progressive Chain-of-Thought Length Calibration for Efficient Large Language Model Reasoning

Chenzhi Hu, Qinzhe Hu, Yuhang Xu, Junyi Chen, Ruijie Wang, Shengzhong Liu, Jianxin Li, Fan Wu, Guihai Chen · 2026

Read SmartThinker: Progressive Chain-of-Thought Length Calibration for Efficient Large Language Model Reasoning by Chenzhi Hu, Qinzhe Hu, Yuhang Xu, Junyi Chen, Ruijie Wang, Shengzhong Liu, Jianxin Li, Fan Wu, Guihai Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08000.txt.

Introduction

Hu and colleagues attack long-winded reasoning in large models, whose long chains bring accuracy at the price of redundancy. Existing length-cutting methods use Group Relative Policy Optimization with static length rewards. Those rewards cannot adapt to problem hardness or response-length spread, causing over-compression and lost accuracy. Their SmartThinker method adds progressive chain-of-thought length calibration. It finds the length with peak accuracy during training and guides long answers toward it, while tuning the length reward weight so correct reasoning paths avoid unfair punishment.

Catalog record

CREATORChenzhi Hu, Qinzhe Hu, Yuhang Xu, Junyi Chen, Ruijie Wang, Shengzhong Liu, Jianxin Li, Fan Wu, Guihai Chen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56777
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.08000

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SmartThinker: Progressive Chain-of-Thought Length Calibration for Efficient Large Language Model Reasoning Chenzhi Hu, Qinzhe Hu, Yuhang Xu, Junyi Chen, Ruijie Wang, Shengzhong Liu, Jianxin Li, Fan Wu, Guihai Chen Abstract Large reasoning models (LRMs) like OpenAI o1 and DeepSeek-R1 achieve high accuracy on complex tasks by adopting long chain-of-thought (CoT) reasoning paths. However, the inherent verbosity of these processes frequently results in redundancy and overthinking. To address this issue, existing works leverage Group Relative Policy Optimization (GRPO) to reduce LRM output length, but their static length reward design cannot dynamically adapt according to the relative problem difficulty and response length distribution, causing over-compression and compromised accuracy. Therefore, we propose SmartThinker , a novel GRPO-based efficient reasoning method with progressive CoT length calibration. SmartThinker makes a two-fold contribution: First, it dynamically estimates the optimal length with peak accuracy during training and guides overlong responses toward it to reduce response length while sustaining accuracy. Second, it dynamically modulates the length reward coefficient to avoid the unwarranted penalization of correct reasoning paths. Extensive experiment results show that SmartThinker achieves up to 52.5% average length compression with improved accuracy, and achieves up to 16.6% accuracy improvement on challenging benchmarks like AIME25. The source code can be found at https://github.com/SJTU-RTEAS/SmartThinker 1 Introduction Figure 1 : Performance demonstration of SmartThinker on a problem from AIME25 The evolution of Large Language Models (LLMs) is currently undergoing a paradigm shift from naive pattern matching ( 3 ) to deliberate logical reasoning. While traditional models excel at providing rapid, associative responses, they often struggle with the multi-step rigor required for complex mathematics, coding, and scientific discovery. This limitation has catalyzed the rise of Large Reasoning Models (LRMs) like OpenAI o1 ( 16 ) and DeepSeek-R1 ( 10 ) . Unlike their predecessors, relying primarily on the pre-training scale, LRMs leverage inference-time scaling laws. By integrating reinforcement learning (RL) with Chain-of-Thought (CoT) ( 30 ) processing, LRMs like DeepSeek-R1 ( 10 ) achieve deep thinking, allocating more computational power during the generation phase to verify, correct, and refine their own logic. However, the reliance on long reasoning traces induces a fundamental challenge known as the overthinking problem . While increasing reasoning length facilitates answering difficult problems, excessively long chains of thought often lead to diminishing or even negative returns. On one hand, overthinking consumes excessive tokens, leading to unnecessary computational and time overhead ( 4 ) ; on the other hand, overthinking simple problems may cause the model to randomly diverge and miss the correct answer. These observations indicate the reasoning length should be carefully controlled to balance correctness and efficiency, rather than maximized indiscriminately . Driven by this observation, many recent works are exploring efficient LLM reasoning strategies. These methods can be broadly divided into 1) training-free approaches ( 32 ; 18 ) , which improve efficiency at inference or prompt level without updating model parameters, and 2) training-based approaches ( 1 ; 15 ; 34 ; 29 ) , which explicitly shape the model’s reasoning behavior through optimization objectives such as supervised fine-tuning and reinforcement learning with length-aware reward designs. Although training-free methods are flexible and low-cost, training-based approaches, particularly reinforcement learning, tend to achieve more consistent efficiency-accuracy gains by directly optimizing reasoning trajectories. Particularly, Group Relative Policy Optimization (GRPO) ( 27 ) improves the sample and training efficiency of reinforcement learning and has become a common basis for efficient reasoning method design. Most GRPO-based mechanisms incorporate a length reward to encourage shorter reasoning trajectories and assign a higher advantage to outputs with fewer tokens. While they are effective in compressing Chain-of-Thought and sometimes even improve accuracy, they rely heavily on heuristic assumptions to estimate the optimal reasoning length. In particular, the target length is not explicitly modeled according to correctness, causing linear length penalties to deviate from the true length–accuracy tradeoff, and often overshoot the optimal reasoning length needed for problem solving. Moreover, existing length reward ( 1 ; 29 ; 34 ) designs are usually static and task-agnostic, applying the same length reward function across problems of varying difficulty. They fail to account for the fact that harder problems inherently require longer and more exploratory reasoning, leading long but correct trajectories to be penalized similarly to incorrect ones. As a result, such static formulations sacrifice necessary reasoning diversity and inevitably degrade response quality to complex questions. To bridge this gap, we propose SmartThinker , a GRPO-based algorithm that jointly optimizes reasoning accuracy and efficiency through adaptive length calibration with dynamic length reward based on optimal length estimation . Our approach is “smart” in two key aspects. First, instead of heuristically penalizing reasoning length, we explicitly characterize the relation between reasoning length and correctness using a Gaussian distribution, enabling us to identify an optimal reasoning length maximizing the probability of success for a given prompt. This replaces blind linear penalties with a principled probabilistic objective. Second, we introduce a dynamic length reward coefficient that ensures the normalized advantage of correct trajectories remains non-negative, preventing valid but longer reasoning paths from being mistakenly suppressed while skipping manual hyperparameter tuning. We extensively evaluate SmartThinker on base models of different scales and mathematical benchmarks with varying difficulty levels. Experimental results show that SmartThinker reduces reasoning token usage by up to 52.2% while simultaneously improving reasoning quality. On challenging benchmarks like AIME25, accuracy gains reach as high as 16.6%, demonstrating the effectiveness of adaptive reasoning length. We show an example from AIME25 in Figure 1 . Our contributions are summarized as follows: • We identify and analyze the reward design issues in GRPO-based efficient reasoning methods caused by the lack of dynamic reward design. • We propose a probabilistic approach to estimate the optimal reasoning length for each question and design a corresponding dynamic length reward. • We use a dynamic length reward coefficient to calibrate the weight of the length reward in the total reward, avoiding incorrectly penalizing correct trajectories. • Extensive experiments demonstrate that SmartThinker can simultaneously improve both efficiency and accuracy with length reduction of up to 52.2% and accuracy improvement of up to 16%. 2 Background and Motivation 2.1 Overthinking Phenomenon in LLM Reasoning A central motivation of efficient reasoning is the overthinking phenomenon, where models expend excessive computational effort on relatively simple tasks, generating unnecessarily long and convoluted reasoning chains that exceed the actual problem complexity. This behavior leads to both inefficiency and increased risk of reasoning errors. From the perspective of reasoning length, overthinking manifests as excessive verbosity and computational overhead in Chain-of-Thought prompting ( 11 ) , as well as performance degradation caused by overly long reasoning traces ( 6 ) . Recent studies further show that reasoning accuracy does not monotonically improve with longer outputs. Instead, the relationship between reasoning length and accuracy typically follows a U-shaped curve, with performance peaking at an intermediate, globally optimal length ( 31 ) . Our experimental results, as shown in Figure 3 , also demonstrate that extending the reasoning beyond this optimal point can even harm accuracy. These observations motivate approaches that explicitly guide models toward an appropriate reasoning length, rather than blindly encouraging longer or shorter reasoning paths. Figure 2 : Overview of the advantage calculation process in SmartThinker . 2.2 GRPO for Efficient Reasoning

Read the complete text