EAT: Entropy After ⟨ / πšƒπš‘πš’πš—πš” ​ ⟩ \textlangle\tt/Think\textrangle for reasoning model early exiting

Xi WangJohns Hopkins University [email protected] James McInerneyNetflix Research [email protected] Lequn WangNetflix Research [email protected] Nathan KallusNetflix Research & Cornell University [email protected] Β· 2025

Read EAT: Entropy After ⟨ / πšƒπš‘πš’πš—πš” ​ ⟩ \textlangle\tt/Think\textrangle for reasoning model early exiting by Xi WangJohns Hopkins University [email protected] James McInerneyNetflix Research [email protected] Lequn WangNetflix Research [email protected] Nathan KallusNetflix Research & Cornell University [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-26522.txt.

Introduction

Xi Wang, James McInerney, Lequn Wang, and Nathan Kallus tackle wasted thinking in reasoning models in a 2025 computing paper. Such models write long chains of thought and often keep revising after they already hold the right answer. The extra words cost time and money. The team looks for a cheap signal that says the model can stop.

Their signal watches how unsure the model is about the word right after a stop marker. When that doubt flattens out, the answer has usually settled as well. A smoothed rule on the signal's wobble tells the model when to quit. Spending the saved effort only on hard problems could make reasoning models much cheaper to run.

Catalog record

CREATORXi WangJohns Hopkins University [email protected] James McInerneyNetflix Research [email protected] Lequn WangNetflix Research [email protected] Nathan KallusNetflix Research & Cornell University [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-26522

Browse the full library Β· About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

EAT: Entropy After ⟨ / πšƒπš‘πš’πš—πš” ​ ⟩ \textlangle\tt/Think\textrangle for reasoning model early exiting Xi WangJohns Hopkins University [email protected] James McInerneyNetflix Research [email protected] Lequn WangNetflix Research [email protected] Nathan KallusNetflix Research & Cornell University [email protected] Abstract Large reasoning models show improved performance with longer chains of thought. However, recent work has highlighted (qualitatively) their tendency to overthink, continuing to revise answers even after reaching the correct solution. We quantitatively confirm this inefficiency by tracking Pass@1 for answers averaged over a large number of rollouts and find that the model often begins to always produce the correct answer early in the reasoning, making extra reasoning a waste of tokens. To detect and prevent overthinking, we propose a simple and inexpensive novel signalβ€”Entropy After </Think> ( EAT )β€”for monitoring and deciding whether to exit reasoning early. By appending a stop thinking token ( </think> ) and monitoring the entropy of the following token as the model reasons, we obtain a trajectory that decreases and stabilizes when Pass@1 plateaus; thresholding its variance under an exponential moving average yields a practical stopping rule. Importantly, our approach enables adaptively allocating compute based on the EAT trajectory, allowing us to spend compute in a more efficient way compared with fixing the token budget for all questions. Empirically, on MATH-500 and AIME-2025, EAT reduces token usage by 13–21% without harming accuracy, and it remains effective in black-box settings where logits from the reasoning model are not accessible, and EAT is computed with proxy models. Code and data assets are available at https://github.com/xidulu/EAT . 1 Introduction Large reasoning models such as GPT o1 ( Jaech et al. 2024 ) , DeepSeek R1 ( DeepSeek-AI et al. 2025 ) , or S1 ( Muennighoff et al. 2025 ) exhibit the test-time scaling phenomenon ( Snell et al. 2024 ; Wu et al. 2024 ) : when given more computation budget at inference, they generate longer chains of thought and achieve higher accuracy on reasoning tasks. This suggests that models can effectively improve performance by β€œthinking longer,” even without additional training. However, current practice allocates a fixed token budget per question, regardless of difficulty. Easy questions can be solved confidently with just a few or no reasoning steps, while harder ones require extended deliberation. This uniform allocation wastes compute on simple instances while potentially underserving complex ones. This manifests as overthinking ( Chen et al. 2024 ; Sui et al. 2025 ) , where models unnecessarily revise correct reasoning, as illustrated in Appendix H . Quantitatively, we observe that Pass@1 accuracy (averaged over multiple random rollouts, Eq. ( 8 )) often stabilizes and saturates early in the reasoning chain, sometimes even within the first 10-20% of the allocated token budget (Fig. 1 , top row). This indicates that the model continues to generate the same answer regardless of additional reasoning steps, making further computation redundant. This observation highlights the need for adaptive test-time computation mechanisms, where the model dynamically determines how much reasoning to allocate to each input. A natural principle for enabling such adaptivity is uncertainty: under submodularity assumptions, computation should continue as long as uncertainty decreases and stop once the uncertainty has stabilized. This idea has a long history in adaptive computing, from dynamically determining the number of steps in RNN ( Graves 2016 ) to confidence-based early exiting rules in deep networks ( Teerapittayanon et al. 2016 ; Schuster et al. 2022 ) . In the context of reasoning models, however, it is not clear whether there exist effective and inexpensive uncertainty signals for this purpose. In this work, we propose Entropy After </Think> ( EAT ) as such a signal (Sec. 4.1 ). By appending a stop thinking token ( </think> ) after each generated reasoning line and measuring the entropy of the model’s next-token distribution over the single token after </think> , we obtain a quantity that sharply decreases and stabilizes at precisely the point where accuracy saturates (Fig. 1 , bottom row). When monitored over time with an exponential moving average, the variance of EAT provides a reliable criterion for early exiting (Alg. 1 , Sec. 4.2 ). In summary, this work makes three key contributions. (i) We provide the first quantitative demonstration that reasoning models frequently overthink, continuing to generate lengthy reasoning chains even after the prediction has stabilized. (ii) We introduce Entropy After </Think> ( EAT ), a lightweight informative signal for early exiting, and propose a practical variance-based stopping rule using an exponential moving average. (iii) We empirically validate the effectiveness of EAT on benchmarks including MATH-500 and AIME-2025, showing that it reduces token usage by up to 21% without sacrificing accuracy (Sec. 5 ). Crucially, EAT remains effective even when the reasoning model’s logits are inaccessible, where we compute EAT using a smaller proxy reasoning model that only observes the reasoning text from the black-box reasoning model, making our method applicable to commercial APIs that do not expose full token probabilities. To support future research, we also release large-scale answer rollouts and intermediate reasoning traces (taking over 20K GPU hours of computation), enabling future works to study early exiting without re-running costly experiments. Figure 1: EAT provides an informative signal to prevent overthinking in reasoning models. We evaluate questions from four datasets (columns) using DeepSeek-R1-0528-Qwen3-8B, where we plot different metrics against the number of reasoning tokens. The first row shows that Pass@1 averaged over 128 rollouts (Eq. ( 8 )) quickly saturates, indicating overthinking in reasoning. The number of unique answers under multiple rollouts (second row) stabilizes near one when Pass@1 converges; however, its evaluation has a high and non-deterministic overhead. We propose to manually append the stop thinking token ( </think> ) during reasoning and look at the E ntropy over the single token A fter </ T hink> ( EAT , bottom row, Eq. ( 5 )), which drops and stabilizes at the point where Pass@1 plateaus, providing a cheap and deterministic signal for early exiting. 2 Related work Early exiting of deep learning models In deep learning literature, it is common to perform layer-wise early exiting to prevent overthinking ( Kaya et al. 2019 ) and improve efficiency. Using confidence / uncertainty as a metric for early exiting is a widely adopted wisdom. In particular, it has been shown that confidence scores can early exit CNNs, diffusion or LLMs ( Graves 2016 ; Teerapittayanon et al. 2016 ; Elbayad et al. 2019 ; Schuster et al. 2022 ; Jazbec et al. 2024 ) . Our approach shares a similar spirit in that we also propose to use entropy, an uncertainty-related metric, as an early exiting criterion, but for reasoning process. Early exiting of long chain of thought Since the release of open-source reasoning models, in particular, the DeepSeek R1 series, many recent pre-prints study early exiting. These methods share similiar principles: they generate an answer rollout string during reasoning and look at various properties of the rollout related to uncertainty. Yang et al. 2025 look at confidence score, measured by length-normalized log-likelihood ( Malinin & Gales 2020 ) of all tokens in the answer. Liu & Wang 2025 ; Fu et al. 2025 ; Mao et al. 2025 study whether the answer has stopped changing. Yong et al.

Read the complete text