Answer Convergence as a Signal for Early Stopping in Reasoning
Xin Liu and Lu Wang · 2025
Read Answer Convergence as a Signal for Early Stopping in Reasoning by Xin Liu and Lu Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-02536.txt.
Introduction
Xin Liu and Lu Wang propose, in a 2025 paper, a way to stop AI reasoning early once the answer has settled. Step-by-step prompting makes language models better at hard problems, but the chains run long and cost money. The pair first ask how much reasoning a model truly needs. On math tasks, models reach their final answer after about three fifths of their steps, leaving the rest as waste.
They offer three cures that work at run time. One stops when answers agree across tries. One nudges the model to emit its stop signal sooner. One learns, from the model's inner states, when to quit. Across five benchmarks and five open models, the methods cut token use a lot with little or no loss of accuracy. On one question set, savings passed forty percent while accuracy rose.
Catalog record
| CREATOR | Xin Liu and Lu Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-02536
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Answer Convergence as a Signal for Early Stopping in Reasoning Xin Liu and Lu Wang Abstract Chain-of-thought (CoT) prompting enhances reasoning in large language models (LLMs) but often leads to verbose and redundant outputs, thus increasing inference cost. We hypothesize that many reasoning steps are unnecessary for producing correct answers. To investigate this, we start with a systematic study to examine what is the minimum reasoning required for a model to reach a stable decision. We find that on math reasoning tasks like math, models typically converge to their final answers after 60% of the reasoning steps, suggesting substantial redundancy in the remaining content. Based on these insights, we propose three inference-time strategies to improve efficiency: (1) early stopping via answer consistency, (2) boosting the probability of generating end-of-reasoning signals, and (3) a supervised method that learns when to stop based on internal activations. Experiments across five benchmarks and five open-weights LLMs show that our methods significantly reduce token usage with little or no accuracy drop. In particular, on NaturalQuestions, Answer Consistency reduces tokens by over 40% while further improving accuracy. Our work underscores the importance of cost-effective reasoning methods that operate at inference time, offering practical benefits for real-world applications. 1 Introduction Large language models (LLMs) exhibit strong reasoning capabilities through step-by-step generation, known as chain-of-thought (CoT) reasoning Wei et al. 2022 ; Cobbe et al. 2021 ; Fang et al. 2024 . However, this approach often leads to unnecessarily long and verbose reasoning traces, resulting in high inference cost and latency. This overthinking phenomenon has become a practical bottleneck, especially in real-time or resource-constrained scenarios Sui et al. 2025 . Figure 1: R1-Qwen-32B converges early on a GSM8K example, suggesting that later steps could be skipped. To improve reasoning efficiency, recent studies have introduced methods that allow models to generate accurate answers with fewer steps. These include reinforcement learning with length-aware rewards Luo et al. 2025 ; Hou et al. 2025 , fine-tuning on variable-length CoT traces Han et al. 2024 ; Xia et al. 2025 , and prompt-based approaches that request concise reasoning Xu et al. 2025 ; Nayab et al. 2024 ; Han et al. 2024 . These methods typically require retraining on curated data or task-specific prompt design. In contrast, we explore inference-time techniques that improve efficiency without sacrificing accuracy. Particularly, we hypothesize that LLMs often internally converge on an answer before completing the full reasoning trace, an insight we formalize as answer convergence . Recognizing such convergence can enable more efficient inference by allowing early stopping without sacrificing accuracy. To investigate this, we start with a reasoning model early-stopping study that systematically truncates explicit CoTs to assess when the model’s answer generated answer converges, i.e., when the answer remains unchanged despite additional reasoning steps. Our experiments reveal that models often converge well before completing the full reasoning chain, suggesting substantial redundancy and highlighting the potential for improving efficiency through early stopping. Figure 1 shows an example where the model answer converges early despite receiving only partial reasoning, indicating that the remaining steps contribute little to the final prediction. As shown in Figure 2 , this pattern holds across five datasets, even on GPQA, a challenging dataset, many examples converge early. Motivated by this finding, we propose inference-time strategies to dynamically truncate explicit reasoning based on the observation that models often reach converged answers early: (1) Early stopping via Answer Consistency , which halts generation when consecutive reasoning chunks yield identical answers; (2) Think Token Adjustment , which encourages models to signal early termination explicitly; and (3) a supervised approach, Learn-to-Stop , which utilizes internal activations to predict optimal stopping points. Our methods are model-agnostic , require no additional training or LM modification, and significantly reduce inference cost without sacrificing accuracy. Importantly, this method does not require ground-truth answer labels , relying only on self-consistency signals during inference. We evaluate our methods on five reasoning benchmarks using five open-weights LLMs. Results show that early stopping strategies consistently reduces token usage without hurting accuracy or even improving accuracy, especially on simpler tasks. Specifically, (1) Performance vs. token length : Learn-to-Stop cuts up to 48% of tokens on NQ with QwQ-32B, sometimes even improving accuracy, suggesting that excessive reasoning may introduce unnecessary noise. (2) Supervised vs. unsupervised : Unsupervised methods work well on NQ and GSM8K, while the supervised approach generalizes better to harder tasks like MATH-500 and GPQA. 2 Related Work Prior work on improving CoT reasoning efficiency generally falls into four categories. Reinforcement learning approaches. Prior research has explored reinforcement learning techniques to mitigate the verbosity of CoT reasoning by penalizing unnecessary reasoning steps. For example, O1-Pruner Luo et al. 2025 introduces a length-harmonizing reward within a PPO framework to discourage superfluous tokens. ThinkPrune Hou et al. 2025 further employs reinforcement learning to prune lengthy reasoning traces while preserving correctness. DAST Shen et al. 2025 proposes a difficulty-adaptive strategy that dynamically adjusts reasoning length based on problem complexity. Fine-tuning with compressed rationales. Supervised fine-tuning offers another avenue for compressing CoT reasoning. TokenSkip Xia et al. 2025 identifies and omits less important tokens to control reasoning length. TALE Han et al. 2024 introduces token-budget-aware prompts and post-training techniques to modulate CoT generation. Munkhbat et al. 2025 utilize best-of-N sampling and few-shot prompts to self-train LLMs on concise reasoning paths. Prompt-based reasoning compression. Prompt-level techniques can also reduce reasoning length during inference. Chain-of-Draft Xu et al. 2025 and Sketch-of-Thought Aytes et al. 2025 guide models to produce minimal intermediate steps instead of full verbalizations. System-level routing methods, such as HaluSearch Cheng et al. 2025 and RouteLLM Ong et al. 2024 , dynamically select reasoning strategies or model backbones to balance cost and quality. Latent reasoning in LLMs. Recent work also explores latent reasoning in LLMs, where intermediate computations are not explicitly verbalized. Coconut Hao et al. 2024 introduces continuous thoughts—hidden state updates reused during decoding—to support gradient-based reasoning without generating tokens. Recurrent Depth Geiping et al. 2025 proposes iterative latent-state refinement to scale test-time compute without extending output length. These methods improve latent reasoning through architectural changes, while our approach focuses on making explicit CoT reasoning more efficient. In contrast to previous studies that control reasoning length via training-time optimization or prompt design, our approach offers a simpler inference-time protocol. Our method enables dynamic early stopping by identifying internal answer stabilization, requiring neither model modification nor labeled training data, and operating independently of the input prompt. 3 Preliminary We investigate whether all steps of a reasoning chain are necessary for the model to converge on its predicted answer, and whether later steps can be omitted without affecting the decision. To this end, we first split the CoT into sentence-level chunks, treating each sentence as a distinct reasoning step, using the NLTK tokenizer Bird et al. 2009 . These chunks are then incrementally concatenated (e.g., chunk1 , chunk1+chunk2 , etc.), each followed by an end-of-reasoning token </think> . The model is prompted to generate an answer from each partial chain via greedy decoding. By tracking when the model’s prediction remains unchanged across successive reasoning steps, we identify the earliest point of answer convergence, approximating the minimum explicit CoT reasoning required for the model to reach a stable decision