Efficient Test-Time Scaling via Temporal Reasoning Aggregation
Jiakun Li, Xingwei He, Kefan Li, Hongzheng Chai, Hongyue Yu, Yuan Yuan · 2026
Read Efficient Test-Time Scaling via Temporal Reasoning Aggregation by Jiakun Li, Xingwei He, Kefan Li, Hongzheng Chai, Hongyue Yu, Yuan Yuan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17304.txt.
Introduction
Li and five colleagues propose TRACE, a system for test-time scaling that stops thought using time pooling of evidence rather than instant signals. TRACE detects settling by pooling recent steps for answer sameness and trust change. With these signals, TRACE judges whether thought has settled, halting work promptly and skipping extra steps. Tests on hard benchmarks show TRACE cuts token usage by 25 to 30 percent on average while keeping scores within 1 to 2 percent of full thought, beating dynamic methods.
Catalog record
| CREATOR | Jiakun Li, Xingwei He, Kefan Li, Hongzheng Chai, Hongyue Yu, Yuan Yuan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50700 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.17304
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Efficient Test-Time Scaling via Temporal Reasoning Aggregation Jiakun Li, Xingwei He, Kefan Li, Hongzheng Chai, Hongyue Yu, Yuan Yuan Abstract Test-time scaling improves the reasoning performance of large language models but often results in token-inefficient overthinking, where models continue reasoning beyond what is necessary for a correct answer. Existing dynamic early-exit methods typically rely on single-step confidence signals, which are often unreliable for detecting reasoning convergence in multi-step settings. To mitigate this limitation, we propose TRACE, a training-free framework for efficient test-time scaling that determines when to terminate reasoning based on temporal aggregation of multi-step evidence rather than instantaneous signals. TRACE detects reasoning convergence over time by aggregating two complementary signals across recent reasoning steps: answer consistency, capturing the persistence of predicted answers, and confidence trajectory, modeling the temporal evolution of model confidence. Benefiting from these two factors, TRACE can accurately determine whether the reasoning process has converged, thereby promptly halting inference and effectively avoiding redundant reasoning steps. Extensive experiments on multiple challenging benchmarks show that TRACE reduces reasoning token usage by 25–30% on average while maintaining accuracy within 1–2% of full-length reasoning, outperforming existing dynamic reasoning methods. 1 1 1 To facilitate reproducibility, our code is available at https://github.com/qianfantianyuzhouzhou/TRACE . 1 Introduction The emergence of large reasoning models ( Xu et al. 2025 ; Yang et al. 2025a ) has brought remarkable progress in solving complex tasks such as mathematical problem solving ( Guan et al. 2025 ) and code generation ( Li et al. 2025 ) . These approaches leverage the test-time scaling law ( Snell et al. 2024 ) by increasing inference-time compute in two complementary ways: (i) extending the length of generated reasoning traces via chain-of-thought prompting ( Wei et al. 2022 ) , and (ii) expanding the search over alternative reasoning paths through self-consistency ( Wang et al. 2023 ) or Tree of Thought ( Yao et al. 2023 ) . Test-time scaling has proven effective in enhancing the reasoning capability of Large Language Models (LLMs), and is now central to many state-of-the-art approaches. However, test-time scaling tends to result in token-inefficient reasoning processes, thereby incurring unnecessary computational overhead or additional serving cost (e.g., API usage). Specifically, LLMs may generate substantially longer chain-of-thought than necessary to reach a correct answer ( Cuadron et al. 2025 ) , resulting in substantial token overuse with marginal accuracy gains—a phenomenon known as overthinking ( Sui et al. 2025 ; Chen et al. 2025a ) . Figure 1: Single-step confidence-based early-exit prematurely stops at a high-confidence but incorrect intermediate prediction, while TRACE avoids false convergence and reaches the correct answer. The green box indicates the correct answer, and the red box indicates an incorrect answer. Prior work has proposed both training-time and inference-time approaches to mitigate overthinking ( Yang et al. 2025c ; Lu et al. 2025 ; Liu and Wang 2025 ) . Training-time approaches explicitly reduce reasoning length by enforcing fixed token budgets ( Han et al. 2025 ) or by learning shorter reasoning trajectories via reinforcement learning ( Arora and Zanette 2025 ) . In contrast, inference-time approaches mitigate overthinking via early-exit policies that terminate generation at inference time once sufficient evidence has been accumulated ( Fu et al. 2024 ; Huang et al. 2025 ; Yang et al. 2025b ) . Such early-exit policies provide fine-grained control and can be applied to off-the-shelf models without additional training. However, most existing dynamic early-exit methods rely primarily on single-step confidence signals. Recent studies ( Xiong et al. 2024 ; Lacombe et al. 2025 ) have revealed that such signals are unreliable during multi-step reasoning. Because reasoning convergence inherently requires stability across multiple steps, single-step confidence signals fail to indicate convergence as they reflect only per-step certainty rather than cross-step stability. Consequently, relying solely on the unreliable single-step confidence signals forces LLMs into a dilemma between effectiveness and efficiency. Premature termination may halt reasoning too early, leading to incorrect outputs, whereas delayed termination prolongs computation unnecessarily, wasting resources; both cases ultimately undermine overall reasoning performance. Figure 1 illustrates that the confidence calculated based on the single-step method is unreliable, as it assigns excessively high confidence to incorrect steps, thereby triggering the termination condition prematurely. Motivated by this observation, we propose Temporal Reasoning Aggregation for Convergent Exit (TRACE) , a multi-step dynamic early-exit method that determines when to terminate reasoning based on the stability of model outputs across a window of recent steps. Since single-step confidence does not reliably indicate convergence in multi-step reasoning, TRACE provides more reliable signals of reasoning convergence by capturing multi-step answer consistency and the temporal evolution of confidence. To be concrete, TRACE evaluates two complementary multi-step signals within a sliding window of recent reasoning steps. First, inspired by self-consistency ( Wang et al. 2023 ) , we define the Answer Consistency Score (ACS) to quantify cross-step agreement of induced answers. Furthermore, to mitigate the unreliable single-step signals, we introduce the Confidence Trajectory Score (CTS) to track confidence evolution across steps. By jointly considering answer consistency and confidence dynamics, TRACE achieves a better effectiveness–efficiency trade-off than single-step confidence-based methods. In summary, this paper makes the following contributions: • We identify a risk that single-step confidence can be a misleading stopping signal, resulting in suboptimal early-exit decisions in reasoning. • We propose a novel early-exit criterion that jointly considers the trajectory of model confidence over recent reasoning steps and the consistency of predicted answers, providing a more reliable signal of reasoning convergence than single-step confidence-based methods. • We conduct extensive experiments on multiple reasoning benchmarks, proving that TRACE achieves a superior accuracy–efficiency trade-off. Compared to the strongest early-exit baselines, TRACE improves average accuracy by 2-4 points at comparable or lower token budgets. Meanwhile, relative to full-length reasoning, TRACE reduces reasoning tokens by 25–30% on average while maintaining accuracy within 1–2%. 2 Evaluation of Single-Step Early-Exit Figure 2: Cumulative accuracy of single-step early-exit based on confidence for DeepSeek-R1-Distill-Llama-8B on hard mathematical reasoning tasks. Figure 3: Overview of TRACE. The model generates reasoning steps autoregressively. A sliding window over the most recent k steps aggregates answer consistency and confidence trajectory signals, which are jointly used to determine whether the reasoning process has converged and can be safely terminated. We conduct an empirical evaluation of single-step confidence-based early-exit on hard mathematical reasoning benchmarks, including OlympiadBench, MATH500, AIME24, and AIME25. Figure 2 reports the cumulative accuracy of early-exit decisions as a function of the reasoning step at which exit is triggered, compared to full reasoning. Across reasoning steps, early-exit decisions based on single-step confidence underperform full reasoning, achieving an overall accuracy of 0.44 compared to 0.55 obtained by full reasoning. These observations indicate that reliable early-exit decisions require moving beyond instantaneous confidence signals. In multi-step reasoning, convergence is inherently temporal and is better reflected by the stability of model behavior across steps, motivating the aggregation of evidence over multiple reasoning steps. 3 Method Motivated by the limitations of single-step confidence discussed above, we present Temporal Reasoning Aggregation for Convergent Exit (TRACE) . Instead, TRACE determines when to terminate reasoning by aggregating evidence across a sliding window of recent reasoning steps, capturing whether the model’s predicted answers have stabilized and whether its confidence has evolved consistently over time. As illustrated in