Predicting thinking time in Reasoning models
Hans Peter Lyngsøe Raaschou-Jensen, Anders Søgaard · 2025
Read Predicting thinking time in Reasoning models by Hans Peter Lyngsøe Raaschou-Jensen, Anders Søgaard (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-23274.txt.
Introduction
Hans Peter Lyngsoe Raaschou-Jensen, Constanza Fierro, and Anders Sogaard ask in 2025 whether a reasoning model can report its own progress while it thinks. Long chains of thought solve hard tasks, but users cannot see how far along the model is.
First, the team tested whether the model's inner states carry progress data, by training a simple probe on sliced reasoning traces. Then they fine tuned models to print progress estimates from zero to one hundred percent as they reason. The best version beat position based baselines on math traces, with a low average error. They also measured how much the true progress value wobbles from the same starting point, a basic limit on any such gauge.
Catalog record
| CREATOR | Hans Peter Lyngsøe Raaschou-Jensen, Anders Søgaard |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-23274
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Predicting thinking time in Reasoning models Thanks: Equal contribution Hans Peter Lyngsøe Raaschou-Jensen, Anders Søgaard Abstract Reasoning models that produce long, hidden chains of thought have emerged as powerful tools for complex, reasoning-intensive tasks ( DeepSeek-AI et al. 2025 ; OpenAI et al. 2024 ) . However, this paradigm introduces a new user experience challenge: users have little insight into how much time the model will spend reasoning before returning an answer. This unpredictability, can lead to user frustration and is likely to compound as LLMs can produce increasingly long tasks asynchronously ( Kwa et al. 2025 ) . In this paper, we introduce and evaluate methods for both online and offline prediction of model "thinking time," aiming to develop a practical "progress bar for reasoning." We discuss the implications for user interaction and future research directions. 1 Introduction Recent work has illustrated the promise of scaling test-time compute ( Snell et al. 2024 ) ( Brown et al. 2024 ) ( DeepSeek-AI et al. 2025 ) ( OpenAI et al. 2024 ) . Much of this work, proposes training the language model to produce a hidden chain of thought ( Wei et al. 2025 ) (e.g., \langle think \rangle … \langle /think \rangle ) which either remains hidden behind an api, or for open-source models like R1 ( DeepSeek-AI et al. 2025 ) remains difficult for users to gauge progress, given the sheer length and complexity of the reasoning trace. This lack of transparency poses a significant user interaction challenge. In practical settings, users may ask: How long will this take? How much time is left? Without feedback, users may become frustrated, abandon tasks, or lose trust in the system. As LLMs are applied to longer, asynchronous, and more open-ended tasks ( Kwa et al. 2025 ) , these issues become increasingly prevalent. While some work has explored teaching models to adhere to user-specified reasoning budgets ( Muennighoff et al. 2025 ; Aggarwal and Welleck 2025 ; Jaghour et al. 2025 ) , this approach is limited when the required budget cannot be determined from the question alone. At the same time, recent research has shown that LLMs encode confidence and uncertainty in their hidden states ( Zhang et al. 2025 ; Xiong et al. 2024 ; Manvi et al. 2024 ; Huang et al. 2025a ) , suggesting that models may possess an internal awareness of their reasoning trajectory. While the halting problem establishes theoretical limitations on algorithm decidability (i.e., determining whether a program will terminate) and consequently on progress prediction (i.e., estimating how far an algorithm is from halting, assumes we know it will halt), practical heuristic approaches for runtime prediction have emerged and demonstrated surprising effectiveness. As Hutter notes, “Perhaps surprisingly, it is possible to predict how long an algorithm will take to run on a previously unseen input, using machine learning techniques to build a model of the algorithm’s runtime as a function of problem-specific instance features” ( Hutter et al. 2013 ) . 2 Prerequisites 2.1 Confidence and Uncertainty Estimation in LLMs Recent research has revealed that language models encode uncertainty information in their hidden states. Zhang et al. 2025 showed that models maintain an internal representation of correctness that can be extracted using a small MLP probe on specific token hidden states. Their work also uncovered that model hidden states contain "look-ahead" information - the ability to predict correctness before an intermediate answer is fully generated, indicating that LLMs possess an inherent awareness of their reasoning trajectory Zhang et al. 2025 . 2.2 Progress Estimation for Heuristic Algorithms To the best of our knowledge, progress prediction was first systematically studied in heuristic search algorithms, with Thayer et al. 2012 offering the earliest formal approach. They define search progress estimation as follows. Given a search algorithm A and a heuristic search problem P=\langle T,h\rangle , let E_{A}(P) denote the total number of nodes expanded by A when solving P . Let \mathrm{Rem}_{A}(P,\mathrm{Gen}_{A}(P)) be the number of remaining nodes that will be expanded by A after having already expanded \mathrm{Gen}_{A}(P) nodes, i.e., \mathrm{Rem}_{A}(P,\mathrm{Gen}_{A}(P))=E_{A}(P)-\mathrm{Gen}_{A}(P) . Definition (Search Progress). The search progress of algorithm A solving problem P after expanding \mathrm{Gen}_{A}(P) nodes is: \mathrm{Prog}_{A}(E_{A}(P))=\frac{\mathrm{Gen}_{A}(P)}{\mathrm{Gen}_{A}(P)+\mathrm{Rem}_{A}(P,\mathrm{Gen}_{A}(P))}=\frac{\mathrm{Gen}_{A}(P)}{E_{A}(P)} As \mathrm{Gen}_{A}(P)\leq E_{A}(P) , search progress is thus a value between 0 and 1 and is scale invariant. Sudry and Karpas 2021 further distinguish between online and offline progress prediction and are the first to apply deep learning methods to online prediction of progress. They convert the problem to a supervised learning problem, training an lstm to conditioned on prior search history, predict \mathrm{Prog}_{A}(E_{A}(P)) Similar work has been done in the field of neural theorem proving, where ( Huang et al. 2025b ) train a language model to predict the number of steps remaining to reach a ’no goals state’ (proof completion) given a current proof state in LEAN ( Moura and Ullrich 2021 ) . They find that conditioning on both on the current proof state along with the history of prior proof states achieves better predictive performance measured by MAE loss between predicted and true states, suggesting online estimation, in practice is more tractable than offline estimation. ( Ma et al. 2019 ) Zhu et al. 2020 apply progress estimation to vision-language navigation in Robotics. 2.3 Reinforcement Learning for LLMS Reinforcement Learning is a learning approach, in which an agent, acting in an environment, attempts to maximize future discounted rewards over a policy ( Sutton and Barto 2018 ) Kaelbling et al. 1996 . Reinforcement learning for LLMs was popularized with RLHF ( Ouyang et al. 2022 ) , in which a language model is optimized using feedback from a reward model trained on human preference data ( Lambert et al. 2024 ) . Typically PPO (Proximal Policy Optimization) ( Schulman et al. 2017 ) is used for computing policy gradients. RLHF Algorithms. Proximal Policy Optimization (PPO) ( Schulman et al. 2017 ) is a widely used reinforcement learning algorithm for fine-tuning language models with human feedback (RLHF). PPO optimizes a clipped surrogate objective to ensure stable policy updates and prevent large deviations from the previous policy. The objective is defined as: \mathcal{L}_{\text{CLIP}}=\mathbb{E}_{t}\left[\min\left(r_{t}(\theta)\hat{A}_{t},\,\mathrm{clip}(r_{t}(\theta),1-\epsilon,1+\epsilon)\hat{A}_{t}\right)+\mathrm{KL}\left(\pi_{\theta}(O_{t}|q_{t})\|\pi_{\theta_{\text{old}}}(O_{t}|q_{t})\right)\right] (1) where r_{t}(\theta)=\frac{\pi_{\theta}(O_{t}|q_{t})}{\pi_{\theta_{\text{old}}}(O_{t}|q_{t})} is the probability ratio between the new and old policies for output O_{t} given query q_{t} , and \hat{A}_{t} is the advantage function, typically estimated using a value network. The \mathrm{clip} function restricts the probability ratio to the interval [1-\epsilon,1+\epsilon] , with \epsilon a small positive constant (e.g., 0.2 ), to avoid excessively large policy updates. KL divergence between the probability distribution over outputs for the old and new policy is added as an additional layer of conservatism. Recently, Direct Preference Optimization (DPO) ( Rafailov et al. 2024 ) and Group Relative Policy Optimization (GRPO) ( Shao et al. 2024 ) , amonst others, have emerged as alternatives to PPO. GRPO Objective. \begin{split}\mathcal{J}_{\text{GRPO}}(\theta)=\mathbb{E}_{q\sim P(Q),\{o_{i}\}_{i=1}^{G}\sim\pi_{\theta_{\text{old}}}(O|q)}\Bigg[\\ \frac{1}{G}\sum_{i=1}^{G}\frac{1}{|o_{i}|}\sum_{t=1}^{|o_{i}|}\bigg\{\min\bigg(&\frac{\pi_{\theta}(o_{i,t}|q,o_{i,<t})}{\pi_{\theta_{\text{old}}}(o_{i,t}|q,o_{i,<t})}\hat{A}_{i,t},\\ &\text{clip}\left(\frac{\pi_{\theta}(o_{i,t}|q,o_{i,<t})}{\pi_{\theta_{\text{old}}}(o_{i,t}|q,o_{i,<t})},1-\epsilon,1+\epsilon\right)\hat{A}_{i,t}\bigg)\\ &-\beta D_{\text{KL}}[\pi_{\theta}(\cdot|q)\|\pi_{\text{ref}}(\cdot|q)]\bigg\}\Bigg]\end{split} (2) where for outcome supervision, the advantage \hat{A}_{i,t} is computed as follows: for each question q , rollouts \{o_{1},o_{2},\cdots,o_{G}\} are sampled from the old policy model \pi_{\theta_{\text{old}}} . A reward model(or reward function) scores these outputs, yielding rewards for each output \mathbf{r}=\{r_{1},r_{2},\cdots,r_{G}\} . Notably, we do not use a value model to compute the advantage, but instead