BrowseConf: Confidence-Guided Test-Time Scaling for Web Agents

Litu Ou, Kuan Li, Huifeng Yin, Liwen Zhang, Zhongwang Zhang, Xixi Wu, Rui Ye, Zile Qiao, Pengjun Xie, Jingren Zhou, Yong JiangTongyi Lab , Alibaba Group · 2025

Read BrowseConf: Confidence-Guided Test-Time Scaling for Web Agents by Litu Ou, Kuan Li, Huifeng Yin, Liwen Zhang, Zhongwang Zhang, Xixi Wu, Rui Ye, Zile Qiao, Pengjun Xie, Jingren Zhou, Yong JiangTongyi Lab , Alibaba Group (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-23458.txt.

Introduction

Litu Ou leads a team of eleven researchers with BrowseConf, a confidence-guided method for scaling web agents at test time. A language model confidence can signal uncertainty and answer reliability, but most work covers single-turn settings. Multi-turn web tasks, with long action sequences, are far harder for verbalized confidence.

Experimenting on open-source agentic models, they first find that models report much higher task confidence after long sequences. BrowseConf uses confidence to guide extra test-time effort where it helps. Better calibrated web agents could browse, compare, and buy with fewer silent errors.

Catalog record

CREATORLitu Ou, Kuan Li, Huifeng Yin, Liwen Zhang, Zhongwang Zhang, Xixi Wu, Rui Ye, Zile Qiao, Pengjun Xie, Jingren Zhou, Yong JiangTongyi Lab , Alibaba Group
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-23458

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

BrowseConf: Confidence-Guided Test-Time Scaling for Web Agents Litu Ou, Kuan Li, Huifeng Yin, Liwen Zhang, Zhongwang Zhang, Xixi Wu, Rui Ye, Zile Qiao, Pengjun Xie, Jingren Zhou, Yong JiangTongyi Lab , Alibaba Group Abstract Confidence in LLMs is a useful indicator of model uncertainty and answer reliability. Existing work mainly focused on single-turn scenarios, while research on confidence in complex multi-turn interactions is limited. In this paper, we investigate whether LLM-based search agents have the ability to communicate their own confidence through verbalized confidence scores after long sequences of actions, a task significantly more challenging than in single-turn scenarios. Experimenting on open-source agentic models, we first find that models exhibit much higher task accuracy at high confidence while having near-zero accuracy when confidence is low. Based on this observation, we propose Test-Time Scaling (TTS) methods that use confidence scores to evaluate answer quality, encouraging the model to try again until reaching a satisfactory confidence level. Results show that our proposed methods significantly reduce token consumption while demonstrating competitive performance compared to baseline methods with a fixed computational budget. Figure 1: Bar charts showing accuracy against verbalized confidence score intervals for gpt-oss-120b (left) and DeepSeek-V3.1 (right). X-axis represents the model’s confidence, grouped into 5-point intervals. Y-axis indicates task accuracy. Green lines plot accuracies for items within each confidence interval. Grey bars show proportion of items in each respective interval. Dashed purple horizontal lines shows the overall accuracy for each model. Intervals containing no items are omitted from the plots. 1 Introduction LLMs have demonstrated strong performance across a diverse spectrum of tasks such as scientific reasoning, coding, web browsing, etc ( OpenAI et al. 2024 ; Jimenez et al. 2024 ; Phan et al. 2025 ; Wu et al. 2025 ; Wei et al. 2025 ) . Nevertheless, even the strongest LLMs remain prone to hallucinations and overconfident errors ( Kalai et al. 2025 ; Chhikara 2025 ; Kapoor et al. 2025 ) . Accurate self-assessment of confidence thus becomes essential, as well-calibrated confidence scores allow users and downstream systems to decide when to rely on model outputs ( Tao et al. 2024 ; Zhang et al. 2025c ) . Prior work has examined confidence estimation methods such as verbalized scores, token probabilities, and self-reflection ( Kotelanski et al. 2023 ; Zhang et al. 2024 ; Wang et al. 2024 ; Li et al. 2025c ) , but these approaches mostly target single-step tasks. In contrast, confidence estimation in long-horizon agentic settings involving external input and adaptive reasoning remains underexplored ( Yao et al. 2024 ; Barres et al. 2025 ; Patil et al. 2025 ) . These scenarios introduce more challenges for LLM agents, as prior work has revealed their tendency to forget previously acquired information and their difficulty in recovering from earlier errors. This ultimately results in an unreliable estimation of confidence in the final output. ( Chen et al. 2025b ; Zhao et al. 2024 ; Liu et al. 2024 ) . To address this research gap, this work investigates confidence calibration in LLM agents by analyzing verbalized confidence scores elicited from the agent’s final output. We focus on the DeepResearch task, which requires generating comprehensive and factual responses to knowledge-intensive queries through complex web browsing and reasoning 1 1 1 OpenAI DeepResearch and Gemini DeepResearch . Our experiments demonstrate a strong positive correlation between an agent’s verbalized confidence and its task accuracy. On challenging benchmarks such as BrowseComp ( Wei et al. 2025 ) , high agent confidence is predictive of significantly higher accuracy, whereas low confidence corresponds to a substantial degradation in performance. Building on this correlation, we propose a confidence-based TTS method to dynamically allocate computational resources. Our approach utilizes a confidence threshold, calibrated on a development set crafted from SailorFog QA ( Li et al. 2025a ) , to trigger additional generative rollouts only when an agent’s confidence falls below this predetermined value. This method contrasts with existing TTS techniques like self-consistency ( Wang et al. 2023 ) , which uniformly apply a fixed number of rollouts to every query. Experiments demonstrate that our proposed method achieves competitive performance while using significantly fewer rollouts, effectively avoiding redundant attempts for queries that the agent is already highly confident in its initial response. 2 Reliability of Verbalized Confidence Our first experiment explores whether verbalized confidence provides a meaningful signal of task accuracy when LLMs perform complex agentic tasks. We use verbalized confidence as it is lightweight and model-agnostic, requiring only a short prompt overhead and integrates well into all agentic processes, whereas post-hoc estimators typically require a separate stage to measure confidence. Compared to token-level entropy, verbalized confidence directly targets task-level correctness through the model’s explicit self-assessment when giving confidence, while entropy measures uncertainty at individual token predictions that can be poorly calibrated even in single-turn scenarios ( Kapoor et al. 2024 ) . We conduct this experiment on the challenging BrowseComp benchmark ( Wei et al. 2025 ) using capable agentic models including DeepSeek-V3.1 ( DeepSeek-AI 2024 ) and gpt-oss-120b ( OpenAI 2025 ) . To instruct models include a confidence score in the final output, we follow Amir et al. 2025 and craft an instruction to let the model output a confidence score on the scale of 0-100. Further implementation details are given in Appendix B . 2.1 Analysis Verbalized confidence results for BrowseComp are shown in Figure 1 . We can see that both models exhibit poor calibration, as their verbalized confidence scores substantially exceed their actual task accuracies. For instance, within the 90–94% confidence bin, the top accuracy, achieved by DeepSeek-V3.1, is merely 53.33%, far below the expected threshold. Notably, eliciting this verbalized confidence does not degrade task performance, where DeepSeek-V3.1’s officially reported score on BrowseComp is 30.0% compared to our 30.49% 2 2 2 https://huggingface.co/deepseek-ai/DeepSeek-V3.1 . Despite this overconfidence, a strong positive correlation is observed between confidence and accuracy. Accuracy approaches zero for confidence scores below 70% but more than doubles the overall average for scores above 95%. This relationship is statistically robust, as the 95–99% confidence bin is one of the most populated intervals for every model. Consequently, verbalized confidence serves as a reliable indicator of the relative quality of a model’s predictions. 3 TTS with Verbalized Confidence Based on the strong positive correlation between verbalized confidence and accuracy identified in the previous section, we propose BrowseConf , a TTS method that dynamically allocates computational budget based on verbalized confidence scores. Algorithm 1 demonstrates our approach. Specifically, for a given input query q , we define the following: C_{i} as the final confidence score of attempt i , \tau as the confidence threshold, and N as the maximum number of attempts allowed. The process terminates at attempt i when C_{i}\geq\tau or all N attempts are exhausted. To select an appropriate threshold \tau without test set leakage, we use a subset from SailorFog-QA, a dataset curated specifically for information-seeking questions ( Li et al. 2025a ) , as a validation set. We perform a single-pass evaluation on this subset, where each question is attempted once and the model produces a final answer with a verbalized confidence score. We then select \tau^{*} as the minimum threshold that ensures at least k\% relative

Read the complete text