Inference-Time Scaling of Verification: Self-Evolving Deep Research Agents via Test-Time Rubric-Guided Verification

Yuxuan Wan †, Tianqing Fang ‡, Zaitang Li ‡, Yintong Huo ††, Wenxuan Wang ‡‡, Haitao Mi ‡, Dong Yu ‡, Michael R. Lyu † · 2026

Read Inference-Time Scaling of Verification: Self-Evolving Deep Research Agents via Test-Time Rubric-Guided Verification by Yuxuan Wan †, Tianqing Fang ‡, Zaitang Li ‡, Yintong Huo ††, Wenxuan Wang ‡‡, Haitao Mi ‡, Dong Yu ‡, Michael R. Lyu † (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-15808.txt.

Introduction

Yuxuan Wan and six co-authors strengthen research agents at test time in a 2026 arXiv paper. Deep research agents automate knowledge discovery and problem-solving. Most work on them improves the policy model through post-training. This team takes another path. They evolve the agent's ability at inference time. The agent iteratively verifies its own outputs. Carefully crafted rubrics guide those checks.

Rubrics spell out what a good answer must do. Verification against them can catch errors before they compound. Inference-time scaling spends more compute at run time for better results. The title names that scaling as the lever. For teams that cannot retrain huge models, test-time methods are attractive. This paper adds a rubric-guided version to that toolbox.

Catalog record

CREATORYuxuan Wan †, Tianqing Fang ‡, Zaitang Li ‡, Yintong Huo ††, Wenxuan Wang ‡‡, Haitao Mi ‡, Dong Yu ‡, Michael R. Lyu †
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-15808

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Inference-Time Scaling of Verification: Self-Evolving Deep Research Agents via Test-Time Rubric-Guided Verification Yuxuan Wan †, Tianqing Fang ‡, Zaitang Li ‡, Yintong Huo ††, Wenxuan Wang ‡‡, Haitao Mi ‡, Dong Yu ‡, Michael R. Lyu † Abstract Recent advances in Deep Research Agents (DRAs) are transforming automated knowledge discovery and problem-solving. While the majority of existing efforts focus on enhancing policy capabilities via post-training, we propose an alternative paradigm: self-evolving the agent’s ability by iteratively verifying the policy model’s outputs, guided by meticulously crafted rubrics. This approach gives rise to the inference-time scaling of verification , wherein an agent self-improves by evaluating its generated answers to produce iterative feedback and refinements. We derive the rubrics based on an automatically constructed DRA Failure Taxonomy, which systematically classifies agent failures into five major categories and thirteen sub-categories. We present DeepVerifier , a rubrics-based outcome reward verifier that leverages the asymmetry of verification and outperforms vanilla agent-as-judge and LLM judge baselines by 12%–48% in meta-evaluation F1 score. To enable practical self-evolution, DeepVerifier integrates as a plug-and-play module during test-time inference. The verifier produces detailed rubric-based feedback, which is fed back to the agent for iterative bootstrapping—refining responses without additional training. This test-time scaling delivers 8%–11% accuracy gains on challenging subsets of GAIA and XBench-DeepResearch when powered by capable closed-source LLMs. Finally, to support open-source advancement, we release DeepVerifier-4K, a curated supervised fine-tuning dataset of 4,646 high-quality agent steps focused on DRA verification. These examples emphasize reflection and self-critique, enabling open models to develop robust verification capabilities. https://github.com/Tencent/CognitiveKernel-Pro https://github.com/yxwan123/DeepVerifier Figure 1: Upper: Inference-time scaling of verification on the full GAIA development set ( n=165 ). Lower: Performance comparison between DeepVerifier-8B fine-tuned on our dataset and other open-sourced models after 10 rounds of verification & feedback on the full GAIA development set. 1 Introduction Recent advances in Deep Research Agents (DRAs), powered by large language models (LLMs) and vision-language models (VLMs), are transforming automated knowledge discovery and complex problem-solving. These systems demonstrate strong performance on tasks requiring coding, web navigation, file processing, and multi-step reasoning. However, DRAs remain prone to unreliable outputs stemming from incorrect actions, API failures, hallucinations, or other errors ( 27 ; 15 ) , which significantly constrain their practical deployment ( 38 ) . For instance, when tasked with identifying a researcher’s earliest publication, an agent might rely on incomplete secondary sources and deliver an inaccurate result. In long-horizon tasks involving dozens of pages and hundreds of actions, online human supervision becomes infeasible. These challenges underscore the need for scalable, automated methods to enhance DRA reliability and performance at test time ( 44 ; 12 ) . Prior work on inference-time improvement has largely emphasized scaling output tokens or selection across parallel rollouts. For example, 44 introduced parallel sampling for optimal trajectory search, while 8 employed narrative-driven aggregation across iterations. Despite existence of Reflexion ( 25 ) -based methods use textual feedback ( 42 ; 37 ) to bootstrap the agent response, the generation of feedback itself is a hard task that requires sophisticated reasoning capability ( 30 ; 12 ) . A more robust test-time self-evolution pipeline involves (1) verifying generated outputs, (2) producing targeted feedback upon detecting errors, and (3) iterating with this feedback. In this paper, we advance this pipeline in two key areas. For (1) verification, we exploit the asymmetry of verification to decompose complex problems into simpler sub-tasks, where checking correctness is often easier than generation ( 33 ) . For (2) feedback generation, we incorporate rubrics-based rewards ( 10 ; 14 ) to provide structured, discriminative signals, derived from an automatically constructed DRA failure taxonomy . We constructhe the taxonomy by analyzing the failure trajectories on the WebAggregator dataset ( 31 ) , categorizing failures into five major classes and thirteen sub-classes. Based on (1) and (2), we present DeepVerifier , an agentic pipeline for automatically verifying the success of DRA output and provide feedbacks based on the rubrics. DeepVerifier decomposes intricate verification challenges into verifiable information-retrieval sub-tasks (Figure 2 ), overcoming limitations of prior holistic judging approaches. This decomposition principle extends naturally to report generation ( 4 ) . We evaluate DeepVerifier on the GAIA benchmark ( 18 ) , which assesses core abilities including reasoning, multimodality, web browsing, and tool use. Results show DeepVerifier outperforming vanilla agent-as-judge and LLM judge baselines by 12–48% in meta-evaluation F1 score. When integrated for test-time scaling with capable closed-source LLMs (e.g., Claude-3.5-Sonnet), it yields 8–11% accuracy improvements across challenging GAIA subsets and 3–6% improvements on the XBench-DeepSearch dataset. Beyond test-time inference, we extend DeepVerifier to develop DeepVerifier-4K, a high-quality supervised fine-tuning (SFT) dataset comprising 4,646 prompt-response pairs tailored for DRA verification. Curated by filtering and parsing 400 initial agent verification trajectories, DeepVerifier-4K enables robust reflection and self-critique. Using this dataset, we fine-tune DeepVerifier-8B, a model that surpasses other open-sourced models after reflection on key benchmarks. Our framework thus offers a scalable solution for both DRA verification and high-quality dataset creation. In summary, our contributions are as follows: • We formalize the agent reflection pipeline for Deep Research Agents (DRAs) and leverage the asymmetry of verification to achieve superior meta-evaluation performance. • We introduce a comprehensive DRA failure taxonomy, automatically constructed to categorize failures systematically, and derive structured rubrics for outcome-based rewards. • Through extensive experiments, we demonstrate the inference-time scaling of verification that holds for both capable closed-source LLM APIs and supervised fine-tuned models; integrating enhanced verification capabilities significantly boosts overall agent performance. Figure 2: Overview of DeepVerifier, which decomposes complex verification problems into smaller, simpler sub-questions leveraging the asymmetry of verification, and provides corrective feedback for the DRA to retry when the answer is considered incorrect. 2 Related Work 2.1 Deep Reserach Agents Research on DRA has rapidly advanced, aiming to build autonomous systems capable of multi-step tasks such as web navigation, data analysis, code generation, and report synthesis. Proprietary frameworks like OpenAI’s Deep Research 21 , Google’s Gemini Deep Research 9 , Perplexity’s Deep Research 23 , and Moonshot AI’s Kimi-Researcher 19 ; 20 demonstrate strong performance on benchmarks such as GAIA and Humanity’s Last Exam, setting high standards for autonomy and multimodal reasoning. Meanwhile, open-source frameworks democratize agent development. Notable systems include Hugging Face’s SmolAgents 24 , Alibaba’s WebAgent family 34 ; 16 ; 29 , and other agents framework such as WebWalker 35 , OWL 13 , TapeAgent 1 , AutoAgent 28 ,OAgents 43 ; 44 , Cognitive Kernel 40 , and Cog-Kernel-Pro 6 , and WebEvolver 5 . In all, DRA verification and its scaling effect remain underexplored. 2.2 Test-Time Scaling of Agents Many works apply Test-Time-Scaling ( 3 ; 26 ) to enhance the quality of agent responses. 45 proposes Best-of-N selection, majority vote, etc. However, such test-time-scaling methods remain prone to the same set of failures in different roll-outs, meaning that errors arising in one run also tend to recur in other runs, rendering the overall result unreliable. Other works explored using LLMs or agents as judges to evaluate agent responses 11 ; 22 ; 17 ; 46 ; 36 . However, these works have focused on web navigation tasks, general reasoning tasks, or software development tasks, while none have studied the responses of DRAs. Recent research also investigates

Read the complete text