WebDancer: Towards Autonomous Information Seeking Agency
Jialong Wu *, Baixuan Li *, Runnan Fang *, Wenbiao Yin, Liwen Zhang, Zhengwei Tao, Dingchu Zhang, Zekun Xi, Gang Fu, Yong Jiang, Pengjun Xie, Fei Huang, Jingren ZhouTongyi Lab , Alibaba Group · 2025
Read WebDancer: Towards Autonomous Information Seeking Agency by Jialong Wu *, Baixuan Li *, Runnan Fang *, Wenbiao Yin, Liwen Zhang, Zhengwei Tao, Dingchu Zhang, Zekun Xi, Gang Fu, Yong Jiang, Pengjun Xie, Fei Huang, Jingren ZhouTongyi Lab , Alibaba Group (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-22648.txt.
Introduction
Jialong Wu and co-authors train a web agent that seeks facts on its own in this 2025 paper. Hard real problems need deep searching and step-by-step thought. Recent research agents show promise, but building one well takes a full plan.
Their plan has four stages: build browsing data, sample action paths, fine-tune the agent for a sound start, and sharpen it with reward-based learning. The agent, WebDancer, follows the ReAct style of mixing thought and action. Tests check how well it handles deep questions. The work maps a path from raw data to a working research agent.
Catalog record
| CREATOR | Jialong Wu *, Baixuan Li *, Runnan Fang *, Wenbiao Yin, Liwen Zhang, Zhengwei Tao, Dingchu Zhang, Zekun Xi, Gang Fu, Yong Jiang, Pengjun Xie, Fei Huang, Jingren ZhouTongyi Lab , Alibaba Group |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-22648
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
WebDancer: Towards Autonomous Information Seeking Agency Jialong Wu *, Baixuan Li *, Runnan Fang *, Wenbiao Yin, Liwen Zhang, Zhengwei Tao, Dingchu Zhang, Zekun Xi, Gang Fu, Yong Jiang, Pengjun Xie, Fei Huang, Jingren ZhouTongyi Lab , Alibaba Group Abstract Addressing intricate real-world problems necessitates in-depth information seeking and multi-step reasoning. Recent progress in agentic systems, exemplified by Deep Research , underscores the potential for autonomous multi-step research. In this work, we present a cohesive paradigm for building end-to-end agentic information seeking agents from a data-centric and training-stage perspective. Our approach consists of four key stages: (1) browsing data construction, (2) trajectories sampling, (3) supervised fine-tuning for effective cold start, and (4) reinforcement learning for enhanced generalisation. We instantiate this framework in a web agent based on the ReAct , WebDancer . Empirical evaluations on the challenging information seeking benchmarks, GAIA and WebWalkerQA, demonstrate the strong performance of WebDancer, achieving considerable results and highlighting the efficacy of our training paradigm. Further analysis of agent training provides valuable insights and actionable, systematic pathways for developing more capable agentic models. https://github.com/Alibaba-NLP/WebAgent ✉ ✉ footnotetext: Corresponding author. 1 Introduction Web agents are autonomous systems that perceive their real-world web environment, make decisions, and take actions to accomplish specific and human-like tasks. Recent systems, such as ChatGPT Deep Research OpenAI (2025a) and Grok DeepSearch x.ai (2025) , have demonstrated strong deep information-seeking capabilities through end-to-end reinforcement learning (RL) training. The community’s previous approaches for information seeking by agentic systems can be categorized into two types: ( i ) Directly leveraging prompting engineering techniques to guide Large Language Models (LLMs) or Large Reasoning Models (LRMs) Wu et al. (2025) ; Team (2025b) ; Li et al. (2025a) to execute complex tasks. ( ii ) Incorporating search or browser capabilities into the web agents through supervised fine-tuning (SFT) or RL Chen et al. (2025) ; Li et al. (2025a) ; Song et al. (2025) ; Jin et al. (2025) ; Sun et al. (2025) ; Zheng et al. (2025) . The first training-free methods are unable to effectively leverage the reasoning capabilities enabled by the reasoning model. Although the latter methods internalize certain information-seeking capabilities through SFT or RL training, both the training and evaluation datasets are relatively simple and do not capture the real-world challenges, for instance, performance on the 2Wiki dataset has already reached over 80%. Moreover, the current SFT or RL training paradigm does not fully and efficiently exploit the potential of information-seeking behavior. Building autonomous information seeking agency involves addressing a set of challenges that span web environment perception and decision-making: (1) acquiring high-quality, fine-grained browsing data that reflects diverse user intents and rich interaction contexts, (2) constructing reliable trajectories that support long-horizon reasoning and task decomposition, and (3) designing scalable and generalizable training strategies capable of endowing the web agent with robust behavior across out-of-distribution web environments, complex interaction patterns, and long-term objectives. To address these challenges, our objective is to unlock the autonomous multi-turn information-seeking agency, exploring how to build a web agent like Deep Research from scratch. An agent model like Deep Research produces sequences of interleaved reasoning and action steps, where each action invokes a tool to interact with the external environment autonomously . Observations from these interactions guide subsequent reasoning and actions until the task is completed. This process is optimized through end-to-end tool-augmented training. The ReAct framework Yao et al. (2023) is the most suitable paradigm, as it tightly couples reasoning with action to facilitate effective learning and generalization in interactive settings. We aim to provide the research community with a systematic guideline for building such agents from a data-centric and training-stage perspective. From a data-centric perspective, constructing web QA data is crucial to building web agents, regardless of whether the training paradigm is SFT or RL. Widely used QA datasets are often shallow, typically consisting of problems that can be solved with a single or a few-turn search. Previous works often filter the difficult QA pairs from open-sourced human-labeled datasets using prompting techniques Song et al. (2025) . Additionally, challenging web-based QA datasets typically only have test or validation sets, and their data size is relatively small. For example, GAIA Mialon et al. (2023) only has 466, WebWalkerQA Wu et al. (2025) contains 680 examples, and BrowseComp Wei et al. () has 1,266, making them insufficient for effective training. Therefore, the automatic synthesis of high-quality datasets becomes crucial. Fang et al. (2025) ; Zuo et al. (2025) . We synthesise the datasets in two ways: 1). By crawling web pages to construct deep queries, referred to as crawl QA , enabling the acquisition of web information through click actions. 2). By enhancing easy-to-hard QA pairs synthesis to incentivize the progression from weak-to-strong agency, transforming simple questions into complex ones, termed e2h QA . From a training-stage perspective, prior work has explored SFT or off-policy RL, but these approaches often face generalization issues, particularly in complex, real-world search environments. Other methods adopt on-policy RL directly Chen et al. (2025) , but in multi-tool settings, early training steps tend to focus primarily on learning tool usage via instruction following. To enable more efficient and effective training, we adopt a two-stage approach combining rejection sampling fine-tuning (RFT) with subsequent on-policy RL. For the trajectory sampling, we restrict the action space to two commonly effective web information-seeking tools as action : search and click . Building on this setup, we employ rejection sampling to generate trajectories using two prompting strategies: one with a strong instruction LLMs for Short-CoT and another leveraging the LRMs for Long-CoT. These yield high-quality trajectories containing either short or long thought , respectively. In the RL stage, we adopt the Decoupled Clip and Dynamic Sampling Policy Optimization (DAPO) algorithm Yu et al. (2025) , whose dynamic sampling mechanism can effectively exploit QA pairs that remain underutilized during the SFT phase, thereby enhancing data efficiency and policy robustness. Our key contributions can be summarized as follows: we abstract the end-to-end web agents building pipeline into four key stages : Step \mathrm{I} : Construct diverse and challenging deep information seeking QA pairs based on the real-world web environment (§ 2.1 ); Step \mathrm{II} : Sample high-quality trajectories from QA pairs using both LLMs and LRMs to guide the agency learning process (§ 2.2 ); Step \mathrm{III} : Perform fine-tuning to adapt the format instruction following to agentic tasks and environments (§ 3.1 ); Step \mathrm{IV} : Apply RL to optimize the agent’s decision-making and generalization capabilities in real-world web environments (§ 3.2 ). We offer a systematic, end-to-end pipeline for building long-term information-seeking web agents. Extensive experiments on two web information seeking benchmarks, GAIA and WebWalkerQA, show the effectiveness of our pipeline and WebDancer (§ 4 ). We further present a comprehensive analysis covering data efficiency, agentic system evaluation, and agent learning (§ 5 ). 2 Deep Information Seeking Dataset Synthesis 2.1 QA Pairs Construction To enable longer-horizon web exploration trajectories, it is essential to curate a substantial corpus of complex and diverse QA pairs that can elicit multi-step reasoning, goal decomposition, and rich interaction sequences. The main requirements for these QAs are: (i) diversity of question types, and (ii) increased task complexity as measured by the