WEBEXPERT: DOMAIN-AWARE WEB AGENTS WITH CRITIC-GUIDED EXPERT EXPERIENCE FOR HIGH-PRECISION SEARCH

Yuelin Hu, Zhengxue Cheng, Ronghua Wu, Qunshan Gu, Hongwei Hu, Wei Liu, Qiao Liang, Li Song · 2026

Read WEBEXPERT: DOMAIN-AWARE WEB AGENTS WITH CRITIC-GUIDED EXPERT EXPERIENCE FOR HIGH-PRECISION SEARCH by Yuelin Hu, Zhengxue Cheng, Ronghua Wu, Qunshan Gu, Hongwei Hu, Wei Liu, Qiao Liang, Li Song (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-06177.txt.

Introduction

Hu and seven colleagues build WebExpert, a web agent for specialized fields like finance, biomedicine, and pharmaceuticals, where queries drift and evidence runs noisy. It retrieves sentence-level experience with topic merging and rule distillation, induces light facets such as time, region, policy, and industry from supervision, and plans with preference learning plus a coverage goal. At run time an experience gate steers decoding toward active facets. Across four benchmarks it beats the strongest browsing baseline by up to 3.6 points on exact match while cutting page hops.

Catalog record

CREATORYuelin Hu, Zhengxue Cheng, Ronghua Wu, Qunshan Gu, Hongwei Hu, Wei Liu, Qiao Liang, Li Song
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE16850
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.06177

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

WEBEXPERT: DOMAIN-AWARE WEB AGENTS WITH CRITIC-GUIDED EXPERT EXPERIENCE FOR HIGH-PRECISION SEARCH Yuelin Hu, Zhengxue Cheng, Ronghua Wu, Qunshan Gu, Hongwei Hu, Wei Liu, Qiao Liang, Li Song Abstract Specialized web tasks in finance, biomedicine, and pharmaceuticals remain challenging due to missing domain priors: queries drift, evidence is noisy, and reasoning is brittle. We present WebExpert, a domain-aware web agent that we implement end-to-end, featuring: (i) sentence-level experience retrieval with topic merging and rule distillation, (ii) schema-light facet induction that bootstraps time/region/policy/industry facets from weak supervision instead of static hand-written lexicons, and (iii) preference-optimized planning that jointly improves query planning and retrieval via pairwise preference learning alongside a coverage-aware objective. At inference, a lightweight experience gate biases decoding toward active facets with fallback under low-retrieval confidence. On GAIA, GPQA, HLE, and WebWalkerQA, WebExpert improves Answer Exact Match (EM) by 1.5–3.6 pp over the strongest browsing baseline and reduces page hops. Analysis shows consistent gains and ablations on retrieval, topic merging, facet induction, and preference-aware training. Our code is available at https://github.com/huyuelin/WebExpert . † † address: 1 Shanghai Jiao Tong University 2 Ant Group 3 Shanghai Maritime University 4 Shanghai Tongji University {huyuelin51717221,zxcheng,song_li}@sjtu.edu.cn {r.wu,guqunshan.gqs,Hongwei.huhw}@antgroup.com Figure 1: Overview of WebExpert. Top: compared to a generic search agent, WebExpert grounds queries with exact facets (e.g., province, time span, policy type), yielding evidence-grounded retrieval rather than token waste and insufficient evidence. Bottom: the three-step pipeline. Step 1 (offline): construct an expert experience base from QA pairs and curated sources via sentence embedding, topic merging, and rule distillation. Step 2 (training): experience-aware supervised fine-tuning (SFT) optimizes planning and retrieval. Step 3 (online): an experience-driven module conditions reasoning large language models (LLMs) to think, perform deep web exploration, and generate answers. 1 Introduction Web browsing agents have shown strong results on open-ended tasks, yet their effectiveness drops in domain-specific scenarios (e.g., credit approval in finance, clinical guidance in biomedicine). Without expert priors, agents formulate off-target queries, wander to irrelevant pages, and miss evidence. In practice, domain practitioners attend to contextual factors such as seasonality, regional regulations, and domain-specific granularity; generic agents rarely do. Figure 1 provides an overview contrasting a generic search agent with our WebExpert and summarizes the three-step pipeline that underpins our system. We present WebExpert , a domain-aware web agent that integrates an expert experience module before deep browsing. The module retrieves domain experiences and generates domain-grounded queries that steer our in-house browsing controller. Our key idea is a critic-guided extraction chain that converts annotated data and expert materials into reusable sentence-level experiences, merged into concise rules that generalize within a domain. Contributions (concise). (i) We formulate domain-aware web browsing via a critic-guided extraction chain that injects sentence-level expert priors to steer query semantics along domain-relevant facets. (ii) We present a practical pipeline from sentence extraction and dense embedding to topic clustering/merging and rule distillation (Uniform Manifold Approximation and Projection, UMAP; Hierarchical Density-Based Spatial Clustering of Applications with Noise, HDBSCAN; and BERTopic) [ 20 , 21 , 5 ] . (iii) We introduce schema-light facet induction that automatically induces facet vocabularies from weak supervision and corpus statistics, reducing manual schema dependence. (iv) We propose experience-conditioned planning with coverage-aware supervised fine-tuning (SFT), retrieval margin, and preference optimization, improving precision beyond generic Retrieval-Augmented Generation (RAG) [ 4 , 18 , 16 , 17 ] . (v) On GAIA/GPQA/HLE and WebWalkerQA, WebExpert yields consistent 1.5–3.6 pp EM gains over the strongest browsing baseline, with fewer page hops. 2 Related Work Web agents and deep research. Large reasoning models (LRMs) integrated with search and browsing have shown strong capabilities in complex tasks. Reason-then-search systems (e.g., search-o1 [ 1 ] ) couple agentic retrieval with in-document reasoning to iteratively refine external knowledge. Recent pipelines (e.g., [ 2 ] ) synthesize broad web search with deeper on-page exploration, enabling navigation across multi-step webpages while maintaining coherent reasoning. These frameworks achieve notable gains in GPQA/GAIA/WebWalkerQA/HLE, yet rely on generic priors and may drift in specialized domains. Retrieval-Augmented Generation. Retrieval-Augmented Generation (RAG) [ 4 ] and its variants [ 18 , 16 , 17 ] improve language models via retrieval augmentation and self-critique. However, RAG quality depends critically on query semantics, ranking, and denoising; domain-specialized priors (policy, region, L2 industry) are rarely injected in a structured way. Our approach complements RAG by distilling sentence-level, facetized experiences that directly bias query planning while remaining schema-light . 3 Method 3.1 Problem Setup We consider domain-specific web tasks where an agent must generate search queries, browse the web, and synthesize an answer a for a question q . We assume access to a curated expert experience base \mathcal{E}=\{r_{i}\}_{i=1}^{N} of sentence-level rules distilled from expert corpora. Let \mathcal{E}^{(k)} denote the top- k retrieved experiences for q (see Sec. 3.3 ). The overall mapping follows a reasoning-with-experiences paradigm: \displaystyle P(\mathcal{R},a\mid q,\mathcal{E}^{(k)}) \displaystyle=\prod_{t=1}^{T_{r}}P\big(\mathcal{R}_{t}\mid\mathcal{R}_{<t},q,\mathcal{E}^{(k)}_{\leq t},\mathcal{D}_{<t}\big) (1) \displaystyle\cdot\prod_{t=1}^{T_{a}}P\big(a_{t}\mid a_{<t},\mathcal{R},q\big), . where \mathcal{R} is the reasoning chain, \mathcal{D}_{<t} are retrieved web documents prior to step t , and \mathcal{E}_{\leq t} denotes the subset of retrieved experiences used up to step t . 3.2 Critic-Guided Expert Experience Extraction (1) Question harvesting and canonicalization. We collect tuples \mathcal{D}=\{(q_{i},a_{i},\mathcal{R}_{i},\mathcal{C}_{i})\} (question, final answer, optional reasoning chain, and citations). Surface forms of questions are normalized via paraphrase mining and schema-free delexicalization to get canonical intents \tilde{q}_{i} . (2) QA-level multi-view clustering. We compute representations for both questions and answers, e.g., \mathbf{u}_{i}=f_{Q}(q_{i}) , \mathbf{v}_{i}=f_{A}(a_{i}) , and optionally a co-encoded pair \mathbf{w}_{i}=f_{QA}(q_{i},a_{i}) . Multi-view density clustering (HDBSCAN/BERTopic or spectral) groups QA tuples under a similarity s\big((q,a),(q^{\prime},a^{\prime})\big)=\lambda_{1}\,\langle\mathbf{u},\mathbf{u}^{\prime}\rangle+\lambda_{2}\,\langle\mathbf{v},\mathbf{v}^{\prime}\rangle+\lambda_{3}\,\langle\mathbf{w},\mathbf{w}^{\prime}\rangle, with soft assignments to allow overlapping intents. This QA-first view captures semantically similar problems even when answers differ in granularity. (3) Evidence aggregation and de-duplication. For each cluster T_{m} , we aggregate answers and mined rationales, retain top-ranked pages/quotes using the BM25 ranking function (BM25) and dense retrieval, and apply Maximal Marginal Relevance (MMR) [ 22 ] for diversity. Source-level diversity and quote-level de-duplication reduce redundancy and noise. (4) Contradiction-aware summarization (DeepSeek-R1 1 1 1 DeepSeek-R1: a publicly available large reasoning model used for contradiction-aware summarization and synthesis. ). We prompt a contradiction- and uncertainty-aware summarizer (e.g., DeepSeek-R1) with the set of answers/rationales and citations in T_{m} to produce a concise rule r_{m} that includes: conditions (assumptions), core guidance, edge cases, and known failure modes. A lightweight entailment/consistency check filters self-contradictory statements; majority-consistent claims are preferred while minority views are either folded into caveats or flagged. (5) Facetization and normalization. Each rule is facetized into g_{m}=(\textit{time},\textit{region},\textit{policy},\textit{L2 industry}) by first filtering high-frequency domain terms (e.g., “CFA Institute” for finance, “FDA” for biomedicine) via corpus statistics as facet candidates, then refining with shallow taggers and LLM disambiguation. We normalize time ranges, geographic names, and policy references, and attach metadata (coverage, confidence, provenance). (6) Continuous refresh and versioning. The experience base is maintained as a versioned store with warm-start clustering and local merges, preserving stable rule identifiers and citation sets while enabling streaming updates as new QA/rationale evidence arrives. Formally, let clustering yield \mathcal{T}=\{T_{m}\}_{m=1}^{K} with T_{m}\subset\mathcal{D} . For each T_{m} , the summarizer h(\cdot) produces a rule and citations (r_{m},c_{m},g_{m})=h\big(T_{m}\big),\hskip 10.00002ptc_{m}\subseteq\bigcup_{(q,a,\mathcal{R},\mathcal{C})\in T_{m}}\!\mathcal{C}. The resulting experience base is \mathcal{E}=\{(r_{m},c_{m},g_{m})\}_{m=1}^{K} . When answers are unavailable, we fallback to sentence-level extraction followed by the same consolidation, preserving compatibility with prior pipelines [ 20 , 21 , 5 ]

Read the complete text