Skim: Speculative Execution for Fast and Efficient Web Agents
Mike Wong, Kevin Hsieh, Suman Nath, Ravi Netravali · 2026
Read Skim: Speculative Execution for Fast and Efficient Web Agents by Mike Wong, Kevin Hsieh, Suman Nath, Ravi Netravali (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16565.txt.
Introduction
Wong and three colleagues build Skim, a 2026 framework for speculative execution that lets web agents skip heavyweight steps on routine sites. An offline profiler first learns each site's stable URL patterns, answer formats, and task trajectories. Skim then matches a query to a template, synthesizes the destination address, and pulls the answer with a compact model behind a verifier. Across standard benchmarks with three agent backbones, median per-task cost fell by a factor of 1.9 in their tests. In the same tests, latency fell 33.4%, with no accuracy loss.
Catalog record
| CREATOR | Mike Wong, Kevin Hsieh, Suman Nath, Ravi Netravali |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57647 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.16565
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Skim: Speculative Execution for Fast and Efficient Web Agents Mike Wong, Kevin Hsieh, Suman Nath, Ravi Netravali Abstract . Skim is a speculative execution framework for web agents that exploits the predictable structure of purpose-built websites. Today’s web-agent expense is not intrinsic to the tasks but a property of how agents are composed: frontier-model inference, browser rendering, and ReAct-style planning are applied to every step of every task regardless of complexity. Skim’s key observation is that websites enforce stable URL patterns, answer formats, and task-to-trajectory mappings across queries of the same type, so most queries can bypass these heavyweight components entirely. An offline profiler captures these patterns once per site. At runtime, Skim matches each query to a template, synthesizes the destination URL, and extracts the answer with a small model. A lightweight verifier gates each fast-path output against the query and schema; rare misspeculations cascade to the full agent, warm-started by the fast path’s final URL to preserve upstream trajectory progress. Across standard web-agent benchmarks paired with three backboneagents (WebVoyager, AgentOccam, BrowserUse), Skim reduces median per-task cost by 1.9x and latency by 33.4% with no accuracy loss. 1. Introduction Web agents, or LLM-based systems that complete tasks by directly browsing and interacting with live websites, are increasingly deployed in retrieval-augmented assistants, deep-research tools, and enterprise automation pipelines. Agents such as WebVoyager ( 13 ) , AgentOccam ( 29 ) , and BrowserUse ( 3 ) now underpin a fast-growing class of products that resolve queries no static corpus can answer: navigating to authenticated pages, completing multi-step lookups across catalogs, and extracting structured information from sites the user does not need to visit themselves. This capability far exceeds what stateless retrieval pipelines (e.g., Perplexity, ChatGPT browsing) achieve by querying search indices and synthesizing from snippets – they cannot maintain authenticated state, complete multi-step trajectories, or reach content beyond search coverage – but it comes at substantial overhead: per-task latencies run 30-120 secs and API costs run $0.20-0.50, 1-2 orders of magnitude more than stateless retrieval. The high overheads of web agents trace to three off-the-shelf components, each designed for problems broader than the web tasks they typically execute. Frontier LLMs are trained for long-context multi-hop reasoning; browsers are engineered for arbitrary and secure human interaction with any web page; ReAct is a general decision-making framework for agents in unconstrained environments with sparse feedback. Each component is highly capable, but fails to exploit the structural regularities that the web exhibits. The first such property is step heterogeneity . Most steps in a typical web agent trajectory are mechanical (fetch a known URL, locate a labeled field on a page, click a stable navigation element) and do not require frontier reasoning or full browser execution. The second is task-driven structure . Sites are purpose-built around the queries users bring to them, so URL templates, page layouts, and answer formats are stable across queries of the same type. For instance, the navigation pattern that resolves one arXiv lookup resolves the next, with only query-specific identifiers changing. Together, these properties imply that many steps can run on cheaper components, and many can be skipped entirely by following trajectories the site has already revealed. Our analysis of popular web agent tasks confirms that the opportunity is substantial (§ 2.2 ). Hand-engineered programs that exploit website structure by using trajectory knowledge to fetch via direct URLs, prune to answer-bearing content, and extract with cheaper models can run 66.7-94.9% faster and 17.7-100.7 \times cheaper than the off-the-shelf ReAct agent without any accuracy loss. However, automating this strategy in practice is difficult; naively substituting these cheaper techniques inside an off-the-shelf ReAct loop drops average task success by 60%. The issue is that cheap models struggle to choose the right action from the hundreds of interactive elements on a typical page, and direct-URL fetching requires knowing in advance precisely which page will contain the answer for a given query (§ 2.3 ). Worse, errors compound across a trajectory, so a single wrong step can invalidate everything downstream. The core question is thus how to identify, when a query arrives, which shortcuts preserve accuracy for that query – a question made difficult by the heterogeneity of tasks, the variation across pages in a site, and the per-step diversity in resource needs. To address these challenges, we present Skim , a drop-in acceleration framework for existing web agents. The key insight underlying Skim is that web sites are predictable enough to precompute navigation paths offline, and structured enough to check answer correctness online. Sites change rarely relative to query rates, so trajectory patterns characterized once per task type remain valid across many future queries. Further, since sites impose stable formats on task result pages (e.g., search results), a fast path’s output can be easily validated against both the query and the expected schema, without invoking the expensive agent. Building on this, Skim profiles each reachable site offline, recording for each task type both the shortcuts that apply (URL patterns reaching its result pages) and what correct outputs look like (the answer schemas of those pages). At runtime, when a query arrives, Skim consults the profile and, if covered, speculatively attempts a fast path via direct URL fetch and cheap model processing, accepting the result only when a small judge model deems it consistent with the query and the recorded schema. Upon failure, Skim falls back to the full ReAct agent, warm-started at the URL the fast path reached – since trajectories share predictable prefixes, even failed shortcuts reduce the work that the agent must redo. We evaluate Skim on two representative benchmarks (WebVoyager, WebShop) across three popular ReAct-based web agents (BrowserUse, AgentOccam, WebVoyager). We consider two deployment modes that exploit the same underlying mechanism. In accelerate mode, Skim lowers median per-task cost by 1.9 \times and latency by 33.4% while preserving accuracy. In aggregate mode, Skim reinvests the saved compute budget into multiple trials that explore different trajectories with verifier-selected outputs. Within the single-trial baseline’s cost budget, this lifts end-to-end accuracy by up to 16.7 percentage points (4.2 pp with majority vote). Figure 1 . Workflow of a representative ReAct-based web agent. The agent loops through render, observe, reason, and act steps until task completion. 2. Background and Motivation Web agents incur substantial overheads not intrinsic to their tasks. We examine where these overheads come from, identify the structural properties that make them avoidable, and characterize the challenges of automating their removal. Figure 2 . Distribution of number of ReAct steps needed for agents to converge to an answer. Figure 3 . Per-step breakdown of latencies. Actions involve typing, clicking, googling, and scrolling while inference involves running the frontier model on the web input 2.1. Overview of web agents Canonical web agents such as WebVoyager ( 13 ) , AgentOccam ( 29 ) , BrowserUse ( 3 ) , and SeeAct ( 34 ) operate by coupling a frontier LLM with a headless browser through a ReAct execution loop ( 31 ) (Figure 1 ). At each step, the agent loads the current page in the browser, observes its rendered representation as either a serialized DOM tree or a screenshot, reasons about the next action to take, and executes that action