W EBLICA : Scalable and Reproducible Training Environments for Visual Web Agents
Oğuzhan Fatih Kar, Roman Bachmann, Yuanzheng Gong, Anders Boesen Lindbo Larsen, Afshin Dehghan · 2026
Read W EBLICA : Scalable and Reproducible Training Environments for Visual Web Agents by Oğuzhan Fatih Kar, Roman Bachmann, Yuanzheng Gong, Anders Boesen Lindbo Larsen, Afshin Dehghan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06761.txt.
Introduction
Oğuzhan Fatih Kar and four co-authors present Weblica, a framework for building reproducible training environments for visual web agents. The live web is complex and ever-changing, so training data has stayed limited to offline demonstrations or a few simulated sites. Weblica instead replays real websites through HTTP-level caching that preserves interactive behavior while freezing visual states.
It also synthesizes new environments with a language model, grounded in real sites and core navigation skills. That scales reinforcement learning training to thousands of environments and tasks. Their Weblica-8B model beats similar-size open baselines on web navigation benchmarks while taking fewer steps, scales well with extra test-time compute, and rivals commercial API models.
Catalog record
| CREATOR | Oğuzhan Fatih Kar, Roman Bachmann, Yuanzheng Gong, Anders Boesen Lindbo Larsen, Afshin Dehghan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.06761
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
W EBLICA : Scalable and Reproducible Training Environments for Visual Web Agents Oğuzhan Fatih Kar, Roman Bachmann, Yuanzheng Gong, Anders Boesen Lindbo Larsen, Afshin Dehghan Abstract The web is complex, open-ended, and constantly changing, making it challenging to scale training data for visual web agents. Existing data collection attempts remain limited to offline trajectories for supervised fine-tuning or a handful of simulated environments for RL training, thus failing to capture web diversity. We propose W EBLICA (Web Replica), a framework for constructing reproducible and scalable web environments. Our framework leverages 1) HTTP-level caching to capture and replay stable visual states while preserving interactive behavior and 2) LLM-based environment synthesis grounded in real-world websites and core web navigation skills. Using this framework, we scale RL training to thousands of diverse environments and tasks. Our best model, W EBLICA -8B, outperforms open-weight baselines of similar size across multiple web navigation benchmarks while using fewer inference steps, scales favorably with additional test-time compute, and is competitive with API models. 1 Introduction Large language models are increasingly capable as autonomous agents in domains like coding [ 3 ; 25 ; 35 ; 15 ] , mathematics [ 14 ; 23 ] , and computer use [ 2 ; 24 ; 8 ; 28 ] . This progress is driven by the availability of large-scale, high-quality training data. Web navigation has emerged as a recent focus toward building agents that autonomously navigate the web to solve tasks ranging from information retrieval to form filling to online shopping. These agents aim to complete multi-step workflows that currently require manual effort, representing a significant step toward personalized digital assistants. Figure 1 : Scaling training data for visual web agents is challenging due to the complex, dynamic, and open-ended nature of the web. Left: We synthetically generate web environments in a fully automated and scalable manner, spanning a broad set of capabilities like navigation, form filling, filtering, date picking, and more. Alongside caching real websites, these create a fully offline alternative to the live web training. Right: Training on these environments improves performance across multiple web navigation benchmarks (Online-Mind2Web [ 41 ] shown here), scaling with both test-time compute (top) and model size (bottom). However, progress on building web agents has been slower, primarily due to the difficulty of scaling training data and environments to capture the complexity of the web. Recent attempts at data generation include collecting offline trajectories as demonstration data for supervised fine-tuning [ 36 ; 5 ; 9 ] , offering limited support to handle the stochastic nature of the web due to lack of interaction. As an alternative, building simulated web environments offers interaction, but they commonly cover only a handful of manually defined domains [ 50 ; 18 ] , limiting generalization. While training directly on live websites could alleviate that, it suffers from brittleness due to timeouts and bot detection, making training unstable. In addition, the live web is constantly evolving and slow to interact with, making carefully controlled ablations and fully reproducible training difficult. This raises a natural question: how to scale interactive web environments while maintaining reproducibility? We propose Weblica , a framework for constructing reproducible and scalable web environments to train visual web agents. Our framework introduces two complementary mechanisms. First, we develop an HTTP-level caching system that records and replays real website interactions, capturing stable visual states while preserving interactive behavior. This enables reproducible training on diverse real-world websites without the brittleness of live web training, though it is limited to domains where stable recordings can be obtained. Second, we present an LLM-based environment synthesis pipeline that generates interactive web environments grounded in real websites and core web navigation skills (e.g., form submission, authentication flows, dynamic search), enabling scaling to broader domains at the cost of a potential sim-to-real gap. All environments are served locally, eliminating network latency and enabling fast training. Together, these approaches provide diverse, reproducible environments at scale. Using this framework, we scale training to thousands of diverse environments and web navigation tasks. We fine-tune models from the Qwen3-VL [ 42 ] family, which operate purely on screenshots without requiring set-of-marks annotations or DOM access, as these can hurt generalization due to the web’s inconsistent underlying structure [ 47 ] . We study the effect of training stages and environment composition, and analyze how performance scales with model size and test-time compute. Our 8B model achieves strong results across multiple web navigation benchmarks. On Online-Mind2Web [ 41 ] , it reaches 39.2% pass@1 with only 30 steps, outperforming open-weight models that use 3 \times more steps, and improves further with additional test-time compute. 2 Related Work Building Web Agents. Early web agents relied on text-only language models that process structured representations such as accessibility trees or DOM elements [ 44 ; 7 ; 50 ; 10 ] . Later work adopted vision-language models (VLMs) to ground actions visually [ 18 ; 11 ; 12 ] . Since early VLMs had limited grounding capabilities, initial approaches augmented screenshots with set-of-marks [ 43 ] overlays. These overlay numbered bounding boxes on interactive elements to simplify action prediction. However, this introduces dependencies on accurate element detection and adds visual clutter that does not reflect natural web perception [ 48 ] . More recent work removes these aids entirely, building agents that operate on raw screenshots and predict actions as pixel coordinates [ 28 ; 34 ; 1 ; 5 ; 9 ; 24 ; 8 ] . We follow this direction and train visual web agents with screenshot input and coordinate-based actions. Data and Environments for Web Agents. Several efforts collect supervised fine-tuning (SFT) trajectories through human annotation or model-generated rollouts. Fara [ 5 ] develops a multi-agent data generation system that produces 145K trajectories across 70K domains. MolmoWeb [ 9 ] combines over 100K synthetic task trajectories with 30K+ human demonstrations and GUI perception data. OpenCUA [ 36 ] and AgentTrek [ 40 ] similarly collect demonstration data for web tasks. While valuable, SFT data alone provides limited support for the exploration and trial-and-error learning that RL training enables. Synthetic environments offer an alternative by enabling RL training in controlled settings. WebArena [ 50 ] and VisualWebArena [ 18 ] provide self-hosted websites that simulate e-commerce, forums, and content management systems. WebRL [ 27 ] and AgentGym-RL [ 39 ] build on these for RL training, yet they cover only a handful of domains and do not capture the diversity of the real web. Recent work has explored scaling task generation. InstaV3 [ 33 ] develops an LLM-based pipeline to generate web navigation tasks across 146K live websites. WebGym [ 6 ] sources several datasets for RL training on live websites, but suffers from reproducibility issues and training instability due to timeouts and bot detection. Our framework addresses this through caching and LLM-based synthesis while remaining grounded in real websites and web navigation skills. Evaluating Web Agents. Evaluation benchmarks for web agents span visual grounding and end-to-end task completion. For visual grounding, benchmarks like ScreenSpot-v2 [ 38 ] , ScreenSpot-Pro [ 19 ] , and MMBench-GUI [ 37 ] evaluate an agent’s ability to localize and interact with UI elements. For task completion, benchmarks vary in