Throttling Web Agents Using Reasoning Gates
Abhinav Kumar, Jaechul Roh, Ali Naseh, Eugene Bagdasarian · 2025
Read Throttling Web Agents Using Reasoning Gates by Abhinav Kumar, Jaechul Roh, Ali Naseh, Eugene Bagdasarian (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-01619.txt.
Introduction
AI web agents browse at speeds and scales no human matches, and hostile or buggy agents could overload sites, scrape content, or flood login systems with fake accounts. Abhinav Kumar, with four co-authors, designs Web Agent Throttling, a framework that charges agents a tunable cost before granting access to resources. The challenges used as gates must be asymmetric, scalable, robust, and workable for any agent.
The team focuses on the language model inside most agents and asks it to solve reasoning puzzles, burning token generation as the cost. Existing puzzles from coding or math fail their stated properties, so they introduce rebus-based reasoning gates, puzzles built from pictures and wordplay. Kumar and the co-authors aim to protect services without locking out legitimate agent traffic, shifting defense from detection toward priced access.
Catalog record
| CREATOR | Abhinav Kumar, Jaechul Roh, Ali Naseh, Eugene Bagdasarian |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-01619
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Throttling Web Agents Using Reasoning Gates Abhinav Kumar, Jaechul Roh, Ali Naseh, Eugene Bagdasarian Abstract AI web agents use Internet resources at far greater speed, scale, and complexity—changing how users and services interact. Deployed maliciously or erroneously, these agents could overload content providers. At the same time, web agents can bypass CAPTCHAs and other defenses by mimicking user behavior or flood authentication systems with fake accounts. Yet providers must protect their services and content from denial-of-service attacks and scraping by web agents. In this paper, we design a framework that imposes tunable costs on agents before providing access to resources; we call this Web Agent Throttling . We start by formalizing Throttling Gates as challenges issued to an agent that are asymmetric, scalable, robust, and compatible with any agent. Focusing on a common component—the language model—we require the agent to solve reasoning puzzles, thereby incurring excessive token-generation costs. However, we find that using existing puzzles, e.g., coding or math, as throttling gates fails to satisfy our properties. To address this, we introduce rebus-based Reasoning Gates , synthetic text puzzles that require multi–hop reasoning over world knowledge (thereby throttling an agent’s model). We design a scalable generation and verification protocol for such reasoning gates. Our framework achieves computational asymmetry, i.e., the response-generation cost is 9.2 × {\times} higher than the generation cost for SOTA models. We further deploy reasoning gates on a custom website and Model Context Protocol (MCP) servers and evaluate with real-world web agents. Finally, we discuss the limitations and environmental impact of real-world deployment of our framework. 1 Introduction Figure 1 : Reasoning gates framework. Internet resources are inherently limited, and many services struggle with denial-of-service (DoS) attacks [ 67 , 60 ] and scraping [ 64 ] . Popularity of AI web agents [ 105 ] that easily crawl the web while mimicking user behavior [ 31 ] exacerbate these threats. For example, Cloudflare recently accused Perplexity, an AI startup, of using anonymous web agents to intentionally bypass its anti-scraping defenses [ 22 ] . † † Code available at https://github.com/umass-aisec/throttling-web-agent † † Project Demo: https://aisec.cs.umass.edu/demo/web-agent-throttling/ We argue that to prevent abuse and ensure equitable access, we should deploy mechanisms that enable web services to effectively throttle emerging web agents, i.e., impose delays and costs on resource access. Note that throttling the automated use of Internet resources is not new; Internet services have traditionally deployed CAPTCHAs [ 93 , 61 ] to distinguish human users from automated bots. However, web agents powered by visual language models (VLMs) can easily bypass CAPTCHAs [ 25 , 27 ] . For instance, startups like Steel.dev [ 89 ] have already commercialized CAPTCHA bypass solutions. Note that such throttling is complementary to other agent controlling mechanisms. While user authentication and attestation mechanisms for users [ 97 , 20 ] and new designs for agents [ 59 , 86 ] will offer identity checks (if implemented), typical Internet services, e.g., public resources, cannot enforce selective access, while others will be prone to Sybil attacks [ 107 ] . Therefore, completely blocking web agents is undesirable as many act on behalf of real users or services and provide legitimate utility. In this paper, we formalize the web agent throttling problem as issuing a set of challenges, or throttling gates that the agent has to solve before accessing the resource to discourage overuse or exploitation. We assert that throttling gates must satisfy four key criteria: (a) Computational Asymmetry: challenges must be expensive to solve but cheap to verify, (b) Scalability: task generation must be fast and not require manual curation, (c) Robustness: tasks must be resistant to web search, memorization, solver APIs, and gig workers, (d) Compatibility: human users, legitimate agents and low resource agents should not be unduly penalized. Although a single agent might not incur a significant overhead, when deployed at scale, as is common in DoS and scraping scenarios, these costs should deter companies and adversaries from abuse. While AI web agents have different designs, the common part across them is a language model (LM), therefore throttling challenges can only target them to impose costs . Recent work shows that token generation for LMs is already costly and models are prone to overthinking [ 53 , 50 ] . We establish that throttling gates should force the web agent to generate tokens, therefore exhausting its computational and/or financial resources. Therefore, we propose to use reasoning challenges, i.e. puzzles that cause LMs to generate tokens, for throttling calling them reasoning gates . We analyze a range of existing challenge formats (coding tasks [ 16 ] , math puzzles [ 45 ] , constraint problems [ 103 ] , and trivia [ 79 ] ) and find that none meet all four criteria. Coding problems lack scalable verification and are vulnerable to misuse; math and logic puzzles are difficult to auto-generate at varying difficulties; constraint problems can be outsourced to solver APIs; and trivia is easily solved via search. Even large-scale benchmarks like HLE [ 76 ] require coordination nearly 1,000 subject-matter experts to curate a test set. To overcome these limitations, we combine soft reasoning problems that use common knowledge [ 88 ] and rebus puzzles [ 37 ] to create a scalable reasoning gates framework. We propose new multi-step, symbolic tasks that require LMs to combine commonsense, domain knowledge, multi-step reasoning, and symbolic composition capabilities. Each rebus-based reasoning gate (rRG) is derived from a random (word, domain) pair, allowing for low-cost verification and scalability without any LM generation based skew in the generated challenges. Importantly, solving them is difficult with basic web scraping or prompt engineering or human intervention, but manageable for capable LMs. We introduce a lightweight throttling protocol that pre-generates rRGs offline and presents them to the agent when it requests the resources (see Figure 1 ). Agents must solve these challenges to proceed, while the server bears minimal computational cost and can dynamically control the difficulty of the challenges. Our experiments reveal several key findings. First, we observe a compute-cost asymmetry of up to 9.2 \times between solving and generating the gates used in a session, making our approach efficient for providers while taxing for agents. Second, we show that smaller models (e.g., o3-mini ) can generate gates that reliably challenge and slow down much larger models — including state-of-the-art (SOTA) systems like o3 and Claude 3.7 without needing heavyweight infrastructure. Finally, in real-world tests using a live website with embedded gates, human participants struggled, taking 11 minutes to partially solve them. On the other hand, Browser Use agent [ 65 ] can solve all gates within 2-5 minutes while an agent can access the Model Context Protocol (MCP) server within 17 seconds. Our Contributions. In summary, we (1) introduce and formalize the web agent throttling problem; (2) evaluate the limitations of conventional tasks as throttling gates; (3) propose and implement rRGs, a novel class of symbolic reasoning challenges designed for agent throttling; and (4) present a throttling protocol supported by extensive empirical studies, including real-world web agent evaluations. 2 Background and Related Work AI Web Agents. AI web agents can autonomously browse, interpret, and act on the web through multi-step, goal-driven interactions. Powered by multimodal models, they