On the Internet, Nobody Knows You’re an LLM Bot: Unmasking Web Agents with Multi-Layer Fingerprinting
Iliana Fayolle, Sihem Bouhenniche, Samuel Pélissier, Pierre Laperdrix, Clémentine Maurice, Walter Rudametkin · 2026
Read On the Internet, Nobody Knows You’re an LLM Bot: Unmasking Web Agents with Multi-Layer Fingerprinting by Iliana Fayolle, Sihem Bouhenniche, Samuel Pélissier, Pierre Laperdrix, Clémentine Maurice, Walter Rudametkin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30119.txt.
Introduction
Iliana Fayolle and five colleagues test whether modern web agents can hide from website defenses. Since twenty twenty-three, language model based agents browse the web autonomously. They solve anti-bot challenges and mimic human behavior convincingly. Some 2026 agents even run on the user's own machine. Site operators struggle to tell them apart from people.
The team deployed honeysites guarded by standard anti-bot mechanisms. Defenses included robots files, CAPTCHAs, proof-of-work, and Cloudflare tools. Six language model based web agents were sent to visit. Fingerprinting covered network, HTTP, and browser layers at once. Some agents bypassed every anti-bot mechanism they faced. Yet every agent could be distinguished from humans by fingerprinting. Agents were also distinguishable from one another the same way. Stealth techniques often backfired, making agents easier to spot.
Catalog record
| CREATOR | Iliana Fayolle, Sihem Bouhenniche, Samuel Pélissier, Pierre Laperdrix, Clémentine Maurice, Walter Rudametkin |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 103 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.30119
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
On the Internet, Nobody Knows You’re an LLM Bot: Unmasking Web Agents with Multi-Layer Fingerprinting Iliana Fayolle, Sihem Bouhenniche, Samuel Pélissier, Pierre Laperdrix, Clémentine Maurice, Walter Rudametkin Abstract . Since 2023, a new class of bots has emerged: Web Agents. They can automate complex tasks on the Web, going beyond traditional browser automation tools such as Selenium , Puppeteer , or Playwright . Leveraging large language models (LLMs), these agents are capable of solving anti-bot mechanisms, mimicking human behavior, and, in some cases, operating directly from the local machine of the user configuring them. As a result, it is becoming increasingly difficult for website administrators to detect and block these LLM-based bots. Modern Web Agents commonly integrate stealth and anti-detection techniques, while numerous proprietary and open-source anti-bot mechanisms have emerged recently, specifically to block them. However, despite their growing prevalence, there is little evaluation of the effectiveness of state-of-the-art anti-bot mechanisms against these LLM-based bots and their stealth capabilities. Likewise, no prior work has comprehensively studied how to characterize and distinguish Web Agents deployed either in the cloud or locally. This paper addresses these open questions by deploying multiple honeysites protected by one or more anti-bot mechanisms (e.g., robots.txt , CAPTCHAs, proof-of-work, and Cloudflare’s free proprietary solutions). We integrated network-, HTTP-, and browser-level fingerprinting techniques, and prompted six LLM-based Web Agents to visit the deployed honeysites. Our analysis reveals three main findings: (i) some Web Agents were able to bypass all evaluated anti-bot mechanisms; (ii) all evaluated Web Agents can be distinguished both from humans and from one another using multi-layer fingerprinting techniques across network, HTTP and browser layers; (iii) stealth and anti-detection mechanisms often increase detectability rather than decrease it. 1. Introduction According to Cloudflare Radar ( 16 ) and the 2025 Thales Group report ( 54 ) , bots represent between 30% and 50% of all web traffic. Not all bots are harmful, some serve legitimate purposes in the Web ecosystem, such as search engine indexers, uptime monitors, or accessibility checkers. However, a significant fraction of bot traffic is either malicious (e.g., engaging in security exploits, credential stuffing, fraud, spam, or content theft ( 14 ; 104 ; 67 ) ) or simply unwanted (e.g., consuming server resources, inflating bandwidth costs, and crowding out genuine user traffic ( 30 ) ). Approximately 14% of total web traffic is attributed to so-called bad bots ( 54 ) . As a result, web administrators need to selectively block certain categories of bots while preserving access for legitimate bots and actual visitors. This dynamic explains the ongoing arms race between bot operators and web administrators. The most basic countermeasure, the Robots Exclusion Protocol (commonly known as robots.txt ( 44 ) ), allows web administrators to declare which paths crawlers should avoid. However, since robots.txt is merely advisory, many bots, including some of those operated by AI companies, ignore it entirely and scrape content regardless ( 67 ; 2 ) . Moreover, non-expert web administrators, such as artists, hobbyists, or beginners are often unaware of this convention or are unable to modify the file due to restrictions imposed by their hosting provider ( 67 ) . More direct enforcement mechanisms, such as server-side rules ( 40 ) and user-agent blocking, shift control from the bot to the server but remain trivially bypassed via user-agent spoofing ( 73 ; 66 ; 59 ) . Hence, more sophisticated techniques have been developed, including challenge-based methods (e.g., CAPTCHAs ( 47 ; 90 ) , proof-of-work ( 112 ) ), browser ( 123 ; 125 ; 8 ) and TLS fingerprinting ( 88 ; 66 ) , which aim to identify bots more reliably regardless of the identity they claim. Since October 2023, a new category of bot traffic has emerged, based on Large Language Models (LLMs), a class of AI generative models ( 67 ) . LLM-based bots operate in three distinct modes: (i) passive crawling to collect training data from the open Web ( 83 ) ; (ii) active retrieval triggered when a user submits a query to a system such as ChatGPT ( 80 ) , causing the model to fetch live content on the user’s behalf; and (iii) agentic visits in which autonomous Web Agent tools browse, interact with, and extract information from pages with varying degrees of autonomy (hereafter, we use the terms “tools” and Web Agents interchangeably). This increase in LLM-based traffic has concrete consequences for website administrators: excessive resource consumption, increased hosting fees, loss of advertising revenue from traffic never converted into human engagement, and a loss of control over how content is used for model training ( 67 ) . Beyond volume, LLM-based bots require more nuance when blocking. A web administrator could previously maintain a relatively stable allowlist of well-known, well-behaved crawlers (e.g., Googlebot ) and broadly block any unexpected behavior or fingerprint. Now, they may wish to block LLM training crawlers to prevent their content from being ingested without consent, while simultaneously permitting certain agentic use cases. However, previous work only focused on robots.txt compliance by LLM-based bots ( 58 ; 67 ; 26 ) or the characteristics of bot traffic prior to LLM democratization ( 66 ; 125 ; 123 ; 122 ; 8 ) . To the best of our knowledge, this is the first large-scale study on the identifying features of LLM-based bots from the perspective of a web server using only single-request, multi-layer fingerprinting techniques via technical API-level observations, without relying on behavioral analysis that requires multiple bot visits or interactions ( 127 ) . Furthermore, we found no previous work that estimates the possibility of blocking evasive LLM-based bots with a sufficiently fine-grained approach, which is crucial for web administrators to maintain control over their content and resources while allowing legitimate use cases. This motivates the following research questions: RQ1 : To what extent are modern web defenses effective against bots, in particular LLM-based ones? RQ2 : Do LLM-based bots exhibit distinctive characteristics (e.g., IP metadata, TLS fingerprints, HTTP header patterns, browser fingerprints) that differentiate them from traditional bots? RQ3 : To what extent can locally executed Web Agents be distinguished from cloud-based ones, and are they inherently less detectable due to their similarity to genuine user environments? To answer these research questions, we deployed nine honeypot servers, each with one or more anti-bot mechanisms installed. For each incoming connection, we collect three fingerprinting layers: (i) network-level information including IP and TLS data, (ii) HTTP headers, and (iii) browser fingerprints. We interact with our infrastructure through a diverse set of 12 tools, including historical web scrapers (e.g., cURL ), web automation frameworks (e.g., Playwright ), and LLM-based Web Agents, deployed both locally and in cloud environments. To establish a baseline for legitimate traffic, we additionally collect fingerprints generated by our local machines across the same three layers. Our contributions are as follows. (I) We actively evaluate the effectiveness of each anti-bot mechanism, as well as the added value of combining multiple techniques against modern Web Agents (§ 5 ). (II) We establish the most relevant fingerprinting criteria to distinguish between human users and bots, and more specifically to differentiate between Web Agents and traditional bots (§ 6 ). (III) Finally, we