Can Trustless Agents Be Trusted? An Empirical Study of the ERC-8004 Decentralized AI Agent Ecosystem
Xihan Xiong, Zelin Li, Wei Wei, Qin Wang, William Knottenbelt, Zhipeng Wang · 2026
Read Can Trustless Agents Be Trusted? An Empirical Study of the ERC-8004 Decentralized AI Agent Ecosystem by Xihan Xiong, Zelin Li, Wei Wei, Qin Wang, William Knottenbelt, Zhipeng Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-26028.txt.
Introduction
Xihan Xiong and colleagues audit a new trust system for AI agents that trade with strangers. The ERC-8004 protocol builds a permissionless trust layer on blockchains. Three on-chain registries record identity, reputation, and validation. Adoption has been rapid, yet nobody had studied the system in the wild. The team crawls records across Ethereum, BNB Smart Chain, and Base. Coverage runs from launch through mid-May of this year.
Identity records disappoint. Most registrations are placeholders, not live agents. Only a small share expose a valid file with a working service endpoint. Reputation records disappoint more. Scores cannot be compared across contexts. Feedback rarely ties to verifiable interactions. Scores can be gamed at minimal cost. Large shares of reviewers show coordinated Sybil behaviour, meaning one actor posing as many. After Sybil-flagged feedback is removed, most rated agents lose their ratings entirely on two chains.
Catalog record
| CREATOR | Xihan Xiong, Zelin Li, Wei Wei, Qin Wang, William Knottenbelt, Zhipeng Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 99 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.26028
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Can Trustless Agents Be Trusted? An Empirical Study of the ERC-8004 Decentralized AI Agent Ecosystem Xihan Xiong, Zelin Li, Wei Wei, Qin Wang, William Knottenbelt, Zhipeng Wang Abstract . As autonomous AI agents increasingly transact across organizational boundaries, a fundamental trust challenge emerges: how can an agent assess whether an unknown counterpart is trustworthy? The ERC-8004 protocol addresses this challenge with the first permissionless trust layer for AI agent economies, built around three on-chain registries for Identity, Reputation, and Validation. Despite its rapid adoption, the protocol has not been studied empirically, leaving it unclear whether the information it records provides a trustworthy basis for decision-making. To address this gap, we present the first empirical study of ERC-8004 across three chains: Ethereum, BNB Smart Chain (BSC), and Base, covering the period from protocol deployment through May 13, 2026. We crawl on-chain Identity and Reputation events, off-chain files, and x402 payment transactions. On the identity side, we find that most registrations are placeholders rather than active agents, with only a small fraction ( 3 % 3\% , 4 % 4\% , and 15 % 15\% across Ethereum, BSC, and Base) exposing a valid ERC-8004 registration file with at least one live service endpoint. On the reputation side, we show that the Registry, as currently deployed, cannot function as a trust signal: values are not commensurable, feedback records are rarely grounded in verifiable interactions, and reputation can be manipulated at minimal cost. Consistent with these design weaknesses, we find that a substantial fraction of reviewers ( 73.6 % 73.6\% , 59.2 % 59.2\% , and 90.6 % 90.6\% across Ethereum, BSC, and Base) exhibit coordinated Sybil behavior. After removing Sybil-flagged feedback, 15.5 % 15.5\% , 72.3 % 72.3\% , and 89.4 % 89.4\% of rated agents, respectively, are left with no valid feedback. We then turn these findings into concrete recommendations for future revisions of ERC-8004. Our study yields actionable protocol-design implications and establishes an empirical baseline for research on AI agent markets. \setcopyright none \authorsaddresses \settopmatter printacmref=false 1. Introduction Autonomous AI agents are evolving from passive assistants into active economic participants capable of executing transactions and operating continuously without human supervision 43 ; 27 ; 47 ; 37 . This transition creates a coordination challenge: agents from different organizations, built on heterogeneous frameworks, and operating across untrusted networks must nonetheless discover one another, assess each other’s reliability, and transact without pre-existing relationships 20 . The ERC-8004 (“Trustless Agents”) protocol 13 fills this gap. Introduced on the Ethereum mainnet on January 29, 2026, it establishes an on-chain trust layer between agent communication protocols (e.g., A2A 19 and MCP 3 ) and payment rails (e.g., x402 10 ). The protocol defines three registries, each deployed once per chain. The Identity Registry assigns agents portable ERC-721-based identities. The Reputation Registry records publicly accessible feedback that can be consumed by users, agents, or higher-level reputation systems. The Validation Registry stores independent attestations of agent performance. Together, these registries enable agents to evaluate previously unknown counterparts before committing value, without relying on a centralized intermediary. Adoption has been real and fast. In its first few months, ERC-8004 drew more than 170 k registered agents (Figure 3 ) across Ethereum, BNB Smart Chain (BSC), and Base, with a total reputation market of over 150 k feedback records (Table 3 ). Despite this rapid growth and its ambition to serve as the first open trust layer for agent economies, the protocol has not yet been studied empirically. We do not know who is using it, whether its registered identities correspond to functional agents, or whether the reputation it exposes can be trusted. Yet these are precisely the questions autonomous agents must answer before deciding whether to interact with an unknown counterpart. To address this gap, we present the first cross-chain empirical study of ERC-8004 as deployed in practice. We collect every event from the Identity and Reputation Registries across all three chains that host the protocol, from each chain’s deployment through 13 May 2026, with the referenced off-chain registration files, gas costs, and x402 payment transactions. Note that the Validation Registry had no confirmed mainnet deployment during our observation period and is therefore outside the scope of this study. Using this dataset, we ask three fundamental questions: Who registers agents? Are the registered identities meaningful? Can the Reputation Registry serve as a trustworthy trust signal? We summarize our main contributions as follows: • Multi-chain dataset (§ 4 ). We assemble the first comprehensive dataset of ERC-8004 activity: every Identity and Reputation event on Ethereum, BSC, and Base, enriched with off-chain registration and feedback files, per-transaction gas costs, and x402 settlements. Researchers may request access to the dataset to support reproducibility and follow-on research. • Identity and adoption analysis (§ 5 ). We analyze who registers and what they register. Registration is dominated by batch-minted placeholders and templated deployments, and ownership is highly concentrated on Ethereum (Gini 0.733 ) and Base (Gini 0.708 ). Most identities never become active agents, with missing URIs for 53\% on Ethereum, 9\% on BSC, and 37\% on Base. Across chains, only 3\% to 15\% expose a valid ERC-8004 registration file with at least one declared service endpoint. This reveals a substantial gap between on-chain registration counts and genuine agent deployment, suggesting that raw registration volume is a poor proxy for ecosystem maturity. • Reputation analysis, including security (§ 6 , § 7 ). We study the Reputation Registry as a trust signal. As deployed, it meets none of the four necessary conditions for a trustworthy score: values are not commensurable, feedback records are not tied to verifiable interactions, the aggregated score can be moved by a single input, and a reputation can be fabricated or destroyed at minimal cost (median cost: $ 0.055 /$ 0.0042 /$ 0.0027 on Ethereum/BSC/Base). Measuring manipulation in the wild, we identify Sybil-flagged reviewers accounting for 73.6\% , 59.2\% , and 90.6\% of reviewers on Ethereum, BSC, and Base, respectively, affecting the displayed reputations of 26.1\% , 75.8\% , and 96.8\% of rated agents. Removing their feedback leaves 15.5\% , 72.3\% , and 89.4\% of rated agents on Ethereum, BSC, and Base without any valid feedback remaining to support their reputation. • Recommendations for protocol designers (§ 8 ). We turn each finding into a concrete, implementable design change for the next revision of ERC-8004 and for similar agent registries. 2. Technical Warm-ups From AI assistants to economic agents . Large language models (LLMs) have evolved from passive assistants into autonomous agents that plan, use external tools, hire other agents, and operate without human intervention 43 ; 27 . Once agents hold wallets and settle payments programmatically, they participate in an agent economy 50 , where buyer agents pay seller agents per inference request across organizational boundaries. This creates a coordination problem: two previously unknown agents must discover each other to assess a counterpart’s competence and honesty. Current agent protocols solve only discovery and messaging: Anthropic’s Model Context Protocol (MCP) 3 standardizes the agent-to-tool interface, and Google’s Agent-to-Agent (A2A) protocol 19 standardizes agent-to-agent discovery, messaging, and task lifecycle via AgentCards . Both specify how parties communicate but defer whether a counterpart can be trusted to the application layer 13 ,