Can AI Agents Agree?
Frédéric Berdoz, Leonardo Rugli, Roger Wattenhofer · 2026
Read Can AI Agents Agree? by Frédéric Berdoz, Leonardo Rugli, Roger Wattenhofer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-01213.txt.
Introduction
Berdoz, Rugli, and Wattenhofer test whether language-model agents can agree in adversarial consensus games over numbers. In a no-stake setting where agents hold no preferences about the final value, valid agreement proves unreliable even without attackers and worsens as groups grow. Adding a few Byzantine agents cuts success further, with failures coming from timeouts and stalled convergence, not from quiet value tampering, warning against deployments that assume robust coordination.
Catalog record
| CREATOR | Frédéric Berdoz, Leonardo Rugli, Roger Wattenhofer |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24822 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.01213
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Can AI Agents Agree? Frédéric Berdoz, Leonardo Rugli, Roger Wattenhofer Abstract Large language models are increasingly deployed as cooperating agents, yet their behavior in adversarial consensus settings has not been systematically studied. We evaluate LLM-based agents on a Byzantine consensus game over scalar values using a synchronous all-to-all simulation. We test consensus in a no-stake setting where agents have no preferences over the final value, so evaluation focuses on agreement rather than value optimality. Across hundreds of simulations spanning model sizes, group sizes, and Byzantine fractions, we find that valid agreement is not reliable even in benign settings and degrades as group size grows. Introducing a small number of Byzantine agents further reduces success. Failures are dominated by loss of liveness, such as timeouts and stalled convergence, rather than subtle value corruption. Overall, the results suggest that reliable agreement is not yet a dependable emergent capability of current LLM-agent groups even in no-stake settings, raising caution for deployments that rely on robust coordination. Agent i 1. Broadcast 2. Receive 3. Vote 4. Private strategy Internal State v_{i}^{(t)} : proposal h_{i}^{(t)} : history \texttt{stop}_{i} : vote r_{i}^{(t)} : private strategy Honest Byzantine Figure 1: Byzantine consensus game with honest and byzantine LLM agents on a synchronous all-to-all network in one round of interaction. The highlighted agent i broadcasts a scalar proposal and justification, receives messages from peers, and emits a termination decision \{\texttt{vote},\texttt{continue}\} . For clarity, only a subset of message arrows is shown. 1 Introduction Large language models are increasingly deployed as autonomous agents that collaborate on planning, coding, reasoning, and many other tasks. In some applications, a group of agents must reach a common decision rather than producing independent answers. When some agents malfunction or behave strategically, the ability of the group to still reach agreement becomes an explicit design requirement rather than a convenience. Classical Byzantine fault-tolerant consensus provides strong guarantees for deterministic algorithms ( 10 ; 7 ) , but it is unclear how these guarantees translate when decisions are produced by stochastic, prompt-driven LLMs. We therefore study a simple no-stake scalar consensus task in which a group of agents repeatedly propose values and exchange messages over a synchronous all-to-all network, and in which agents do not have specific preferences over the final value. A subset of agents may behave in a Byzantine fashion, arbitrarily attempting to disrupt or bias consensus. Each agent is implemented as an LLM-driven policy that receives a compact textual history and outputs a proposal and justification. Fig. 1 illustrates the game structure. We summarize our contributions as follows: • A capability study of LLM-agent consensus across two models and group sizes in benign settings. • A robustness study showing that even a single Byzantine agent collapses consensus success. • An analysis revealing that failures are dominated by liveness loss, not value corruption. 2 Related Work LLMs are increasingly deployed as interacting agents ( 8 ; 13 ; 9 ) , and recent work documents common multi-agent failure patterns ( 1 ) . Several approaches target robustness to malicious agents via coordination mechanisms ( 2 ; 5 ) . Closest to our setting, 3 study benign numeric consensus via LLM negotiation and analyze the effects of agent number, personality, and topology. Our focus differs in three ways. First, we introduce a controlled Byzantine fraction. Second, we enforce a validity constraint requiring the decided value to be an initial honest proposal. Third, we separate validity from liveness and show that failures are dominated by liveness loss. Complementary work frames multi-agent reliability through a Byzantine fault-tolerance lens and proposes aggregation mechanisms such as confidence-weighted consensus ( 15 ) . Concurrently, 4 also observe that multi-agent LLM coordination degrades as network size increases. In a Mixture-of-Agents setting, 12 similarly find that a single deceptive agent suffices to nullify performance gains. Figure 2: Consensus performance without Byzantine agents B=0 for Qwen3-8B and Qwen3-14B across N\in\{4,8,16\} and two prompt variants (with vs. without mentioning possible Byzantine agents). Error bars show 95% Wilson confidence intervals. Qwen3-14B reaches valid consensus more often, adversary-free prompts improve liveness, and larger groups slow and weaken consensus. Figure 3: Effect of Byzantine agents on Qwen3-14B consensus with eight honest agents. Bars show the distribution of valid vs. invalid consensus outcomes over 25 runs per configuration; missing bars correspond to 0% consensus (all timeouts). 3 Method Setting. We consider N agents communicating over a synchronous all-to-all network for rounds t=1,\ldots,T_{\max} . A fraction f\in[0,\nicefrac{{1}}{{3}}] of agents are Byzantine, with B=f\cdot N the number of Byzantine agents. Each honest agent i maintains a scalar proposal \smash{v_{i}^{(t)}\in[0,50]} , initialized at t=0 by sampling i.i.d. from a fixed distribution over [0,50] (uniform in our implementation), whereas Byzantine agents do not have an initial proposal and may choose arbitrary values in each round. The goal of the protocol is to find agreement among honest agents through a structured exchange. Protocol. Our simulator (A2A-Sim) shown in Fig. 1 delivers structured messages over a synchronous network. We present the full pseudo-code in Section A.2 and describe the prompting strategy in Section A.3 . Termination and outcomes. The simulator declares termination when at least 2/3 of all agents vote to stop; otherwise, the simulator times out at t=T_{\max} and we declare no consensus. At termination, the game yields: (i) valid consensus (all honest agents hold identical values drawn from the initial honest proposals); (ii) invalid consensus (termination without validity); or (iii) no consensus (timeout). This is a no-stake agreement game: the final agreement value carries no external reward for any of the agents, and evaluation focuses on agreement properties rather than optimizing the value. Threat model. For simplicity, we consider a restricted Byzantine model. Byzantine agents may propose arbitrary values and justifications and adapt to the history, but they cannot equivocate (send different messages to different recipients), forge identities, or drop or suppress messages. In each round, a Byzantine agent must send the same message to all recipients. We demonstrate that even this straightforward threat model can have a substantial impact on consensus performance. LLM agent implementation. Unless otherwise noted, all experiments use a common configuration. Each agent uses the same prompt template specifying its role and inputs: local summary, current proposal, and private strategy from the previous round. The agent must return a JSON-formatted output containing a scalar proposal, a free-text justification, and a termination decision. We pass a compact textual summary of previous rounds rather than the full raw history to stay within the context window. The summary includes, for the previous round, each agent’s scalar proposal and a truncated justification, along with the focal agent’s current proposal and private strategy. Evaluation. For each configuration we run 25 independent simulations and record outcome rates (valid, invalid, premature stop, no consensus), rounds to termination, and consensus quality. We use T_{\max}=50 for all experiments. Outcome rates are reported with 95% Wilson confidence intervals over 25 runs ( 11 ) . We test agents based on the Qwen3-8B/14B model family ( 14 ) . 4 Experiments and Results 4.1 Consensus without Byzantine agents We first study whether LLM-agent groups can reliably solve the scalar consensus game in benign conditions ( f=B=0 ). We run 600 simulations using A2A-Sim, varying agents N\in\{4,8,16\} and evaluating