Deception and Communication in Autonomous Multi-Agent Systems: An Experimental Study with Among Us Conference: Proc. of the 25th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2026); May 25 – 29, 2026; Paphos, Cyprus

Maria Milkowski, Tim Weninger · 2026

Read Deception and Communication in Autonomous Multi-Agent Systems: An Experimental Study with Among Us Conference: Proc. of the 25th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2026); May 25 – 29, 2026; Paphos, Cyprus by Maria Milkowski, Tim Weninger (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-26635.txt.

Introduction

Milkowski and Weninger study deception among language model agents playing the social deduction game Among Us. Across 1,100 games, the agents produced over a million tokens of meeting dialogue. Speech act analysis shows all agents lean on directive language most of the time. Impostor agents shift slightly toward explanations and denials when they speak. Deception mostly takes the form of equivocation rather than outright lies, and it grows under social pressure. It rarely lifts win rates, exposing a tension between honesty and utility.

Catalog record

CREATORMaria Milkowski, Tim Weninger
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41304
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.26635

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Deception and Communication in Autonomous Multi-Agent Systems: An Experimental Study with Among Us Conference: Proc. of the 25th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2026); May 25 – 29, 2026; Paphos, Cyprus Maria Milkowski, Tim Weninger Abstract . As large language models are deployed as autonomous agents, their capacity for strategic deception raises core questions for coordination, reliability, and safety in multi-goal, multi-agent systems. We study deception and communication in LLM agents through the social deduction game Among Us , a cooperative-competitive environment. Across 1,100 games, autonomous agents produced over one million tokens of meeting dialogue. Using speech act theory and interpersonal deception theory, we find that all agents rely mainly on directive language, while impostor agents shift slightly toward representative acts such as explanations and denials. Deception appears primarily as equivocation rather than outright lies, increasing under social pressure but rarely improving win rates. Our contributions are a large-scale analysis of role-conditioned deceptive behavior in LLM agents and empirical evidence that current agents favor low-risk ambiguity that is linguistically subtle yet strategically limited, revealing a fundamental tension between truthfulness and utility in autonomous communication. \doi FRXL8789 C. Amato, L. Dennis, V. Mascardi, J. Thangarajah (eds.) 1. Introduction Autonomous agents are increasingly embedded in human environments, making decisions and communicating in contexts ranging from virtual assistants to autonomous vehicles. As these systems gain independence, goals may not always align. When misalignment occurs, agents may act deceptively by withholding, fabricating, or distorting information to further their objectives ( Sarkadi et al. 2023 ; Mayoral-Macau 2025 ; Nguyen et al. 2025 ) . Understanding when and how such deception arises is essential for building trustworthy multi-agent systems. We study this in the social deduction game Among Us 1 1 1 The Among Us game IP is owned by Innersloth. Our use is for non-commercial research purposes and governed under Fair Use. . In each game, some agents (Crewmates) strive to complete tasks and win, while others (Impostors) aim to win by eliminating Crewmates and avoiding detection. Using large language model (LLM) agents as players, we simulate 1,100 complete games across varying group sizes and impostor ratios, producing a corpus of millions of tokens of dialogue and associated reasoning traces, discussions, and votes. A short example of this is illustrated in Fig. 1 . This environment allows deception to arise from goal-driven interaction rather than from explicit instruction or hand-crafted behaviors ( Christian and Young 2004 ; Adhikari et al. 2021 ; Sarkadi et al. 2023 ) . Figure 1. Example discussion phase of four AI agents during a round of AmongUs . The imposter-agent (red) is unknown to the crew-agents (pink, green, blue) and is attempting to deceive them to win the game. Within multi-agent systems, communication has long been treated as action rather than text. Frameworks grounded in speech act theory ( Austin 1975 ; Searle 1969 ) classify utterances as assertions, directives, commissives, or declarations to support coordination and negotiation ( Wooldridge 2009 ; Kraus 1997 ) . Adversarial and competitive extensions to this framework examine how misaligned incentives can make deception or obfuscation advantageous ( Panait and Luke 2005 ; Stone and Veloso 2000 ) . Psychological approaches such as interpersonal deception theory (IDT) ( Buller and Burgoon 1996 ) emphasize concealment, falsification, and equivocation as dynamic strategies that unfold across dialogue. Together, these traditions view communication as a strategic process shaped by goals and constraints. The rise of LLM-based agents challenges these assumptions. Unlike classical systems with predefined communicative acts, LLMs generate open-ended natural language conditioned on context and role. Recent sandbox studies show that deceptive behavior can emerge spontaneously when incentives reward misrepresentation ( Golechha and Garriga-Alonso 2025 ) , and that reinforcement-trained models are often more proficient at producing deception than detecting it ( Hubinger et al. 2024 ; Greenblatt et al. 2024 ) . Yet existing work largely measures deception through outcomes rather than language. However, the way that goal-driven LLM agents balance their training pressure for truthfulness against their situational pressure for task success remains poorly understood. This is the goal of the present work. Tensions in Theory. Speech act theory assumes discrete, stable performatives such as inform or request , while interpersonal deception theory highlights ambiguity and the blending of strategies. Formal models often treat deception as an identifiable move, whereas psychological and evolutionary perspectives describe it as a continuum that includes equivocation and omission. In computational terms, this distinction parallels symbolic dialogue systems versus reinforcement-based communication, where deception may emerge as a property of optimization rather than explicit design ( Sarkar et al. 2025 ; Huynh et al. 2024 ) . These competing views motivate our study: to provide empirical evidence of how LLM agents communicate and deceive within a structured multi-agent environment. Figure 2. Overview of the Among Us simulation framework. Games begin with random initialization of player roles ( X =#Crewmates, Y =#Imposters) and tasks. During gameplay, agents act sequentially at discrete timesteps (movement, task completion, impostor actions). When a dead body is reported or an emergency meeting is called, a discussion phase is triggered: each surviving agent, including impostors, contributes up to X rounds of utterances. After discussion, a vote is held; if a plurality is reached, the selected player is ejected. The game continues until one of three termination conditions is met: (1) impostors and crew reach parity, (2) all impostors are ejected, or (3) all crew tasks are completed. Deception in Among Us Based on this setup, we address the following research questions: RQ1 How often and to what effect do autonomous agents communicate in a multi-agent deception game? RQ2 How do agents realize classical speech act categories in their dialogue? RQ3 How do agents produce deceptive strategies consistent with interpersonal deception theory, and how effective are these strategies in gameplay outcomes? By analyzing agent interactions through these lenses, we contribute: (1) a novel empirical testbed for deception in agentic AI, and (2) a theoretical synthesis linking multi-agent systems research with established communication and deception frameworks. Findings in Brief. Across all simulations, agents communicated frequently, but ( RQ1 ) the amount of dialogue alone did not predict success, indicating a potential decoupling of talk from coordinated action. Crew victories depended primarily on translating discussion into ejections rather than on how much agents spoke. Linguistically, ( RQ2 ) nearly all utterances were classified as directives, with impostors producing slightly more representatives such as denials and explanations. Deceptive speech ( RQ3 ) was dominated by equivocation ( ie , vague or hedged statements that maintain plausible deniability) while outright falsification was rare. Rates of deception increased under social pressure but showed no reliable link to victory. Together, these results indicate that while LLM agents communicate fluently and adaptively, their deceptive language reflects the competing pressures of training for factuality and for responsive task completion rather than deliberate manipulation. 2. Related Work This work sits at the intersection of (i) deception in multi-agent systems, (ii) speech-act grounded agent communication, and (iii) LLM agents in communicative games. We contribute an empirical bridge: a large-scale, controlled multi-agent evaluation in which autonomous LLM agents realize (or fail to realize) speech-act categories and deception strategies under explicit role incentives. 2.1. Deception

Read the complete text