Is Lying an Emergent Behaviour in LLMs? Evidence from Gaslighting AI agents in a Sustainability Game
Subhendu Bhandary, Federico Carucci, Christos Charalambous, Francesca Dilisante, Ksenia Dvorkina, Anna Garbo, Jiaqi Liang, Riccardo Vasellini, Francesco Bertolotti · 2026
Read Is Lying an Emergent Behaviour in LLMs? Evidence from Gaslighting AI agents in a Sustainability Game by Subhendu Bhandary, Federico Carucci, Christos Charalambous, Francesca Dilisante, Ksenia Dvorkina, Anna Garbo, Jiaqi Liang, Riccardo Vasellini, Francesco Bertolotti (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-28456.txt.
Introduction
Subhendu Bhandary and eight colleagues test whether language-model agents lie on their own. Their agents play a competitive game over shared resources that are said to regrow but in fact do not. They manage industrial, military, and ecological assets while watching neighbors, warning of future attacks, and tracking reputations.
Deception emerged even when agents were never permitted to lie. Being allowed to lie mostly raised bluffing and diversion rather than outright backstabbing. Seeing neighbors' status changed the whole dynamics, raising attacks while also helping the living world last and species live side by side. Announcing future attacks lowered extinction risk without ending conflict. Reputation memory and visible biosphere levels cut how fast the living world was used up. Rule-based agents provided a baseline, and the authors read the results as evidence that lying can be emergent, while message channels may still aid sustainability.
Catalog record
| CREATOR | Subhendu Bhandary, Federico Carucci, Christos Charalambous, Francesca Dilisante, Ksenia Dvorkina, Anna Garbo, Jiaqi Liang, Riccardo Vasellini, Francesco Bertolotti |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.28456
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Is Lying an Emergent Behaviour in LLMs? Evidence from Gaslighting AI agents in a Sustainability Game Subhendu Bhandary, Federico Carucci, Christos Charalambous, Francesca Dilisante, Ksenia Dvorkina, Anna Garbo, Jiaqi Liang, Riccardo Vasellini, Francesco Bertolotti Abstract LLMs agents are increasingly used in multi-agent settings, yet their behaviour in sustainability games remains largely unexplored. This work investigates whether lying can emerge among LLM agents in a competitive sustainability game in which agents are informed that common resources can regenerate, although regeneration does not actually occur. We develop an agent-based model of a sustainability game in which agents manage industrial, military, and ecological resources, and interact through a network. LLM agents can observe neighbours’ status, declare future attacks, receive permission to lie, and access reputation information, while rule-based agents provide an interpretable behavioural baseline. The results show that neighbour information strongly changes system dynamics, increasing attacks while improving biosphere retention and coexistence. Also, the presence of future declarations reduce extinction risk without suppressing conflict. Behaviourally, deception emerges even when agents are not explicitly allowed to lie, and explicit permission mainly increases bluffing and diversion rather than direct backstabbing. Finally, the presence of reputation memory and information about the current biosphere level reduces system ecological depletion. These findings suggest that deception can arise as an emergent behaviour in LLM-agent systems and that communication between LLM-agents could support sustainability while dealing with risk. Keywords LLM \cdot sustainability \cdot ABM \cdot agent-based model \cdot multi-agent system \cdot game \cdot lying \cdot gaslighting \cdot deception 1 Introduction Sustainability is one of the most pressing challenges of our times 3 , especially since the second half of the twentieth century 14 ; 54 . The main concern in sustainability research is that the overconsumption of shared resources can undermine the ability of future generations to meet their own needs 13 . In recent years, this issue has gained renewed importance in relation to climate change and broader debates on existential risk 6 , because decisions about resource use, technological development, and environmental governance can shape long-term sustainability trajectories 24 . As automatic decision-making systems become more widespread 60 , specifically those related to machine learning in general, and large language models (LLMs) in particular 76 , the issue of how artificial agents behave in sustainability settings is becoming increasingly relevant 9 . Moreover, these systems are increasingly deployed in multi-agent settings, where they may interact with one another directly or indirectly, often through natural-language communication 21 . This raises a broader alignment problem that remains unresolved in multi-agent LLM systems: how can the collective behaviour of interacting LLM agents be assessed when repeated interaction may generate emergent dynamics, and when agents may act on incomplete or misleading information about the environment 74 ; 80 ; 50 ; 68 ? This paper addresses this issue in a specific context: when LLMs face sustainability issues and can compete with each other, is lying an emergent behavior? And, if so, is it possible to assess its effect on the overall sustainability of the system when misleading information is present? This question connects recent work on LLM deception with the literature on collective action and common-pool resource dilemmas 56 . Several studies show that LLM agents may misrepresent intentions or strategically deceive other agents even without being directly instructed to do so ( 75 ; 65 ) . Other works suggest that deception becomes especially relevant in long-horizon interaction, where statements, actions, and trust evolve over time rather than being evaluated in isolated one-shot exchanges ( 82 ; 18 ) . In sustainability settings, this is particularly important because communication may support coordination, but it may also create opportunities for manipulation, false commitments, and strategic exploitation. Consequently, the question could be studied in two ways. One would be to observe autonomous LLM agents acting in a real-world sustainability-related system. At present, however, this would be impractical and potentially unsafe, because autonomous LLMs should not be placed in control of high-stakes real-world systems without careful safeguards 50 . We therefore adopt a second approach: a minimal and controlled game environment in which decisions are explicit, outcomes are observable, and external confounders are limited 5 . We use a sustainability game that has already been employed to study artificial agents under both rule-based 8 ; 9 and LLM-based decision-making 7 . The design of the game is such that a player has two goals. First, there is a short-term competition objective, which means employing its resources to defend itself from other neighbouring players and to attack them. In order to do this, the player should decide which combination of production and military capacity to build at every turn. Some of the players’ endowment has an effect on a common stock, which in the game models the planet’s biosphere 56 . Therefore, a long-term sustainability issue arises, given that if the biosphere is completely eroded, all players lose. Consequently, these two goals are in opposition to each other, but in this work, agents are gaslighted to believe they could perform actions to positively affect the system. In the ABM of the game, two kinds of agents can be employed. First, LLM-based agents, which make decisions by calling LLMs and using their indications, can exchange semantically rich information with other agents and the environment. In our case, this information exchange includes declaring future attack intentions, potentially misrepresenting those intentions, and receiving information about the past consistency between neighbours’ declarations and subsequent actions. Then, rule-based agents, which have fixed preferences regarding production and attacking, stick to them. The ABM of the sustainability game is simulated multiple times, both with rule-based agents and with LLM-based agents, with various parameter configurations regarding the amount of initial common resources. The rule-based simulations have been carried out with the purpose of studying and interpreting the behaviour of LLMs in this short-term and long-term decision-making setting, and of providing a possible interpretation, given that LLM behaviour is typically a black box. The LLM agents were also studied with different behavioural configurations, meaning the information they could access and provide to neighbours. The results show that neighbour information could be an important condition for altering the sustainability and the deception rate of an LLM system. When agents are able to observe their neighbours, attacks increase, but biosphere retention and coexistence also improve. Also, declaring to other agents their next attacking move reduce extinction risk, although they do not eliminate conflict; deception emerges even when agents are not explicitly allowed to lie but, when lying is explicitly permitted, deceptive behaviour becomes more frequent, but through bluffing and diversion and not by direct backstabbing. Also, when agents receive information about the current state of the biosphere, their commons depletion rate decreases, together with the lying rate. Finally, rule-based agents could serve as a proper baseline to interpret, at least partially, the behaviour of LLM-based agents. The paper proceeds as follows. First, section 2 situates the study within three related bodies of work: sustainability and common-pool resource games, agent-based modelling of collective resource dynamics, and recent research on LLM agents, communication, and deception. It also clarifies the specific research gap addressed here, namely how LLM-based agents behave when sustainability constraints, conflict, communication, memory, and misleading environmental