From Grunts to Grammar: Emergent Language from Cooperative Foraging

Maytus Piriyajitakonkij, Rujikorn Charakorn, Weicheng Tao, Wei Pan, Mingfei Sun, Cheston Tan, Mengmi Zhang · 2025

Read From Grunts to Grammar: Emergent Language from Cooperative Foraging by Maytus Piriyajitakonkij, Rujikorn Charakorn, Weicheng Tao, Wei Pan, Mingfei Sun, Cheston Tan, Mengmi Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-12872.txt.

Introduction

Why humans have language may trace back to cooperation: ancestors who could coordinate hunts and shares had reason to invent signals. Maytus Piriyajitakonkij and co-authors tested that story in 2025 with artificial agents playing foraging games in a shared grid world. Each agent sees only part of the world and must coordinate with partners to grab high-value targets or act in the right order, learning actions and communication together from scratch.

The signals the agents invented showed hallmarks of natural language: arbitrariness, interchangeability between speaker and listener, displacement beyond the here and now, cultural transmission across generations, and compositionality. The team measured each property and varied population size, social structure, and timing demands to see what shapes which feature. They offer the setup as a public platform for studying how language can grow out of partial knowledge and shared goals.

Catalog record

CREATORMaytus Piriyajitakonkij, Rujikorn Charakorn, Weicheng Tao, Wei Pan, Mingfei Sun, Cheston Tan, Mengmi Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-12872

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

From Grunts to Grammar: Emergent Language from Cooperative Foraging Maytus Piriyajitakonkij, Rujikorn Charakorn, Weicheng Tao, Wei Pan, Mingfei Sun, Cheston Tan, Mengmi Zhang Abstract Early cavemen relied on gestures, vocalizations, and simple signals to coordinate, plan, avoid predators, and share resources. Today, humans collaborate using complex languages to achieve remarkable results. What drives this evolution in communication? How does language emerge, adapt, and become vital for teamwork? Understanding the origins of language remains a challenge. A leading hypothesis in linguistics and anthropology posits that language evolved to meet the ecological and social demands of early human cooperation. Language did not arise in isolation, but through shared survival goals. Inspired by this view, we investigate the emergence of language in multi-agent Foraging Games. These environments are designed to reflect the cognitive and ecological constraints believed to have influenced the evolution of communication. Agents operate in a shared grid world with only partial knowledge about other agents and the environment, and must coordinate to complete games like picking up high-value targets or executing temporally ordered actions. Using end-to-end deep reinforcement learning, agents learn both actions and communication strategies from scratch. We find that agents develop communication protocols with hallmark features of natural language: arbitrariness, interchangeability, displacement, cultural transmission, and compositionality. We quantify each property and analyze how different factors, such as population size and temporal dependencies, shape specific aspects of the emergent language. Our framework serves as a platform for studying how language can evolve from partial observability, temporal reasoning, and cooperative goals in embodied multi-agent settings. We will release all data, code, and models publicly. (a) Foraging Games (b) ScoreG (c) TemporalG Figure 1 : An Overview of Foraging Games. (a) Two agents operate in a 5\times 5 partially observable grid world. Each agent can observe a 3\times 3 grid centered on itself. The two agents are required to pick up the goal items simultaneously. (b) ScoreG game: Two items are assigned random scores; each agent observes only one score, and both must pick up the higher-scoring item to succeed in an episode. This game is designed to encourage agents to communicate about items’ scores. (c) TemporalG game: Two items are assigned random spawn times; each agent observes only one item when it spawns. The agents must pick up the items in the same order as their spawn times—i.e., the earlier item must be picked up first. This game is designed to encourage agents to communicate about time. 1 Introduction Before the emergence of structured language, early humans relied on gestures, vocalizations, and simple signals to coordinate their actions in a partially observable and socially interdependent world. A leading hypothesis is that human language evolved not in isolation, but through cooperative interaction under partial observability sterelny2012language ; tomasello2010origins ; nowak2000evolution ; christiansen2003language ; nowak2001towards . Language is not merely an abstract code but a tool shaped by social use and shared goals wittgenstein2009philosophical ; wagner2003progress . Although direct evidence from these early stages is unavailable, multi-agent simulations offer a way to study how language emerges from the need to coordinate with others cangelosi2012simulating ; kirby2014iterated ; lazaridou2017multi ; lazaridou2018emergence . Prior work on emergent communication has primarily focused on referential games (RG), where a speaker conveys task-relevant information to a listener over a limited communication channel lazaridou2017multi ; lewis2008convention ; kharitonov2019egg ; gualdoni2024bridging . These settings have advanced our understanding of symbol grounding and compositionality, but often impose simplifying assumptions: agents are limited to unidirectional communication galke2022emergent , operate in fixed speaker-listener roles, and perform disembodied tasks with passive input processing and no active interaction with the environment. Even recent extensions to population-based learning kim2021emergent ; chaabouni2022emergent ; michelrevisiting typically decouple communication from physical behavior. Such setups diverge from the ecologically grounded, socially interdependent, and embodied conditions under which human language likely evolved tomasello2010origins ; dessalles2007we . To bridge this gap, we introduce Foraging Games (FG), a multi-agent framework designed to reflect more realistic ecological and cognitive constraints that may have shaped early language dessalles2007we ; tomasello2010origins . FG supports bidirectional communication. Agents are trained to jointly learn both physical action and communication, as early humans likely did during cooperative foraging. The environment enforces embodiment: agents must explore, observe, and act within a dynamic and partially observable world that they can influence. Moreover, each agent interacts with a population of diverse partners, facilitating the study of generalization to new partners, dialect formation, and cultural transmission kim2021emergent ; rita2022role ; michelrevisiting . Specifically, we formulate FG as a partially observable grid world in which agents must complete multi-step games as shown in Figure 1 . Success depends not only on taking effective actions, but also on communicating what they see and know. It includes two games: (1) collecting the most valuable item with a partner, which encourages communication about items’ scores and locations, and (2) picking up items in a specific order with a partner, which requires communication about when items were seen. Each agent has deep neural network modules for perception, memory, and policies to translate internal representations into actions and messages. Agents communicate through discrete messages drawn from a finite set of learnable vocabulary exchanged at each time step. They are trained independently using Proximal Policy Optimization (PPO) schulman2017proximal , with no shared modules, parameters, or gradients, reflecting the personalized and decentralized nature of each agent. Subsequently, agents achieve a success rate (SR) above 95\% across all games. Although two trained agents perform well when paired with each other, each fails when paired with a copy of itself at test time, suggesting that an agent understands only its partner’s language, not the one it produces. We propose two solutions to this problem. The first is to train a population with more than two agents. We hypothesize that developing a shared language becomes the optimal strategy when agents must communicate with multiple partners. The second is to incorporate self-interaction during training charakorn2023generating ; charakorn2024diversity , motivated by the observation that humans can speak to themselves. These solutions encourage agents to comprehend their own messages, promoting convergence on a shared common language and reflecting the property of interchangeability. Since human language develops in populations, we further explore language properties in groups of agents connected via fully connected and ring-structured social networks. We decode task-relevant information, such as item positions, from the agents’ messages using logistic regression, verifying that the messages are meaningful rather than random. Above-chance decoding accuracy indicates that a language has emerged to communicate item properties. Finally, we show that agents can develop implicit communication wang2025scout ; grupen2022multi ; dreyer2025comparing , i.e., gaining information by observing a partner’s behavior, when they are unable to send messages. Our key contributions are as follows: 1. We introduce Foraging Games, a framework for studying emergent communication in physically grounded, socially interdependent environments. FG provides ecological and cognitive constraints that early humans might have faced, including embodiment, behavior coordination, partial observability, bidirectional communication, and temporal reasoning. 2. We introduce a hybrid cross-and-self-play training regime that encourages interchangeable language and supports cultural transmission : agents that are closer in the training population develop more similar languages than those farther apart. While agents need not converge on a single shared language, reflecting the arbitrariness of language,

Read the complete text