The Emergence of Complex Behavior in Large-Scale Ecological Environments
Joseph Bejjani, Chase Van Amburg, Chengrui Wang, Chloe Huangyuan Su, Sarah M. Pratt, Yasin Mazloumi, Naeem Khoshnevis, Sham M. Kakade, Kianté Brantley, Aaron Walsman · 2025
Read The Emergence of Complex Behavior in Large-Scale Ecological Environments by Joseph Bejjani, Chase Van Amburg, Chengrui Wang, Chloe Huangyuan Su, Sarah M. Pratt, Yasin Mazloumi, Naeem Khoshnevis, Sham M. Kakade, Kianté Brantley, Aaron Walsman (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-18221.txt.
Introduction
Joseph Bejjani, with nine co-authors, scales an open-ended digital ecology to tens of thousands of evolving agents to watch complex behavior emerge. No agent gets rewards or a learning goal. They live, reproduce, mutate, and face selection, while reshaping their world and each other in the process.
A new multi-agent simulator on modern hardware pushes populations past sixty thousand, each agent with its own evolved neural policy. Behaviors such as long-range resource extraction and vision-based strategies appear. The study asks how scale itself, in population and in space, changes what evolution invents when nobody sets the task.
Catalog record
| CREATOR | Joseph Bejjani, Chase Van Amburg, Chengrui Wang, Chloe Huangyuan Su, Sarah M. Pratt, Yasin Mazloumi, Naeem Khoshnevis, Sham M. Kakade, Kianté Brantley, Aaron Walsman |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-18221
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Emergence of Complex Behavior in Large-Scale Ecological Environments Joseph Bejjani, Chase Van Amburg, Chengrui Wang, Chloe Huangyuan Su, Sarah M. Pratt, Yasin Mazloumi, Naeem Khoshnevis, Sham M. Kakade, Kianté Brantley, Aaron Walsman Abstract We explore how physical scale and population size shape the emergence of complex behaviors in open-ended ecological environments. In our setting, agents are unsupervised and have no explicit rewards or learning objectives but instead evolve over time according to reproduction, mutation, and natural selection. As they act, agents also shape their environment and the population around them in an ongoing dynamic ecology. Our goal is not to optimize a single high-performance policy, but instead to examine how behaviors emerge and evolve across large populations due to natural competition and environmental pressures. In an effort to discover how complex behaviors naturally emerge, we conduct experiments in large-scale worlds that reach populations of more than 60,000 individual agents, each with their own evolved neural network policy. We identify various emergent behaviors such as long-range resource extraction, vision-based foraging, and predation that arise under competitive and survival pressures. We examine how sensing modalities and environmental scale affect the emergence of these behaviors, finding that some appear only in sufficiently large environments and populations, with larger scales increasing behavioral stability and consistency. While there is a rich history of research in evolutionary settings, our scaling results provide promising new directions to explore ecology as an instrument of machine learning in an era of abundant computational resources. Experimental code is available at https://github.com/jbejjani2022/ecological-emergent-behavior . 1 Introduction Since Darwin, the evolutionary emergence of biodiversity and complex behavior has been studied across a wide variety of biological disciplines, including evolutionary theory ( Darwin 1859 ; Simpson 1944 ) , ecology ( MacArthur & Wilson 2001 ) , and genetics ( Dobzhansky 1937 ) . Models of these emergent dynamics range from theories of speciation and adaptive radiation ( Coyne & Orr 2004 ; Schluter 2000 ) to the mathematical analyses of population genetics ( Fisher 1930 ; Wright 1931 ) . In these fields, decades of mathematical modeling, laboratory experiments, and field work have tremendously improved our understanding of the mechanisms of evolution in nature. Unfortunately, there are many obstacles to studying emergent behavior in the natural world. As ecosystems become larger and more complex, they are more difficult to control and measure. Even where possible, running controlled experiments in large-scale natural settings risks damaging or displacing wild populations. In an effort to better understand the emergence of complex behavior due to competitive and environmental pressures, we study the open-ended evolution of neural network policies in large-scale ecological simulations. In this setting, agents do not have a specified objective or reward signal but instead collect resources to survive and reproduce according to the dynamics of the environment. Policy changes occur only via mutation as parents pass their policies on to their children. With the rapid growth in computational resources available to researchers, our goal is to study open-ended evolutionary dynamics in populations of these simple digital organisms at scales not previously possible, in the hopes of providing new tools for investigating the effects of environmental scale and population size on behavioral emergence. To study this, we use a new JAX-based simulation environment ( Wang et al. 2025 ) that allows rapid evaluation of large grid worlds. Our larger experiments can contain over 60,000 individual agents with a physical area of 1,000,000 grid cells. Agents in this environment must navigate to find food and other resources in order to survive. Agents can also reproduce by collecting enough resources to make a mutated copy of themselves. A 3D visualization of this environment can be found in Figure 1 . We identify multiple instances where sensor configurations and large environmental scales strongly impact the resulting behaviors, which can lead to long-term ecological consequences. For example, we show that agents with simple compass sensors can adapt to conduct long-range resource gathering expeditions, but that this behavior emerges less reliably at small scales. We also show that agents with vision sensors will evolve better foraging and attacking behavior than agents without them. Again, these effects are more consistent at large scales. These investigations aim not only to better understand ecological phenomena through simulation, but also to create a novel environment for studying machine intelligence. Recent years have demonstrated that in AI, scale doesn’t merely improve models — it fundamentally transforms their capabilities ( Wei et al. 2022a ) . Yet despite this insight, many attempts at embodied learning have remained confined to simple environments with small populations over short timescales. Our work explores what capabilities emerge when we scale not just a single model but an entire ecosystem. Just as reasoning emerges in individual models only beyond a certain size threshold ( Wei et al. 2022b ) , we ask: what strategies become learnable within populations only when environmental complexity reaches sufficient richness? Through this lens, we present our work not only as a method to learn about ecology, but as an exploration of how ecology itself learns. Figure 1: A 3D visualization of a 512\times 512 map in our environment. Insert (a) shows a top down view of the entire map, (b) shows a group of agents clustered in the corner, (c) shows agents in the water, (d) shows agents travelling back and forth from the land and (e) shows a close up of a single agent gathering resources. 2 Related Work The emergence of life has inspired computational research since the field’s inception. Conway’s Game of Life ( Games 1970 ) simulates populations through simple local rules. Early computer programs such as Tierra ( Ray 1992 ) and Avida ( Brown ) simulate life as self-replicating programs that evolve through mutations. Like Conway, Reynolds 1987 used local rules of motion to produce emergent flocking and schooling behaviors. As computers became more powerful, so did the ability to create complex simulations of evolution. Lenia ( Chan 2018 ; Chan 2020 ; Chan 2023 ) generalized the discrete state grid of Conway’s Game of Life into a continuous state space, generating diverse and lifelike organisms. Prior work has evolved agent morphology for locomotion ( Sims 1994a ; Sims 1994b ; Ha 2018 ; Gupta et al. 2021 ; Auerbach et al. 2014 ; Auerbach & Bongard 2012 ; Jeon et al. 2025 ; Auerbach & Bongard 2014 ; Szerlip & Stanley 2013 ) , sensing ( Pratt et al. 2022 ; Mugan & MacIver 2020 ; Tiwary et al. 2025 ) , and appearance ( Mordvintsev et al. 2020 ) , while neuroevolution methods have evolved neural network architectures directly ( Stanley & Miikkulainen 2002 ; Stanley & Miikkulainen 2004 ; Stanley et al. 2009 ) . Evolution has also provided inspiration for the internal dynamics of optimization algorithms. Genetic algorithms ( Holland 1992 ; Jong 1975 ) and evolutionary strategies ( Wierstra et al. 2014 ; Hansen & Ostermeier 2001 ; Rechenberg 1973 ; Schwefel 1995 ; Conti et al. 2018 ) apply the principles of evolution and natural selection to optimization and have been used to optimize neural networks for tasks like Atari games and Mujoco locomotion tasks ( Salimans et al. 2017 ; Such et