Self-Organization to the Edge of Ergodicity Breaking in a Complex Adaptive System

Nixie Sapphira Lesmana 1,2, Ling Feng 3,1, Kan Chen 4,5, Choy Heng Lai 1 · 2026

Read Self-Organization to the Edge of Ergodicity Breaking in a Complex Adaptive System by Nixie Sapphira Lesmana 1,2, Ling Feng 3,1, Kan Chen 4,5, Choy Heng Lai 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-15669.txt.

Introduction

Lesmana and three colleagues build EvoSK, a setup where agents learn on a rugged spin-glass map and the worst are swapped out. The setup tunes itself to the brink where frozen order sets in, with burst sizes that follow a power law near minus 1.5 and payoffs that top any fixed setup. At this brink, two kinds of order merge: only the heavy tail of the burst sizes gives the slow falloff that the tug between choice and change needs.

Catalog record

CREATORNixie Sapphira Lesmana 1,2, Ling Feng 3,1, Kan Chen 4,5, Choy Heng Lai 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27256
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.15669

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Self-Organization to the Edge of Ergodicity Breaking in a Complex Adaptive System Nixie Sapphira Lesmana 1,2, Ling Feng 3,1, Kan Chen 4,5, Choy Heng Lai 1 Abstract Self-organized criticality (SOC) is widely proposed as a fundamental mechanism for collective behavior, yet its role in objective-driven, heterogeneous adaptive systems underpinning real complex systems remains less understood. We introduce EvoSK, a minimal evolutionary model in which agents perform memory-dependent reinforcement learning on a rugged Sherrington–Kirkpatrick landscape while the population evolves through extremal replacement of the least-fit agents. We demonstrate that this coupled dynamics drives the system to a critical state residing on the transition boundary between ergodic and non-ergodic phases. At this boundary, the system exhibits scale-free evolutionary avalanches with a mean-field exponent τ ≈ − 1.5 \tau\approx-1.5 , while simultaneously achieving collective rewards that surpass those of any manually fine-tuned, non-evolutionary regime. Our results provide a mechanistic link between the statistical physics of ergodicity breaking and the functional optimality of complex adaptive systems, suggesting that the edge of ergodicity breaking acts as a robust attractor for systems adapting on rugged, high-dimensional landscapes. I Introduction Understanding how adaptive systems organize collective behavior in complex environments remains a central challenge across physics 2 ; 7 ; 6 ; 21 ; 16 ; 4 , biology 1 ; 3 , and learning models 12 ; 8 ; 17 ; 11 . Self-organized criticality (SOC) has long been proposed as an attracting state for driven, dissipative complex systems 2 ; 16 , often characterized by scale-free avalanche dynamics and critical cascades linked to thresholds or control parameters (e.g., critical density in forest fires 7 ; 6 , slope/height in sandpiles 14 ; 5 , or fitness in evolution 1 ; 9 ). However, most SOC studies have focused on relatively simple models interactions and without explicit optimization goals nor adaptive behaviors. In contrast, living and adaptive systems – from biological to social and economic – typically feature heterogeneous interactions and pursue explicit objectives such as survival, energy efficiency, or profit maximization, making true optimization under such constraints highly nontrivial. Key open questions therefore remain: Do genuinely complex adaptive systems self-organize toward criticality without external tuning? And if so, what is the fundamental nature of that criticality? To address these questions we construct a minimal evolutionary spin-glass model (EvoSK) that embodies the three essential ingredients of genuinely complex adaptive systems: (a) many-body nonlinear heterogeneous interactions, realized via quenched random couplings in the mean-field Sherrington–Kirkpatrick (SK) framework 15 ; 10 ; (b) adaptive agents that optimize local payoffs through memory-dependent reinforcement learning 10 ; 13 ; 19 ; and (c) Darwinian evolution through extinction and replacement of the least-fit agents, implemented via extremal dynamics 1 . The system is a direct extension of the Bak–Sneppen rules 1 but explicitly incorporates heterogeneous interactions and adaptive learning, thereby capturing both the complexity and the adaptive selection pressures in living systems. Our analysis on the experiments reveal three main results. First, the system autonomously evolves to a steady state whose collective performance surpasses that achieved by any manually tuned non-evolutionary dynamics with the same adaptive behaviors. Second, avalanche-size distributions exhibit clear power-law scaling with exponent \tau\approx-1.5 , consistent with the mean-field universality class of evolutionary SOC 1 and empirical observations in biological neural systems 3 . Third, and perhaps most importantly, this self-organized optimal state resides at the transition between ergodic and non-ergodic phases, i.e., at the edge of ergodicity breaking. The identification of ergodicity (breaking) is done through probing the evolved temperature distribution through a total-variation-based ergodicity coefficient and characterizing collective cascades via avalanche statistics. We find that within a broad range of adaptivity levels characterized by memory strength, the system spontaneously organizes to this edge of ergodicity breaking, and at the same time the systems as a whole achieves near-optimal rewards that outperform both fixed-temperature and non-evolutionary baselines, despite the fact that individual agents only optimize their local payoffs. II Model II.1 SK Games: Reinforcement Learning on a Spin-Glass Landscape We consider the SK game 10 as a stylized model of learning in a complex environment. The system consists of N interacting i -indexed agents, each choosing a binary action \sigma_{i}(t)\in\{-1,+1\} at every discrete times t . Agent interactions are encoded in a quenched random coupling matrix [J]\in\mathbb{R}^{N\times N} , with entries J_{ij}\sim\mathcal{N}(0,1/N),J_{ii}=0, corresponding to the mean-field Sherrington–Kirkpatrick (SK) spin glass model. Throughout this work, we focus on the fully symmetric case J_{ij}=J_{ji} , which admits an underlying energy function known to be favorable for collective learning and optimization. Asymmetric cases have been discussed in prior works, such as 10 , and are beyond our current scope. Each agent maintains an action value (or q -value) function q^{\sigma}_{i}(t) that evolves according to a simple reinforcement-learning rule, q^{\sigma}_{i}(t+1)=(1-\alpha)q^{\sigma}_{i}(t)+\alpha R^{\sigma}_{i}(t), (1) where a memory parameter \alpha\in(0,1) controls the update rate after receiving each instantaneous reward R^{\sigma}_{i}(t) : R^{\sigma}_{i}(t):=\sigma\sum_{j=1}^{N}J_{ij}\sigma_{j}(t). (2) Actions are chosen stochastically via a softmax policy \mathbb{P} : \mathbb{P}(\sigma_{i}(t)=\sigma)=\frac{e^{\beta q^{\sigma}_{i}(t)}}{\sum_{\sigma^{\prime}=\pm 1}e^{\beta q^{\sigma^{\prime}}_{i}(t)}}. (3) where \beta=\frac{1}{T} is an inverse temperature that controls exploration randomness characterizing the agent’s behaviour. Equations ( 1 )-( 3 ) define the baseline SK learning dynamics. The parameter \alpha defines the agents’ effective memory (small \alpha : long memory, large \alpha : rapid forgetting), while the parameter T sets the exploration level. At t=0 , all q_{i}^{\sigma} are initialized to zero, corresponding to purely random actions. q -value updates and action choices are performed simultaneously across agents. In this baseline dynamics without evolutionary adaptation, both \alpha and T are fixed externally. Previous studies have shown that the SK game behavior is highly sensitive to these two parameters; for instance, low T leads to frozen, ordered dynamics while high T produces noisy, inefficient exploration. In this work, the SK game provides a reference framework upon which our evolutionary extension is built and against which its adaptive dynamics are benchmarked. II.2 Evolutionary SK Game with Endogenous Noise Adaptation The SK Game described in Sec. II.1 assumes a fixed population of learning agents with static learning parameters. To study how learning dynamics interact with evolutionary selection, we embed the SK Game into an evolutionary environment in which agents are periodically replaced or mutated based on their performance (fitness). To allow for diversity in exploration behavior, we randomly assign a unique T_{i} value to each agent i , uniformly sampled from the range [0,2] . This range of temperature is chosen to cover diverse exploration levels, from below the known critical temperature T_{c}=1 of the SK model to above it. Our construction follows the logic of extremal dynamics, as in the Bak-Sneppen mechanism 1 . In our system, at each discrete time step t , agents first update their action values q_{i}^{\sigma}(t) and choose actions \sigma_{i}(t) according to the baseline SK Game. Let us define the instantaneous fitness of agent i as f_{i}(t):=q_{i}^{\sigma_{i}(t)}(t), (4) i.e., the value associated with the action actually taken. An evolutionary replacement then takes place. Here, the least-fit agent i , i.e. with the lowest fitness value f_{i}(t) , is removed and replaced by a new agent. A new agent i^{*} replaces i and is initialized with neutral q -values, q_{i^{*}}^{\sigma}(t)=0\quad\forall\sigma\in\{\pm 1\}, (5) corresponding to an untrained learner. Its learning behavior T_{i^{*}} is again sampled uniformly

Read the complete text