Betting on Equilibrium: Monitoring Strategic Behavior in Multi-Agent Systems
Etienne Gauthier, Francis Bach, Michael I. Jordan · 2026
Read Betting on Equilibrium: Monitoring Strategic Behavior in Multi-Agent Systems by Etienne Gauthier, Francis Bach, Michael I. Jordan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-05427.txt.
Introduction
Etienne Gauthier and 2 co-authors introduce, in a 2026 paper, a way to detect when players in repeated games drift away from strategic behavior. Their test works online, without fixing the sample size in advance. It builds on e-values, a tool for inference that stays valid at any stopping time.
The method bets against a benchmark, so evidence grows whenever observed payoffs break the expected pattern. Equilibrium play serves as the benchmark, covering Nash, correlated, and coarse correlated forms in one framework. The authors analyze detection times, add procedures that limit false discoveries in large games, and extend the test to stochastic games with changing states.
Catalog record
| CREATOR | Etienne Gauthier, Francis Bach, Michael I. Jordan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 131 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-05427
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Betting on Equilibrium: Monitoring Strategic Behavior in Multi-Agent Systems Etienne Gauthier, Francis Bach, Michael I. Jordan Abstract In many multi-agent systems, agents interact repeatedly and are expected to settle into equilibrium behavior over time. Yet in practice, behavior often drifts, and detecting such deviations in real time remains an open challenge. We introduce a sequential testing framework that monitors whether observed play in repeated games is consistent with equilibrium, without assuming a fixed sample size. Our approach builds on the e-value framework for safe anytime-valid inference: by “betting” against equilibrium, we construct a test supermartingale that accumulates evidence whenever observed payoffs systematically violate equilibrium conditions. This yields a statistically sound, interpretable measure of departure from equilibrium that can be monitored online. We also leverage Benjamini-Hochberg-type procedures to increase detection power in large games while rigorously controlling the false discovery rate. Our framework unifies the treatment of Nash, correlated, and coarse correlated equilibria, offering finite-time guarantees and a detailed analysis of detection times. Moreover, we extend our method to stochastic games, broadening its applicability beyond repeated-play settings. 1 Introduction Game theory provides a powerful lens for understanding the collective behavior of interacting decision-makers, or agents, in shared environments. Each agent selects actions to achieve its own objectives, while the resulting interactions create complex patterns of incentives that shape the system as a whole. Such patterns can be characterized in terms of equilibrium concepts, such as Nash equilibrium ( 33 ) , correlated equilibrium ( 5 ) , or coarse correlated equilibrium ( 32 ) . In all of these cases, no individual agent can improve its expected payoff by unilaterally deviating. These equilibrium concepts apply both to single-shot games and to repeated games, thereby providing a general foundation for analyzing the collective dynamics of strategic behavior. This foundation is supported by powerful results that link game theory and online learning. For example, if all agents follow no-regret learning dynamics, their joint empirical play converges to an equilibrium set. Specifically, vanishing external regret guarantees convergence to the set of coarse correlated equilibria, while vanishing internal regret yields convergence to the set of correlated equilibria. In special cases, such as two-player zero-sum games, these equilibria coincide with Nash equilibrium. For a thorough discussion of such links between learning and games, we refer the reader to 8 . If we take a broader viewpoint on learning-based multi-agent systems, however, we see that the stationarity assumptions underlying equilibrium concepts are unrealistic. Learning agents may update their objectives, face changing environments, or adopt new strategies as learning continues. As a result, the collective behavior can drift away from equilibrium, sometimes gradually and sometimes abruptly ( 44 ; 19 ) . For equilibrium concepts to still be useful, a basic challenge is that of detecting departures from equilibrium. This would allow agents (or external entities) to verify whether agents are playing rationally ( 18 ) , detect strategic misalignment or collusion ( 24 ; 22 ) , and preempt instability in networked systems ( 38 ) . Yet monitoring equilibrium behavior as it unfolds is a challenging statistical problem. Traditional equilibrium testing assumes a fixed dataset ( 6 ) . In contrast, practitioners observing ongoing interactions need methods that can assess, in real time, whether the system remains consistent with equilibrium assumptions, or whether something fundamental has changed. To address these challenges, we introduce a sequential testing framework that monitors whether observed play aligns with equilibrium behavior, without relying on fixed sample sizes or stationary distributions. Our approach leverages the e-value framework for safe, anytime-valid inference ( 47 ; 41 ; 67 ; 23 ; 42 ; 21 ) . By “betting” against equilibrium, we construct a test supermartingale that accumulates evidence whenever observed payoffs systematically violate equilibrium conditions. This yields a statistically sound, interpretable measure of departure from equilibrium that can be monitored online. Our framework extends existing equilibrium testing approaches such as that of 6 in several key aspects. First, rather than assuming access to a fixed dataset of historical play, we develop an online procedure that enables sequential monitoring as interactions unfold. This captures the practical goal of detecting shifts from equilibrium as they happen, something that offline methods are inherently ill-suited for. Simply reapplying static tests to a growing dataset is akin to a form of sequential p-hacking ( 56 ) . Second, our method does not require knowledge of the specific payoff evaluations at the equilibrium under test. It instead operates under weaker information assumptions, requiring only that players’ behavior be consistent with some (possibly unknown) equilibrium, thereby expanding the range of settings where testing remains feasible. Additionally, we sharpen the theoretical characterization of correlated equilibrium, obtaining bounds that are linear in the number of actions per player rather than super-exponential as is the case for existing methods. Finally, we leverage a variant of the Benjamini-Hochberg procedure ( 7 ) for controlling the false discovery rate (FDR) while enhancing power in large games ( 58 ) . This method builds on earlier work using e-values for FDR control ( 64 ) and related online multiple testing methods ( 63 ) . Unlike prior approaches that address online multiple testing where hypotheses themselves arrive over time ( 69 ; 17 ) , our setting involves a fixed collection of hypotheses that are continuously updated as evidence accumulates. We also extend our sequential testing framework to stochastic games ( 34 ) , where the environment’s state evolves in response to players’ joint actions. Mathematically, this generalizes Wald’s framework ( 62 ) to state-dependent Markovian dynamics. We monitor whether observed trajectories remain consistent with a putative equilibrium behavior, even under nonstationary payoffs. Our framework captures dynamic, state-dependent interactions common in real-world multi-agent systems, where detecting deviations from intended strategies is critical. Examples include verifying adherence to risk policies in automated trading or ensuring compliance with coordination rules in autonomous driving. Our method enables online detection of such departures from equilibrium, supporting safety, compliance, and reliability in complex adaptive environments. 2 Monitoring Repeated Normal-Form Games In many multi-agent systems, agents repeatedly interact over time, producing sequences of actions and payoffs. A central question in these settings is whether observed behavior aligns with rational strategic play, formalized through equilibrium notions. In this section, we consider a repeated, finite game setting where, at each round, players choose actions and receive payoffs according to the game’s payoff structure. We assume that the joint action profile is drawn identically and independently from a fixed (possibly unknown) strategy at each round, enabling martingale and sequential inference techniques. Notation and setup. We consider a finite multi-player game with n players, and for convenience we write [n]~:=~\{1,\dots,n\} . For each player i\in[n] , let A_{i} be the finite action set, yielding the joint action space \mathbf{A}:=A_{1}\times\dots\times A_{n} . Let u_{i}:\mathbf{A}\to[0,1] be the payoff function of player i . We evaluate the payoffs of randomized strategies using the standard expected utility. We write \mathbf{a}=(a_{1},\dots,a_{n}) for an action profile and u_{i}(a_{i},a_{-i}) for the payoff of player i when the players choose actions according to \mathbf{a} . For any set S , we write \Delta(S) for the set of probability measures over S . Throughout, we use the shorthand a\wedge b:=\min(a,b) and a\vee b:=\max(a,b) . Equilibria