Experience-replay Innovative Dynamics
Tuo Zhang, Leonardo Stella, Julian Barreiro Gomez · 2025
Read Experience-replay Innovative Dynamics by Tuo Zhang, Leonardo Stella, Julian Barreiro Gomez (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-12199.txt.
Description
Zhang, Stella, and Barreiro-Gomez build new learning dynamics for groups of AI agents, in a paper published in 2025, borrowing from evolutionary game theory. Multi-agent learning is notoriously unstable because each learner's world shifts as the others learn. The classic replicator dynamic guarantees convergence to stable equilibria in calm settings. In other settings it misbehaves, and alternative dynamics trace cycles that only approach equilibrium.
No learning algorithm had yet been built on those cycling dynamics. The authors develop one that marries them with experience replay, the trick of reusing stored past encounters. Replay steadies the cycles enough to exploit their near-equilibrium paths. Their goal is formal guarantees where current practice relies on hope. The paper speaks to designers of fleets, markets, and games of learning machines.
Catalog record
| CREATOR | Tuo Zhang, Leonardo Stella, Julian Barreiro Gomez |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-12199