Experience-replay Innovative Dynamics

Tuo Zhang, Leonardo Stella, Julian Barreiro Gomez · 2025

Read Experience-replay Innovative Dynamics by Tuo Zhang, Leonardo Stella, Julian Barreiro Gomez (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-12199.txt.

Description

Zhang, Stella, and Barreiro-Gomez build new learning dynamics for groups of AI agents, in a paper published in 2025, borrowing from evolutionary game theory. Multi-agent learning is notoriously unstable because each learner's world shifts as the others learn. The classic replicator dynamic guarantees convergence to stable equilibria in calm settings. In other settings it misbehaves, and alternative dynamics trace cycles that only approach equilibrium.

No learning algorithm had yet been built on those cycling dynamics. The authors develop one that marries them with experience replay, the trick of reusing stored past encounters. Replay steadies the cycles enough to exploit their near-equilibrium paths. Their goal is formal guarantees where current practice relies on hope. The paper speaks to designers of fleets, markets, and games of learning machines.

Catalog record

CREATORTuo Zhang, Leonardo Stella, Julian Barreiro Gomez
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-12199

Browse the full library · About the Tower of Babel