Reducing Variance Caused by Communication in Decentralized Multi-agent Deep Reinforcement Learning

Changxi Zhu, Mehdi Dastani, Shihan Wang · 2025

Read Reducing Variance Caused by Communication in Decentralized Multi-agent Deep Reinforcement Learning by Changxi Zhu, Mehdi Dastani, Shihan Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-06261.txt.

Description

Changxi Zhu, Mehdi Dastani, and Shihan Wang address in 2025 a flaw in how teams of learning agents train together. When agents share messages to coordinate, the noise in those messages can shake their learning steps and slow progress. The team studied that shake with formal analysis in a shared setting where each agent learns on its own.

They propose add-on methods that cut the shake in the learning signal. Plugged into two known methods, the add-ons were tried on tasks from a strategy game suite and a traffic junction world. Agents trained with the add-ons reached high scores while their learning steps stayed steadier, which supports the theory.

Catalog record

CREATORChangxi Zhu, Mehdi Dastani, Shihan Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE114 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-06261

Browse the full library · About the Tower of Babel