Deep Meta Coordination Graphs for Multi-agent Reinforcement Learning

Nikunj Gupta, James Zachary Hare, Jesse Milzman, Rajgopal Kannan, Viktor Prasanna · 2025

Read Deep Meta Coordination Graphs for Multi-agent Reinforcement Learning by Nikunj Gupta, James Zachary Hare, Jesse Milzman, Rajgopal Kannan, Viktor Prasanna (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04028.txt.

Description

Teams of learning agents cooperate better when they know which teammates actually influence each other. Nikunj Gupta and four co-authors present deep meta coordination graphs, a method for multi agent reinforcement learning that builds the teamwork graph as it learns. Classic coordination graphs fix the interaction structure in advance and split the team's value function along it.

Their method instead composes new meta graphs on the fly, learns richer descriptions of agent interaction, and passes information through graph convolutional networks. The graph and the value functions train together, letting agents reason about joint actions end to end. On hard cooperative tasks, the method beat earlier graph based and non graph approaches in both performance and sample efficiency. Ablation tests traced the gains to the design choices, and a complexity analysis discusses real world use.

Catalog record

CREATORNikunj Gupta, James Zachary Hare, Jesse Milzman, Rajgopal Kannan, Viktor Prasanna
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-04028

Browse the full library · About the Tower of Babel