Deep Meta Coordination Graphs for Multi-agent Reinforcement Learning
Nikunj Gupta, James Zachary Hare, Jesse Milzman, Rajgopal Kannan, Viktor Prasanna · 2025
Read Deep Meta Coordination Graphs for Multi-agent Reinforcement Learning by Nikunj Gupta, James Zachary Hare, Jesse Milzman, Rajgopal Kannan, Viktor Prasanna (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04028.txt.
Description
Teams of learning agents cooperate better when they know which teammates actually influence each other. Nikunj Gupta and four co-authors present deep meta coordination graphs, a method for multi agent reinforcement learning that builds the teamwork graph as it learns. Classic coordination graphs fix the interaction structure in advance and split the team's value function along it.
Their method instead composes new meta graphs on the fly, learns richer descriptions of agent interaction, and passes information through graph convolutional networks. The graph and the value functions train together, letting agents reason about joint actions end to end. On hard cooperative tasks, the method beat earlier graph based and non graph approaches in both performance and sample efficiency. Ablation tests traced the gains to the design choices, and a complexity analysis discusses real world use.
Catalog record
| CREATOR | Nikunj Gupta, James Zachary Hare, Jesse Milzman, Rajgopal Kannan, Viktor Prasanna |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-04028