Action-Graph Policies: Learning Action Co-dependencies in Multi-Agent Reinforcement Learning

Nikunj Gupta, James Zachary Hare, Jesse Milzman, Rajgopal Kannan, Viktor Prasanna · 2026

Read Action-Graph Policies: Learning Action Co-dependencies in Multi-Agent Reinforcement Learning by Nikunj Gupta, James Zachary Hare, Jesse Milzman, Rajgopal Kannan, Viktor Prasanna (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-17009.txt.

Description

Nikunj Gupta and co-authors propose Action Graph Policies, modeling action co-dependencies in multi-agent reinforcement learning. Coordinating actions is the most basic form of cooperation in multi-agent reinforcement learning. Good decentralized decision-making often depends not only on good individual actions, but on picking compatible actions across agents to sync behavior, avoid conflicts, and meet global constraints.

Action Graph Policies model dependencies among agents' available action choices, building coordination contexts that let agents base decisions on global action dependencies. In theory, the policies induce a richer joint policy compared to fully independent policies. They can realize coordinated joint actions provably more optimal than greedy execution even from centralized value-decomposition methods. In tests, the policies achieve eighty to ninety-five percent success on canonical coordination tasks with partial observability and anti-coordination penalties, where other multi-agent methods reach only ten to twenty-five percent.

Catalog record

CREATORNikunj Gupta, James Zachary Hare, Jesse Milzman, Rajgopal Kannan, Viktor Prasanna
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE82 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-17009

Browse the full library · About the Tower of Babel