PMAT: Optimizing Action Generation Order in Multi-Agent Reinforcement Learning

Kun Hu, Muning Wen, Xihuai Wang, Shao Zhang, Yiwei Shi, Minne Li, Minglong Li, Ying Wen · 2025

Read PMAT: Optimizing Action Generation Order in Multi-Agent Reinforcement Learning by Kun Hu, Muning Wen, Xihuai Wang, Shao Zhang, Yiwei Shi, Minne Li, Minglong Li, Ying Wen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-16496.txt.

Description

Kun Hu and seven colleagues let game agents decide who moves first, and learn the order as part of the strategy, in a 2025 paper. Multi-agent reinforcement learning usually moves everyone at once, ignoring that one agent's action shapes another's best reply. Sequential play allows finer coordination, but the best order is itself a puzzle.

Their mechanism samples decision orders from a Plackett-Luce ranking model, sidestepping unstable rankings and vanishing gradients. Credits flow from how much each agent's local view matters, tying order to influence. Bolted onto a transformer-based multi-agent system, the result, PMAT, topped prior methods on StarCraft II battles, simulated football, and robotic control benchmarks. Coordination gains were consistent across the three testbeds. The authors argue decision order deserves first-class status in multi-agent design, alongside the policies themselves.

Catalog record

CREATORKun Hu, Muning Wen, Xihuai Wang, Shao Zhang, Yiwei Shi, Minne Li, Minglong Li, Ying Wen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-16496

Browse the full library · About the Tower of Babel