PMAT: Optimizing Action Generation Order in Multi-Agent Reinforcement Learning
Kun Hu, Muning Wen, Xihuai Wang, Shao Zhang, Yiwei Shi, Minne Li, Minglong Li, Ying Wen · 2025
Read PMAT: Optimizing Action Generation Order in Multi-Agent Reinforcement Learning by Kun Hu, Muning Wen, Xihuai Wang, Shao Zhang, Yiwei Shi, Minne Li, Minglong Li, Ying Wen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-16496.txt.
Description
Kun Hu and seven colleagues let game agents decide who moves first, and learn the order as part of the strategy, in a 2025 paper. Multi-agent reinforcement learning usually moves everyone at once, ignoring that one agent's action shapes another's best reply. Sequential play allows finer coordination, but the best order is itself a puzzle.
Their mechanism samples decision orders from a Plackett-Luce ranking model, sidestepping unstable rankings and vanishing gradients. Credits flow from how much each agent's local view matters, tying order to influence. Bolted onto a transformer-based multi-agent system, the result, PMAT, topped prior methods on StarCraft II battles, simulated football, and robotic control benchmarks. Coordination gains were consistent across the three testbeds. The authors argue decision order deserves first-class status in multi-agent design, alongside the policies themselves.
Catalog record
| CREATOR | Kun Hu, Muning Wen, Xihuai Wang, Shao Zhang, Yiwei Shi, Minne Li, Minglong Li, Ying Wen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-16496