Fixing Incomplete Value Function Decomposition for Multi-Agent Reinforcement Learning
Andrea Baisero, Rupali Bhati, Shuo Liu, Aathira Pillai, Christopher Amato · 2025
Read Fixing Incomplete Value Function Decomposition for Multi-Agent Reinforcement Learning by Andrea Baisero, Rupali Bhati, Shuo Liu, Aathira Pillai, Christopher Amato (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-10484.txt.
Description
Andrea Baisero and co-authors fix in 2025 a blind spot in how teams of learning agents share credit. In cooperative multi-agent learning, a team's total score is built from each agent's private score. The building rule must keep each agent's best move aligned with the team's best, a property called IGM.
Popular rules satisfy the property but cannot express many valid score patterns. The one rule that can is needlessly complex. The authors lay out the full class in a simple form and add a thin fixing layer to older models, calling the family QFIX. Across game testbeds, the fixed models learned more stably and scored higher, with the smallest mixing parts.
Catalog record
| CREATOR | Andrea Baisero, Rupali Bhati, Shuo Liu, Aathira Pillai, Christopher Amato |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 111 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-10484