Fixing Incomplete Value Function Decomposition for Multi-Agent Reinforcement Learning

Andrea Baisero, Rupali Bhati, Shuo Liu, Aathira Pillai, Christopher Amato · 2025

Read Fixing Incomplete Value Function Decomposition for Multi-Agent Reinforcement Learning by Andrea Baisero, Rupali Bhati, Shuo Liu, Aathira Pillai, Christopher Amato (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-10484.txt.

Description

Andrea Baisero and co-authors fix in 2025 a blind spot in how teams of learning agents share credit. In cooperative multi-agent learning, a team's total score is built from each agent's private score. The building rule must keep each agent's best move aligned with the team's best, a property called IGM.

Popular rules satisfy the property but cannot express many valid score patterns. The one rule that can is needlessly complex. The authors lay out the full class in a simple form and add a thin fixing layer to older models, calling the family QFIX. Across game testbeds, the fixed models learned more stably and scored higher, with the smallest mixing parts.

Catalog record

CREATORAndrea Baisero, Rupali Bhati, Shuo Liu, Aathira Pillai, Christopher Amato
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE111 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-10484

Browse the full library · About the Tower of Babel