Dual Ensembled Multiagent Q-Learning with Hypernet Regularizer

Yaodong Yang, Guangyong Chen, Hongyao Tang, Furui Liu, Danruo Deng, Pheng Ann Heng · 2025

Read Dual Ensembled Multiagent Q-Learning with Hypernet Regularizer by Yaodong Yang, Guangyong Chen, Hongyao Tang, Furui Liu, Danruo Deng, Pheng Ann Heng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-02018.txt.

Description

Yaodong Yang and co-authors attack the inflated self-confidence of learning teams. In multiagent reinforcement learning, each agent's value estimates tend to run too high, and the error grows with team size until learning destabilizes. Earlier fixes trimmed the target values used in training but ignored how the live network's own updates pile the error back on. Their 2025 paper analyzes the loop of estimation and optimization together, then intervenes in both halves.

Their method, DEMAQ-HR, first averages random ensembles of both the individual and the team value estimates to set a lower, safer target. A new regularizer then restrains the mixing network's weights during optimization so optimism cannot quietly re-accumulate. On standard particle-world and StarCraft testbeds, the approach tamed the overestimation and stabilized learning. The authors frame the lesson plainly: in teams, optimism compounds twice, so it must be taxed twice.

Catalog record

CREATORYaodong Yang, Guangyong Chen, Hongyao Tang, Furui Liu, Danruo Deng, Pheng Ann Heng
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-02018

Browse the full library · About the Tower of Babel