Dual Ensembled Multiagent Q-Learning with Hypernet Regularizer
Yaodong Yang, Guangyong Chen, Hongyao Tang, Furui Liu, Danruo Deng, Pheng Ann Heng · 2025
Read Dual Ensembled Multiagent Q-Learning with Hypernet Regularizer by Yaodong Yang, Guangyong Chen, Hongyao Tang, Furui Liu, Danruo Deng, Pheng Ann Heng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-02018.txt.
Description
Yaodong Yang and co-authors attack the inflated self-confidence of learning teams. In multiagent reinforcement learning, each agent's value estimates tend to run too high, and the error grows with team size until learning destabilizes. Earlier fixes trimmed the target values used in training but ignored how the live network's own updates pile the error back on. Their 2025 paper analyzes the loop of estimation and optimization together, then intervenes in both halves.
Their method, DEMAQ-HR, first averages random ensembles of both the individual and the team value estimates to set a lower, safer target. A new regularizer then restrains the mixing network's weights during optimization so optimism cannot quietly re-accumulate. On standard particle-world and StarCraft testbeds, the approach tamed the overestimation and stabilized learning. The authors frame the lesson plainly: in teams, optimism compounds twice, so it must be taxed twice.
Catalog record
| CREATOR | Yaodong Yang, Guangyong Chen, Hongyao Tang, Furui Liu, Danruo Deng, Pheng Ann Heng |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-02018