Predictive Auxiliary Learning for Belief-based Multi-Agent Systems
Qinwei Huang, Stefan Wang, Simon Khan, Garrett E. Katz, Qinru Qiu · 2025
Read Predictive Auxiliary Learning for Belief-based Multi-Agent Systems by Qinwei Huang, Stefan Wang, Simon Khan, Garrett E. Katz, Qinru Qiu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-01078.txt.
Description
Qinwei Huang and colleagues add predictive side tasks to multi agent reinforcement learning, where several agents must cooperate while seeing only part of the world. Most systems train policies from reward alone, even though observations, messages, and other agents' behavior carry useful signal.
Their framework, BEPAL, trains each agent's policy alongside a belief model that predicts hidden state information, such as other agents' rewards or directions of motion. Training is centralized while execution stays decentralized. The extra prediction work enriches the agents' internal representations and steadies learning. On a predator prey task and on Google Research Football, BEPAL improved performance metrics by about sixteen percent on average and converged more stably than baselines.
Catalog record
| CREATOR | Qinwei Huang, Stefan Wang, Simon Khan, Garrett E. Katz, Qinru Qiu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-01078