M 3 HF \text{M}^{3}\text{HF} : Multi-agent Reinforcement Learning from Multi-phase Human Feedback of Mixed Quality
Ziyan Wang, Zhicheng Zhang, Fei Fang, Yali Du · 2025
Read M 3 HF \text{M}^{3}\text{HF} : Multi-agent Reinforcement Learning from Multi-phase Human Feedback of Mixed Quality by Ziyan Wang, Zhicheng Zhang, Fei Fang, Yali Du (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-02077.txt.
Description
Ziyan Wang and co-authors introduce a 2025 framework that trains teams of learning agents with human feedback of mixed quality. Setting good reward rules for many agents at once is hard, and bad rules breed misaligned team behavior. Their method brings people of unlike skill into training at several phases to guide the agents as they learn.
Training pauses at set points for human review. A large language model helps sort the feedback and assign it to the right agents, and reward rules update through templates with weights that decay or shift with performance. Both expert and non expert voices are folded in rather than filtered out. In hard test settings, the method beat leading rivals, and the authors argue broader human input makes team behavior easier to read and more robust.
Catalog record
| CREATOR | Ziyan Wang, Zhicheng Zhang, Fei Fang, Yali Du |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-02077