M 3 ​ HF \text{M}^{3}\text{HF} : Multi-agent Reinforcement Learning from Multi-phase Human Feedback of Mixed Quality

Ziyan Wang, Zhicheng Zhang, Fei Fang, Yali Du · 2025

Read M 3 ​ HF \text{M}^{3}\text{HF} : Multi-agent Reinforcement Learning from Multi-phase Human Feedback of Mixed Quality by Ziyan Wang, Zhicheng Zhang, Fei Fang, Yali Du (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-02077.txt.

Description

Ziyan Wang and co-authors introduce a 2025 framework that trains teams of learning agents with human feedback of mixed quality. Setting good reward rules for many agents at once is hard, and bad rules breed misaligned team behavior. Their method brings people of unlike skill into training at several phases to guide the agents as they learn.

Training pauses at set points for human review. A large language model helps sort the feedback and assign it to the right agents, and reward rules update through templates with weights that decay or shift with performance. Both expert and non expert voices are folded in rather than filtered out. In hard test settings, the method beat leading rivals, and the authors argue broader human input makes team behavior easier to read and more robust.

Catalog record

CREATORZiyan Wang, Zhicheng Zhang, Fei Fang, Yali Du
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-02077

Browse the full library · About the Tower of Babel