Personalized Multi-Agent Average Reward TD-Learning via Joint Linear Approximation
Leo Muxing Wang, Pengkun Yang, Lili Su · 2026
Read Personalized Multi-Agent Average Reward TD-Learning via Joint Linear Approximation by Leo Muxing Wang, Pengkun Yang, Lili Su (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-02426.txt.
Description
Leo Muxing Wang, Pengkun Yang, and Lili Su study cooperative learning across agents in this 2026 paper. Each agent faces its own environment and learns its own value function. A shared linear representation links them, with personal weights lying in one unknown subspace. Borrowing from personalized federated learning, agents jointly estimate that subspace and their local parts.
The single-timescale method runs all updates together, without nested loops. Splitting shared and personal parts filters out conflicting signals between agents. Misaligned signals otherwise drag learning in wrong directions. The analysis proves a linear speedup from cooperation. Challenges include agent differences, Markovian sampling, and tightly coupled error dynamics. Experiments on a broader control problem confirm the shared-structure gains.
Catalog record
| CREATOR | Leo Muxing Wang, Pengkun Yang, Lili Su |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 236356 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.02426