Personalized Multi-Agent Average Reward TD-Learning via Joint Linear Approximation

Leo Muxing Wang, Pengkun Yang, Lili Su · 2026

Read Personalized Multi-Agent Average Reward TD-Learning via Joint Linear Approximation by Leo Muxing Wang, Pengkun Yang, Lili Su (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-02426.txt.

Description

Leo Muxing Wang, Pengkun Yang, and Lili Su study cooperative learning across agents in this 2026 paper. Each agent faces its own environment and learns its own value function. A shared linear representation links them, with personal weights lying in one unknown subspace. Borrowing from personalized federated learning, agents jointly estimate that subspace and their local parts.

The single-timescale method runs all updates together, without nested loops. Splitting shared and personal parts filters out conflicting signals between agents. Misaligned signals otherwise drag learning in wrong directions. The analysis proves a linear speedup from cooperation. Challenges include agent differences, Markovian sampling, and tightly coupled error dynamics. Experiments on a broader control problem confirm the shared-structure gains.

Catalog record

CREATORLeo Muxing Wang, Pengkun Yang, Lili Su
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE236356
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.02426

Browse the full library · About the Tower of Babel