Collaborative Yet Personalized Policy Training: Single-Timescale Federated Actor-Critic

Leo Muxing Wang, Pengkun Yang, Lili Su · 2026

Read Collaborative Yet Personalized Policy Training: Single-Timescale Federated Actor-Critic by Leo Muxing Wang, Pengkun Yang, Lili Su (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14423.txt.

Introduction

Wang, Yang and Su study federated actor-critic training where agents share a common linear subspace representation but keep personalised local policy parts. Agents iteratively estimate the shared subspace, local critic heads, and local policies. Under single-timescale updates with Markovian sampling, finite-time convergence is proved via a joint linear approximation framework. Critic error and policy gradient norms are shown to converge to zero, with linear speedup in the number of agents despite heterogeneous trajectories.

Catalog record

CREATORLeo Muxing Wang, Pengkun Yang, Lili Su
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE351729
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.14423

Browse the full library · About the Tower of Babel