Transition Transfer Q Q -Learning for Composite Markov Decision Processes

Jinhang ChaiElynn Chen ♯, Lin Yang · 2025

Read Transition Transfer Q Q -Learning for Composite Markov Decision Processes by Jinhang ChaiElynn Chen ♯, Lin Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-00534.txt.

Description

Jinhang Chai, Elynn Chen, and Lin Yang study transfer learning for decision tasks that share most dynamics but differ in sparse spots, in work from twenty twenty-five. In transfer reinforcement learning, a model trained on one task should adapt fast to a kin task. Proof of how well that works has lagged behind practice.

Their frame splits each task's dynamics into a shared low rank part and a sparse task specific part. Their method learns with an optimism rule that reuses the shared part. After enough source task runs, regret on the target task grows far more slowly than single task learning. The bound does not grow with the full state size. The proof shows how shared structure helps while sparse gaps are handled.

Catalog record

CREATORJinhang ChaiElynn Chen ♯, Lin Yang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-00534

Browse the full library · About the Tower of Babel