Transition Transfer Q Q -Learning for Composite Markov Decision Processes
Jinhang ChaiElynn Chen ♯, Lin Yang · 2025
Read Transition Transfer Q Q -Learning for Composite Markov Decision Processes by Jinhang ChaiElynn Chen ♯, Lin Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-00534.txt.
Description
Jinhang Chai, Elynn Chen, and Lin Yang study transfer learning for decision tasks that share most dynamics but differ in sparse spots, in work from twenty twenty-five. In transfer reinforcement learning, a model trained on one task should adapt fast to a kin task. Proof of how well that works has lagged behind practice.
Their frame splits each task's dynamics into a shared low rank part and a sparse task specific part. Their method learns with an optimism rule that reuses the shared part. After enough source task runs, regret on the target task grows far more slowly than single task learning. The bound does not grow with the full state size. The proof shows how shared structure helps while sparse gaps are handled.
Catalog record
| CREATOR | Jinhang ChaiElynn Chen ♯, Lin Yang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-00534