Task diversity produces systematic transfer but inhibits continual reinforcement learning
Purab Seth, Neil Shah, Kunal Jha, Samuel J. Gershman, Max Kleiman-Weiner, Wilka Carvalho · 2026
Read Task diversity produces systematic transfer but inhibits continual reinforcement learning by Purab Seth, Neil Shah, Kunal Jha, Samuel J. Gershman, Max Kleiman-Weiner, Wilka Carvalho (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00880.txt.
Description
Seth and co-authors ask how task variety shapes agents that keep learning in this 2026 paper. Continual RL aims at agents that never stop adapting. Training on many diverse tasks is known to build strong zero-shot skill. But past work froze the agent's weights before testing.
Their domain, Banyan, runs on GPUs and varies three axes of a task. Map layouts, target objects, and subgoal chains can each be dialed up or down. More diversity gives systematic transfer: agents start each new task near their last score. This holds even when the best policy changes shape. But too much diversity hurts, they find. Learners plateau on new tasks while still improving on old ones, with no fresh play on them. The result is a trade-off at the heart of lifelong learning. Variety builds a springboard and a ceiling.
Catalog record
| CREATOR | Purab Seth, Neil Shah, Kunal Jha, Samuel J. Gershman, Max Kleiman-Weiner, Wilka Carvalho |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.00880