Task diversity produces systematic transfer but inhibits continual reinforcement learning

Purab Seth, Neil Shah, Kunal Jha, Samuel J. Gershman, Max Kleiman-Weiner, Wilka Carvalho · 2026

Read Task diversity produces systematic transfer but inhibits continual reinforcement learning by Purab Seth, Neil Shah, Kunal Jha, Samuel J. Gershman, Max Kleiman-Weiner, Wilka Carvalho (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00880.txt.

Description

Seth and co-authors ask how task variety shapes agents that keep learning in this 2026 paper. Continual RL aims at agents that never stop adapting. Training on many diverse tasks is known to build strong zero-shot skill. But past work froze the agent's weights before testing.

Their domain, Banyan, runs on GPUs and varies three axes of a task. Map layouts, target objects, and subgoal chains can each be dialed up or down. More diversity gives systematic transfer: agents start each new task near their last score. This holds even when the best policy changes shape. But too much diversity hurts, they find. Learners plateau on new tasks while still improving on old ones, with no fresh play on them. The result is a trade-off at the heart of lifelong learning. Variety builds a springboard and a ceiling.

Catalog record

CREATORPurab Seth, Neil Shah, Kunal Jha, Samuel J. Gershman, Max Kleiman-Weiner, Wilka Carvalho
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.00880

Browse the full library · About the Tower of Babel