Simple Recipe Works: Vision-Language-Action Models are Natural Continual Learners with Reinforcement Learning
Jiaheng Hu, Jay Shim, Chen Tang, Yoonchang Sung, Bo Liu, Peter Stone, Roberto Martín-Martín · 2026
Read Simple Recipe Works: Vision-Language-Action Models are Natural Continual Learners with Reinforcement Learning by Jiaheng Hu, Jay Shim, Chen Tang, Yoonchang Sung, Bo Liu, Peter Stone, Roberto Martín-Martín (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-11653.txt.
Description
Hu and co-authors test a simple recipe for continual reinforcement learning with vision-language-action models. Common wisdom says sequential fine-tuning causes catastrophic forgetting, so complex methods are needed. Across lifelong RL benchmarks, the team finds the opposite for large pretrained VLAs. Sequential tuning with LoRA stays plastic, forgets little, and keeps zero-shot skill. The robustness comes from a synergy of the big pretrained model, cheap adaptation, and on-policy RL. The result recasts plain sequential tuning as a strong default for lifelong learning.
Catalog record
| CREATOR | Jiaheng Hu, Jay Shim, Chen Tang, Yoonchang Sung, Bo Liu, Peter Stone, Roberto Martín-Martín |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63289 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.11653