World Action Models Enable Continual Imitation Learning with Recurrent Generative Replays
Manish Kumar Govind, Dominick Reilly, Smit Patel, Hieu Le, Srijan Das · 2026
Read World Action Models Enable Continual Imitation Learning with Recurrent Generative Replays by Manish Kumar Govind, Dominick Reilly, Smit Patel, Hieu Le, Srijan Das (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-27374.txt.
Introduction
Govind leads a team teaching robots new skills without erasing old ones, using the robot's own world model as its memory. World action models predict both actions and future images, so they can imagine past tasks. Their Recurrent Generative Replay framework queries the model to synthesise practice runs for earlier tasks. In their 2026 robotics paper, continual imitation learning then mixes real new data with imagined old data.
Experiments span simulation and real-world manipulation. Catastrophic forgetting drops by up to fifty percent relative to sequential fine-tuning in the reported comparisons. Performance approaches privileged replay methods that keep real demonstration data. Two bottlenecks limit the generated replay: long-horizon visual decay and inconsistency between actions and observations. Robots that imagine their past can keep learning their future. Stored-demonstration-free continual learning becomes a credible route.
Catalog record
| CREATOR | Manish Kumar Govind, Dominick Reilly, Smit Patel, Hieu Le, Srijan Das |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.27374
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
World Action Models Enable Continual Imitation Learning with Recurrent Generative Replays Manish Kumar Govind, Dominick Reilly, Smit Patel, Hieu Le, Srijan Das Abstract Going beyond predicting robot actions, World Action Models (WAMs) can also generate future visual observations. We build on this generative capability to propose Recurrent Generative Replay ( ReGen ), a continual imitation learning framework that synthesizes pseudo-replay trajectories, enabling a robot policy to rehearse previously learned tasks without storing their original human demonstrations. During continual adaptation, ReGen recursively queries the WAM to synthesize pseudo-replay trajectories conditioned only on prior task instructions and current-task observations. Experiments in both simulation and real-world manipulation settings show that ReGen reduces catastrophic forgetting by up to 50 % 50\% relative to sequential fine-tuning, while approaching the performance of privileged experience replay methods that require access to real replay data. Finally, we analyze the factors limiting generated replay, identifying long-horizon visual degradation and action-observation inconsistency as the primary bottlenecks. Our results establish WAMs as a promising foundation for continual robot learning without stored demonstrations. Keywords: Continual Imitation Learning, World Action Model, Generative Replay, Robot Control “A robot that can imagine its past can continue learning its future.” 1 Introduction Recently, World Action Models (WAMs) have emerged as a promising paradigm for robot imitation learning by unifying perception , prediction , and control within a single generative framework [ 43 , 17 , 21 , 42 ] . As WAMs become general-purpose robot policies, continual adaptation to new tasks becomes inevitable. Yet, like other learned policies, they suffer from catastrophic forgetting when fine-tuned sequentially [ 9 , 26 , 35 ] . This raises a key question: can the same generative capabilities that make WAMs powerful also serve as a mechanism for retaining previously learned skills? Existing approaches for mitigating catastrophic forgetting span two generations of robot policies: conventional visuomotor policies [ 6 , 47 ] and more recent Vision-Language-Action (VLA) models [ 18 , 2 , 15 ] . Across both paradigms, experience replay has emerged as the dominant continual learning strategy, where demonstrations from previous tasks are stored and replayed during adaptation to new tasks [ 22 , 50 , 40 , 24 , 41 ] . While highly effective, these approaches fundamentally rely on access to ground-truth demonstrations from prior tasks. This assumption is becoming increasingly impractical in modern robot learning. Earlier progress in robotics was driven by open datasets of robot demonstrations [ 7 , 3 , 38 ] , whereas the emerging paradigm is centered around pretrained robot foundation models trained on large-scale proprietary datasets that are rarely released publicly [ 2 , 15 , 43 ] . Consequently, what we desire for continual learning is a replay mechanism that does not depend on access to true demonstrations from previous tasks. WAMs are uniquely positioned to address exactly this challenge. By jointly modeling actions together with future visual observations of the scene [ 43 , 17 , 21 , 42 ] , WAMs expose a generative interface capable of synthesizing trajectories for previously learned tasks conditioned only on their language instructions and current observations. In this work, we leverage this property to enable continual imitation learning without access to any real demonstrations from previous tasks as shown in Figure 1 . Figure 1: Overview of ReGen . Sequential fine-tuning of WAMs leads to catastrophic forgetting (top) . ReGen leverages the WAM’s generative capabilities to hallucinate pseudo-demonstrations of previously learned tasks, replaying them alongside new task data to mitigate forgetting without storing any prior-task demonstrations. (bottom) . Consequently, we propose Re current Gen erative Replay ( ReGen ), the first continual learning framework that leverages the WAM itself as a native generative replay mechanism. When adapting to a new task, ReGen generates pseudo-demonstrations for previous tasks by conditioning the WAM on prior task instructions and initial visual observations, then recurrently feeding back its own generated future observations. This yields completed synthetic trajectories of previous tasks. These pseudo-demonstrations are then combined with the new-task demonstrations during fine-tuning to substantially mitigate catastrophic forgetting without requiring human-collected demonstrations of past tasks. We evaluate ReGen in both simulated [ 22 ] and real-world environments, where it reduces forgetting by over 50\% relative to naive sequential fine-tuning and approaches the performance of experience replay methods that rely on privileged access to human-collected demonstrations from previous tasks. Critically, our analysis reveals that the effectiveness of ReGen is fundamentally tied to two key limitations of current WAMs: (i) degradation in the visual fidelity of future observations during long-horizon recurrent generation, and (ii) inconsistencies between predicted future observations and the corresponding generated actions. These findings indicate that, while ReGen is not yet a complete substitute for real replay, the remaining performance gap is primarily governed by the generative limitations of WAMs themselves. Consequently, improving the fidelity and consistency of WAM generation represents a key direction for closing the gap between pseudo-replay and real experience replay. We summarize our contributions as follows: • We propose Recurrent Generative Replay , the first replay-based continual imitation learning framework that leverages the generative capabilities of WAMs to synthesize replay trajectories without storing real demonstrations from previous tasks. • We demonstrate that ReGen substantially mitigates catastrophic forgetting in both simulated and real-world manipulation settings while preserving strong forward transfer. • We identify the primary limitations preventing generated replay from matching real experience replay, namely long-horizon degradation in visual generation and inconsistencies between predicted observations and actions, highlighting key future directions for WAMs. 2 Related Work Continual Imitation Learning. Continual learning aims to acquire a sequence of tasks without catastrophically forgetting previously learned skills [ 9 ] . Existing approaches fall into three categories: regularization-based methods that constrain weight updates [ 19 , 46 ] , rehearsal-based methods that retain real samples from prior tasks [ 5 ] , and architecture-based methods that allocate task-specific parameters [ 27 , 33 ] . Prior work [ 22 ] adapts these to lifelong robot manipulation, and recent methods extend them with skill discovery, knowledge-distillation, or task-specific adapters combined with replay [ 40 , 32 , 25 , 31 ] ; a parallel line of work develops continual learning frameworks for VLAs which also replay [ 41 , 23 , 24 ] . Across this line of work, forgetting is mitigated by storing real demonstrations, regularizing weights, or partitioning parameters. ReGen is orthogonal: rather than maintaining a growing buffer of real trajectories, it leverages the world-action model itself to simulate past tasks, providing replay examples without retaining any real demonstrations. Generative Replay Unlike replay-based methods, generative replay synthesizes pseudo-samples for rehearsal [ 36 ] . In robotics, CRIL [ 10 ] , t-DGR [ 45 ] , and [ 29 ] train generative models on past data to prevent forgetting. In contrast, ReGen generates trajectories from current task data to facilitate continual learning. ReGen shares this current-data insight but targets continual imitation learning. By leveraging a unified world-action model [ 17 ] for both action and future-frame prediction, ReGen avoids model-based planning and eliminates the need for separate dynamics models. World Models for robot control World models learn predictive representations of environment dynamics, originally proposed for sample-efficient reinforcement learning (RL) [ 11 ] and popularized by the