SPREAD: Subspace Representation Distillation for Lifelong Imitation Learning

Kaushik Roy, Giovanni D’urso, Nicholas Lawrance, Brendan Tidd, Peyman Moghadam · 2026

Read SPREAD: Subspace Representation Distillation for Lifelong Imitation Learning by Kaushik Roy, Giovanni D’urso, Nicholas Lawrance, Brendan Tidd, Peyman Moghadam (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08763.txt.

Introduction

Kaushik Roy and colleagues keep lifelong imitation learners from forgetting old skills as new ones arrive. Raw feature matching is noise-sensitive and drops the low-dimensional shapes behind tasks. Their SPREAD frame aligns policy features inside low-rank subspaces via SVD, adds a confidence-guided loss on the surest action samples, and tops the LIBERO benchmark.

Catalog record

CREATORKaushik Roy, Giovanni D’urso, Nicholas Lawrance, Brendan Tidd, Peyman Moghadam
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38254
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.08763

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SPREAD: Subspace Representation Distillation for Lifelong Imitation Learning Kaushik Roy, Giovanni D’urso, Nicholas Lawrance, Brendan Tidd, Peyman Moghadam Abstract A key challenge in lifelong imitation learning (LIL) is enabling agents to acquire new skills from expert demonstrations while retaining prior knowledge. This requires preserving the low-dimensional manifolds and geometric structures that underlie task representations across sequential learning. Existing distillation methods, which rely on L 2 L_{2} -norm feature matching in raw feature space, are sensitive to noise and high-dimensional variability, often failing to preserve intrinsic task manifolds. To address this, we introduce S ​ P ​ R ​ E ​ A ​ D SPREAD , a geometry-preserving framework that employs singular value decomposition (SVD) to align policy representations across tasks within low-rank subspaces. This alignment maintains the underlying geometry of multimodal features, facilitating stable transfer, robustness, and generalization. Additionally, we propose a confidence-guided distillation strategy that applies a Kullback–Leibler divergence loss restricted to the top- M M most confident action samples, emphasizing reliable modes and improving optimization stability. Experiments on the LIBERO, lifelong imitation learning benchmark, show that S ​ P ​ R ​ E ​ A ​ D SPREAD substantially improves knowledge transfer, mitigates catastrophic forgetting, and achieves state-of-the-art performance. † † 1 CSIRO Robotics, DATA61, CSIRO, Australia. E-mails: firstname.lastname @csiro.au † † 2 Queensland University of Technology (QUT), Brisbane, Australia. E-mails: firstname.lastname @qut.edu.au Fig. 1 : Geometrical interpretation of the Subspace Representation Distillation loss. SPREAD maximizes similarity between consecutive LIL policies by minimizing discrepancies in projected feature representations across different input modalities within each policy’s subspace. I Introduction Robotic agents are increasingly required to operate in open-world environments where new tasks arise sequentially and previously acquired skills must be retained over long horizons. While imitation learning [ 15 , 27 , 3 , 30 , 33 ] has demonstrated strong performance in teaching robots complex behaviors from demonstrations, its standard formulations assume a fixed task distribution and thus fail under continual task acquisition. When exposed to sequential learning, policy networks suffer from catastrophic forgetting [ 17 , 8 ] , where adapting to new demonstrations degrades representations required for prior skills. Addressing this challenge is central to enabling scalable and reliable lifelong imitation learning. A variety of strategies have been proposed to alleviate catastrophic forgetting in lifelong imitation learning. Experience Replay (ER) [ 4 ] addresses forgetting by replaying samples from previous tasks, but imbalanced data distributions often shift the representation space toward the current task, degrading performance on earlier tasks. Hierarchical skill learning methods such as LOTUS [ 32 ] enhance scalability through a dynamic skill library, but remain vulnerable to degradation of past knowledge. Distillation-based approaches, such as M2Distill [ 24 ] , transfer multimodal knowledge between policies; however, their reliance on L_{2} feature alignment in raw feature space neglects the underlying geometric structure of task representations. This limitation can lead to overly rigid alignment that impedes adaptation. These shortcomings highlight the need for subspace-preserving, geometry-aware distillation strategies to enable robust and scalable lifelong imitation learning. Fig. 2 : Overview of our proposed SPREAD method. Subspace Representation Distillation aligns the latent representations from different input modality encoders ( e.g. , Task, AgentView, HandEye, Joint, and Gripper information), while confidence-guided policy distillation maps the action distribution of the GMM policy between incremental steps T^{k-1} and T^{k} . To this end, we propose SPREAD , a lifelong imitation learning framework that explicitly aligns the low-rank subspace representations of consecutive policies. By enforcing consistency in how features are projected onto dominant subspaces, our approach preserves the intrinsic directions that define task manifolds while leaving orthogonal directions available for novel skill acquisition (see Fig. 1 ). The motivation for subspace alignment arises from the observation that neural representations are often concentrated in low-dimensional subspaces within high-dimensional feature spaces. Prior work in representation learning has demonstrated that these subspaces capture the most discriminative and transferable structure of task-relevant features [ 26 ] , while also exhibiting robustness to noise [ 5 ] . Leveraging this property allows SPREAD to distill knowledge more effectively, avoiding over-constraining raw activations while maintaining the geometry critical for skill retention. This geometry-aware distillation provides a principled balance between stability and plasticity: the representational essence of past tasks is retained, yet sufficient capacity remains to encode new skills without interference. Complementing this, our confidence-guided policy distillation applies Kullback-Leibler (KL) divergence [ 18 ] to top- K action samples, ensuring robust behavioral transfer. We evaluate SPREAD on diverse robotic manipulation benchmarks under sequential learning settings. Results show that SPREAD significantly outperforms conventional feature-level distillation and state-of-the-art lifelong imitation learning baselines. Beyond quantitative gains, our analysis reveals that SPREAD maintains the intrinsic manifold structure of task features, thereby yielding more robust transfer and retention across tasks. In summary, this work makes the following contributions: • We introduce SPREAD , a novel framework that preserves the low-dimensional subspace geometry of task features in lifelong imitation learning. We provide theoretical justification for why subspace-level alignment better preserves intrinsic task manifolds compared to feature-level distillation. • We present a confidence-guided policy distillation strategy, using KL divergence on top- K actions to enhance behavioral robustness. • We demonstrate through extensive experiments that SPREAD achieves state-of-the-art performance in mitigating catastrophic forgetting, while enabling efficient adaptation to new robotic skills. II Related Work Imitation learning (IL) enables robots to replicate expert behaviors by mapping observations to actions [ 15 , 27 , 3 , 16 ] . Extending IL to sequential settings, Lifelong Imitation Learning (LIL) aims to continuously acquire new skills while retaining past ones, thereby addressing catastrophic forgetting [ 8 , 17 ] . Existing LIL approaches draw inspiration from lifelong learning in vision [ 29 , 20 ] and language [ 14 ] , adapting regularization [ 1 , 25 ] , memory-replay [ 22 , 23 , 17 , 9 ] , and dynamic architecture [ 35 , 6 ] based strategies to mitigate catastrophic forgetting. Experience Replay (ER) [ 4 ] retains a limited subset of trajectories from past tasks and replays them alongside new demonstrations, but imbalanced replay distributions can bias the learned policy toward more recent skills. Similarly, CRIL [ 9 ] leverages deep generative replay (DGR) [ 28 ] to generate pseudo-demonstrations through action-conditioned video prediction, however, the instability and inaccuracy of generated videos degrade performance on complex LIL tasks. EWC [ 17 ] uses a Fisher information-based measure to constrain updates on parameters essential for earlier tasks to balance plasticity and stability, but struggles to maintain consistent performance in LIL. By decomposing complex behaviors into modular skills, BUDS [ 37 ] enables effective skill reuse through autonomous segmentation of demonstration trajectories. LOTUS [ 32 ] advances this paradigm by coupling unsupervised skill discovery with open-vocabulary vision models to build a continually expanding skill library. Despite their scalability benefits, both BUDS and LOTUS face challenges in maintaining efficiency and representational consistency as the skill library scales. Tokenization-based frameworks such as T2S [ 36 ] introduce parameter-efficient skill tokens that extend transformer architectures without uncontrolled parameter growth, while SPECI [ 34 ] adopts a prompt-driven skill codebook for efficient skill reuse and adaptation. These approaches improve scalability but often depend on strong architectural assumptions. Knowledge distillation strategies like

Read the complete text