X-IL: Exploring the Design Space of Imitation Learning Policies

Xiaogang Jia, Atalay Donat, Xi Huang, Xuan Zhao, Denis Blessing, Hongyi Zhou, Han A. Wang, Hanyi Zhang, Qian Wang, Rudolf Lioutikov, Gerhard Neumann · 2025

Read X-IL: Exploring the Design Space of Imitation Learning Policies by Xiaogang Jia, Atalay Donat, Xi Huang, Xuan Zhao, Denis Blessing, Hongyi Zhou, Han A. Wang, Hanyi Zhang, Qian Wang, Rudolf Lioutikov, Gerhard Neumann (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-12330.txt.

Introduction

Xiaogang Jia and co-authors present X-IL, an open-source framework for exploring how imitation learning policies for robots should be designed. Building such a policy involves many choices: how to encode sensor input, which network backbone to use, and how to represent the policy itself. As options multiply, the design space grows vast and mostly untested. The framework's modular build lets users swap parts in and out with ease.

Users can exchange backbones such as Transformer, Mamba, and xLSTM, and switch training methods such as score matching and flow matching. Systematic trials with the framework uncover new policy combinations that beat existing methods on recent robot learning benchmarks. The experiments also reveal the strengths and weaknesses of each design choice. The authors offer the study as a practical guide for builders and a base for future research in imitation learning.

Catalog record

CREATORXiaogang Jia, Atalay Donat, Xi Huang, Xuan Zhao, Denis Blessing, Hongyi Zhou, Han A. Wang, Hanyi Zhang, Qian Wang, Rudolf Lioutikov, Gerhard Neumann
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-12330

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

X-IL: Exploring the Design Space of Imitation Learning Policies Xiaogang Jia, Atalay Donat, Xi Huang, Xuan Zhao, Denis Blessing, Hongyi Zhou, Han A. Wang, Hanyi Zhang, Qian Wang, Rudolf Lioutikov, Gerhard Neumann Abstract Designing modern imitation learning (IL) policies requires making numerous decisions, including the selection of feature encoding, architecture, policy representation, and more. As the field rapidly advances, the range of available options continues to grow, creating a vast and largely unexplored design space for IL policies. In this work, we present X-IL , an accessible open-source framework designed to systematically explore this design space. The framework’s modular design enables seamless swapping of policy components, such as backbones (e.g., Transformer, Mamba, xLSTM) and policy optimization techniques (e.g., Score-matching, Flow-matching). This flexibility facilitates comprehensive experimentation and has led to the discovery of novel policy configurations that outperform existing methods on recent robot learning benchmarks. Our experiments demonstrate not only significant performance gains but also provide valuable insights into the strengths and weaknesses of various design choices. This study serves as both a practical reference for practitioners and a foundation for guiding future research in imitation learning. Code available at this link . † † affiliationnotice: \icmlHanStatement 1 Introduction Imitation learning (IL) ( Osa et al., 2018 ) has emerged as a powerful paradigm for teaching agents complex behaviors by mimicking demonstrations, eliminating the need for explicit reward engineering ( Argall et al., 2009 ) . However, the rapid development of novel machine-learning techniques across various domains makes it challenging to assess their potential impact on imitation learning. To address this, we introduce X-IL, a novel framework designed to integrate and explore recently developed techniques within an imitation learning pipeline. Our framework decomposes the imitation learning process into four key modules: (1) observation representations, (2) backbones, (3) architectures, and (4) policy representations. Each module is interchangeable, enabling systematic exploration of the design space for imitation learning policies. This modularity facilitates rapid prototyping, benchmarking, and deployment. Figure 1 provides an overview of our framework. More specifically, we offer various observation representations, including 2D RGB inputs and 3D point cloud representations, to accommodate diverse perception tasks. Our framework incorporates versatile encoders, such as MLPs, ResNet ( He et al., 2015 ) , ViT ( Dosovitskiy et al., 2021 ) , and pre-trained models, which can be tailored to different input types. Furthermore, we offer both Decoder-only and Encoder-Decoder architectures. Decoder-only is simpler with fewer parameters, while Encoder-Decoder supports additional representation learning for better generalization and scaling. We define the backbone as the core computational unit of the policy architecture, offering support for Transformer ( Vaswani et al., 2017 ) , Mamba ( Gu & Dao, 2024 ) , and xLSTM ( Beck et al., 2024 ) . Lastly, we offer several state-of-the-art policy representations including popular diffusion- and flow-based models ( Ho et al., 2020 ; Chi et al., 2023 ; Reuss et al., 2023 ; Lipman et al., 2023 ; Du et al., 2022 ) . Figure 1 : Overview of X-IL framework. X-IL supports multi-modal inputs (Language, RGB, and Point Cloud) and two architectures: Decoder-Only and Encoder-Decoder. Inside each architecture, the Backbone serves as the core computational unit, offering support for Transformer, Mamba, and xLSTM. For policy representations, X-IL supports Behavior Cloning (BC), Diffusion-based, and Flow-based Policies, enabling diverse learning paradigms for imitation learning. Notably, each component—input modality, architecture, backbone, and policy—can be easily swapped to efficiently explore various model configurations. Our contributions can be summarized as follows: 1) We introduce X-IL, a user-friendly and highly modular framework for imitation learning that supports multi-modal inputs, flexible encoders, diverse architectures and policy representations. 2) We leverage our framework to systematically explore the design space of IL policies. In doing so, we obtain novel policy designs that achieve state-of-the-art results on the LIBERO ( Liu et al., 2023 ) and RoboCasa ( Nasiriany et al., 2024 ) benchmarks. 3) Our extensive experiments yield valuable insights, such as the potential of recent sequence models as strong alternatives to Transformers, or, that fusing different input modalities can lead to significant performance improvements. Our work is organized as follows. In Section 2 , we review related work. Section 3 describes the proposed framework, detailing design choices and its modular components. In Section 4 , we provide experimental evaluations across multiple benchmarks, followed by a discussion of results and observations in Section 5 . 2 Related Work Multi-modal Imitation Learning. Early imitation learning methods relied on either state ( Schaal, 1996 ; Ho & Ermon, 2016 ; Torabi et al., 2018 ) or images ( Pomerleau, 1988 ; Lynch et al., 2020 ; Young et al., 2021 ) to describe the environment and define the goal. However, obtaining accurate state information in real-world setting is not straightforward, and state-based representation struggles to capture the complexity of unstructured environments. Conversely, images provide a rich representation for behavior learning ( Mandlekar et al., 2021 ) and can be directly acquired from raw sensory input. Despite these advantages, using images as goal conditions in imitation learning is limited by their ambiguity in goal representation and difficulty in goal specification, making them less flexible for real-world deployment. To address this, natural language has been explored as an alternative goal representation, offering a more intuitive and accessible way to specify tasks. Recent studies ( Shridhar et al., 2022 ; Reuss et al., 2024b ; Bharadhwaj et al., 2024 ) have explored the integration of language goals with image observation, enabling more flexible policy learning. Another line of research fine-tunes Vision-Language Models (VLMs) models to obtain Vision-Language Action Models (VLAs) ( Kim et al., 2024 ; Li et al., 2023 ; Li et al., 2024 ) . However, purely image-based representation lack crucial 3D structural information, which is essential for many tasks. Therefore, there is a recent trend on incorporating richer 3D scene presentations, such as point clouds, to enhance policy performance ( Ke et al., 2024 ; Ze et al., 2024a ) . Imitation Learning with Sequence Models. In recent years, sequence models have been increasingly applied to learning human behaviors, as human decision-making is inherently non-Markov and requires incorporating historical observations ( Mandlekar et al., 2021 ) . Early works utilized RNN-based structures ( Mandlekar et al., 2021 ) . However, these models suffers from vanish gradient for handling long observation sequence and low training efficient due to the sequential processing nature. To address this limitation, Transformer-based architectures have been widely adopted ( Shafiullah et al., 2022a ; Reuss et al., 2023 ; Bharadhwaj et al., 2024 ) , offering superior scalability and sequence modeling capabilities. Most recently, State-Space Models(SSM) ( Gu & Dao, 2024 ; Jia et al., 2024 ) have emerged as a promising alternative to Transformers, demonstrating remarkable efficiency on small datasets and the ability to learn consistent representation. Additionally, improved RNN-based architectures, such as xLSTM ( Beck et al., 2024 ) , have shown potential to rival both Transformer and SSMs in natural language processing. However, their application in imitation learning remains largely unexplored. X-IL aims to bridge this gap by incorporating Transformers, Mamba, and xLSTM as modular components and empirically evaluating their performance under different tasks and representations. Modular Imitation Learning Libraries. While numerous open-source libraries

Read the complete text