IMLE Policy: Fast and Sample Efficient Visuomotor Policy Learning via Implicit Maximum Likelihood Estimation
Krishan Rana ∗ 1 , Robert Lee ∗ , David Pershouse 1 and Niko Sünderhauf 1 · 2025
Read IMLE Policy: Fast and Sample Efficient Visuomotor Policy Learning via Implicit Maximum Likelihood Estimation by Krishan Rana ∗ 1 , Robert Lee ∗ , David Pershouse 1 and Niko Sünderhauf 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-12371.txt.
Introduction
Krishan Rana and co-authors present a robot policy learning method that needs fewer demonstrations, in work from 2025. Imitation learning copies expert actions, and recent generative methods capture complex action patterns well. Those methods often need large datasets and many computing steps per action, which hurts in robotics where data is costly.
Their method is based on implicit maximum likelihood estimation, a training approach that avoids slow sampling. It learns from minimal demonstrations, needing notably less data on average to match rival methods on complex behaviours. Its simple generator design produces each action in a single step, making it far faster at run time than diffusion-based policies. Tests cover manipulation tasks in simulation and on real robots. Code and videos are shared on a project page.
Catalog record
| CREATOR | Krishan Rana ∗ 1 , Robert Lee ∗ , David Pershouse 1 and Niko Sünderhauf 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-12371
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
IMLE Policy: Fast and Sample Efficient Visuomotor Policy Learning via Implicit Maximum Likelihood Estimation Krishan Rana ∗ 1 , Robert Lee ∗ , David Pershouse 1 and Niko Sünderhauf 1 Abstract Recent advances in imitation learning, particularly using generative modelling techniques like diffusion, have enabled policies to capture complex multi-modal action distributions. However, these methods often require large datasets and multiple inference steps for action generation, posing challenges in robotics where the cost for data collection is high and computation resources are limited. To address this, we introduce IMLE Policy, a novel behaviour cloning approach based on Implicit Maximum Likelihood Estimation (IMLE). IMLE Policy excels in low-data regimes, effectively learning from minimal demonstrations and requiring 38% less data on average to match the performance of baseline methods in learning complex multi-modal behaviours. Its simple generator-based architecture enables single-step action generation, improving inference speed by 97.3% compared to Diffusion Policy, while outperforming single-step Flow Matching. We validate our approach across diverse manipulation tasks in simulated and real-world environments, showcasing its ability to capture complex behaviours under data constraints. Videos and code are provided on our project page: imle-policy.github.io/ . I Introduction Learning policies from demonstrations is becoming a key approach for enabling robots to perform complex tasks. At its core, this problem involves mapping observations to actions in a way that captures the nuanced and often multi-modal nature of human behaviour. However, leveraging behaviour cloning for real-world robotics applications presents unique challenges including the ability to learn these highly multi-modal action distributions from limited demonstration data which can be expensive to collect, and the need for computational efficiency to enable real-time operation. Recent advancements in generative modelling, such as diffusion models [ 33 , 9 ] and flow matching [ 19 , 4 ] , have demonstrated promise in capturing complex multi-modal action distributions for behaviour cloning. However, these approaches are computationally expensive during inference, as they require iterative sampling processes to generate actions. Additionally, they often demand large datasets to train performant models effectively. Addressing these challenges is crucial for enhancing the practicality and adoption of behaviour cloning in real-world tasks. Generative Adversarial Networks (GANs) are an alternative approach to generative modelling with efficient single-step inference, but fell out of favour due to their issues with training stability and mode collapse, where parts of the data distribution are ignored, limiting their ability to effectively model complex, multi-modal distributions. To address these shortcomings, Implicit Maximum Likelihood Estimation (IMLE) [ 18 ] was introduced as an alternative training objective for single-step generative models, based on a simple objective that ensures every datapoint is well-represented by at least one generated sample. In essence, IMLE minimises the distance between each data point and its nearest generated sample, guaranteeing comprehensive mode coverage and maintaining stable training, even with smaller datasets. This makes IMLE a compelling alternative to diffusion models for developing efficient and faster behaviour cloning methods suitable for real-world robotics. In this work, we propose IMLE Policy, a novel extension of Implicit Maximum Likelihood Estimation tailored for conditional behaviour cloning. We leverage a particular instantiation of IMLE that utilises rejection sampling in the training objective [ 35 ] , which further improves sample efficiency while effectively enabling the model to sample all possible modes during inference. IMLE Policy offers several key advantages that make it particularly promising for real-world robotic systems: • Expressive multi-modal action distributions: By optimising the policy to generate samples close to every possible data point, IMLE Policy by nature does not drop modes, enabling highly expressive multi-modal action generations for a given state (Figure (Bottom)). • Sample efficiency: IMLE Policy can accurately model complex multi-modal distributions using 38% less data on average than Diffusion Policy and single-step Flow-Matching to achieve similar performance (Figure (Top)). • Fast inference: IMLE Policy can generate multi-modal actions using only a single forward pass – a 97.3% increase in inference speed when compared to vanilla Diffusion Policy without collapsing modes when compared to single step Flow Matching. We evaluate IMLE Policy across diverse simulation benchmarks and multi-modal real-world tasks, demonstrating its effectiveness as an alternative to existing generative model-based behaviour cloning approaches. IMLE Policy meets the critical desiderata for real-world robotics: sample efficiency, computational speed, and expressiveness . (1) IMLE Policy outperforms state-of-the-art baselines in low-data regimes, while matching performance when more data is available , learning performant real-world policies from as few as 17 demonstrations . (2) IMLE Policy captures multi-modal action distributions in a single step , generating diverse trajectories across varying conditions, avoiding mode collapse seen in other single-step methods. (3) IMLE Policy enables fast real-time inference , reducing latency by 97.3% compared to iterative diffusion models while maintaining competitive task success rates. We further analyse sample efficiency, multi-modal expressivity, and key design choices to understand IMLE Policy’s strengths. All code, datasets, and training details will be released to ensure reproducibility and support further research. We provide supplementary videos to demonstrate the real world performance of our system when compared to the baselines. Fig. 2: Qualitative Analysis of Mode Capturing Performance. Illustrating the trajectories generated by different methods (rows) for varying initial end-effector positions (columns) in the Push-T task. The goal is to push the T-shaped block from its initial position to align with the target (green). At the top of the T, the dataset exhibits multi-modal behaviour: in the centre, demonstrations are evenly split between pushing left and right, while towards the edges, the majority of demonstrations push towards the closer side, with only a few moving in the opposite direction. IMLE Policy successfully captures all modes without collapsing or biasing, maintaining trajectory diversity even in underrepresented modes. In contrast, Diffusion Policy tends to bias towards one mode when close to an edge, while Flow Matching collapses modes, producing averaged and unimodal trajectories. II Related Work We organise our discussion of prior work based on three key behaviour cloning desiderata for real-world robotics: capturing multi-modal behaviour, achieving sample efficiency, and enabling fast inference. While existing works address each of these aspects individually, relatively few approaches attempt to satisfy all three simultaneously. II-A Multi-Modality in Behaviour Cloning Behaviour cloning has been widely explored as a means of enabling robots to learn from human demonstrations, achieving success across various manipulation tasks [ 41 , 12 , 25 , 24 , 39 , 29 , 3 , 2 , 1 , 31 , 6 , 8 , 7 , 10 ] . Capturing the multi-modal nature of human demonstrations is a fundamental challenge in behaviour cloning, and generative models have been extensively applied to address this issue. Methods such as Conditional Variational Autoencoders (CVAEs) [ 23 , 42 ] , Energy-Based Models (EBMs) [ 11 ] , and Vector Quantization [ 17 ] have been used to model multi-modal action distributions, though each comes with trade-offs such as mode collapse or complex multi-stage training. Recently, de-noising diffusion models have emerged as a dominant approach due to their stable training dynamics and strong performance in multi-modal imitation learning [ 6 , 8 , 7 , 10 , 20 ] . However, these models require an iterative sampling process during inference, making them computationally expensive. An alternative class of generative models, IMLE (Implicit Maximum Likelihood Estimation),