HumanoidMimicGen: Data Generation for Loco-Manipulation via Whole-Body Planning
Kevin Lin 1,2,∗ , Ajay Mandlekar 1,∗ , Caelan Reed Garrett 1,∗ , Nikita Chernyadev 1 , Yu Fang 1 , Runyu Ding 1 , Yuqi Xie 1 , Justin Tran 1 , Linxi Fan 1,† , Yuke Zhu 1,2,† 1 NVIDIA 2 The University of Texas at Austin ∗ Equal contribution † Project leads https://humanoidmimicgen.github.io/ · 2026
Read HumanoidMimicGen: Data Generation for Loco-Manipulation via Whole-Body Planning by Kevin Lin 1,2,∗ , Ajay Mandlekar 1,∗ , Caelan Reed Garrett 1,∗ , Nikita Chernyadev 1 , Yu Fang 1 , Runyu Ding 1 , Yuqi Xie 1 , Justin Tran 1 , Linxi Fan 1,† , Yuke Zhu 1,2,† 1 NVIDIA 2 The University of Texas at Austin ∗ Equal contribution † Project leads https://humanoidmimicgen.github.io/ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27724.txt.
Introduction
Kevin Lin and colleagues generate humanoid loco-manipulation data with whole-body planning instead of teleoperation. Their HumanoidMimicGen transfers contact-rich whole-body skills from a few source demonstrations to new object poses, interleaved with locomotion and manipulation planning. Whole-body visuomotor policies co-trained on the generated data beat real-data-only policies by 20 percent on a nine-task benchmark.
Catalog record
| CREATOR | Kevin Lin 1,2,∗ , Ajay Mandlekar 1,∗ , Caelan Reed Garrett 1,∗ , Nikita Chernyadev 1 , Yu Fang 1 , Runyu Ding 1 , Yuqi Xie 1 , Justin Tran 1 , Linxi Fan 1,† , Yuke Zhu 1,2,† 1 NVIDIA 2 The University of Texas at Austin ∗ Equal contribution † Project leads https://humanoidmimicgen.github.io/ |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50176 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.27724
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
HumanoidMimicGen: Data Generation for Loco-Manipulation via Whole-Body Planning Kevin Lin 1,2,∗ , Ajay Mandlekar 1,∗ , Caelan Reed Garrett 1,∗ , Nikita Chernyadev 1 , Yu Fang 1 , Runyu Ding 1 , Yuqi Xie 1 , Justin Tran 1 , Linxi Fan 1,† , Yuke Zhu 1,2,† 1 NVIDIA 2 The University of Texas at Austin ∗ Equal contribution † Project leads https://humanoidmimicgen.github.io/ Abstract Imitation learning is a promising approach for training humanoid robots to both walk and manipulate, but it requires a large number of demonstrations, which are time-intensive and difficult to collect via teleoperation. Existing data-generation algorithms can automatically synthesize demonstrations for manipulators, but they are ineffective on humanoids because their high-dimensional composite action spaces involve arms, legs, and torsos. We present HumanoidMimicGen, a method for generating humanoid legged loco-manipulation data. Our method adapts contact-rich whole-body skills from a handful of source demonstrations to new states, generalizing across changes in object pose. By interleaving these single- and dual-arm skills with whole-body locomotion and manipulation planning, the method generates stable, collision-free data across diverse scenes and layouts. To evaluate our approach, we introduce a new simulated loco-manipulation benchmark containing nine diverse tasks that test humanoid loco-manipulation capabilities. There, we demonstrate that HumanoidMimicGen automatically generates large datasets for imitation learning and enables a systematic study of how data generation and policy learning decisions impact model performance. We show that whole-body visuomotor policies co-trained with data generated by HumanoidMimicGen outperform those trained only on real-world data by 20% . \abscontent 1 Introduction Vision-Language-Action (VLA) models [ 6 , 7 ] , trained on large robotic manipulation datasets, have recently demonstrated a remarkable capability to enable robots to autonomously complete a wide range of manipulation tasks. However, this paradigm has largely been demonstrated in stationary robot manipulation settings, where the robot does not need to walk around in its workspace. This contrasts with the promise of humanoid robots: their human-like form factor should enable them to move and interact fluidly with environments designed for humans. However, applying the VLA paradigm to humanoid loco-manipulation remains challenging due to two key difficulties. First, VLAs require large-scale manipulation datasets to develop their capabilities. Sourcing these datasets for even stationary manipulation settings remains a challenging endeavor due to the persistent human time and effort required. The data collection process typically involves robot teleoperation, where teams of human operators control fleets of robots to collect datasets over months [ 17 , 9 , 44 , 32 ] . Second, intelligently controlling a humanoid is a difficult problem due to its high degrees of freedom and the need to balance itself during simultaneous manipulation and locomotion. Consequently, large-scale loco-manipulation datasets are not readily available, making VLA training prohibitive. Simulation and synthetic data generation offer a compelling means to address the challenge of sourcing large-scale datasets for training VLAs. Automated data generation tools [ 40 , 14 ] allow for generating large volumes of data, and furthermore, recent results have shown that these synthetic datasets can train real-world manipulation policies [ 38 , 53 , 12 , 23 ] . Furthermore, such tools can enable studies into how data quality and policy learning decisions can impact model performance [ 41 , 46 ] . This kind of systematic investigation is needed for the loco-manipulation setting due to the lack of available datasets and the difficulty of evaluating VLA models in the real world [ 3 ] . To address this, we present HumanoidMimicGen, a method for humanoid legged loco-manipulation demonstration generation. HumanoidMimicGen interleaves locomotion planning, arm planning, and skill demonstration adaptation to generate loco-manipulation demonstrations in new scenes (see Fig. 1 ). We propose a hybrid control space for humanoids, where legs are controlled by a reinforcement-learned policy and, in turn, adopt a decoupled approach that factors planning into lower- and upper-body motion, corresponding to segments that require dynamic and static stability. To study data quality and policy training questions in the setting of loco-manipulation, we introduce a new simulation benchmark of humanoid factory tasks. We show that HumanoidMimicGen can generate high-quality data and train performant policies in this setting. Finally, we demonstrate that generating large simulation datasets with HumanoidMimicGen enables sim-and-real co-training for sample-efficient deployment on real-world humanoids. The contributions of this paper are: HumanoidMimicGen: a data generation method for humanoids that uses whole-body skill planning to synthesize loco-manipulation demonstrations from a few human demonstrations. G1 loco-manipulation benchmark: a new nine-task simulation benchmark suite of G1 humanoid loco-manipulation tasks, enabling reproducible comparison across methods. Humanoid policy learning analysis: experiments on this benchmark that study the effect of randomization types, data-generation algorithms, and model architectures on policy success rates. Sim-and-real co-training: real-world results demonstrating that policies co-trained on real-world data and data generated by HumanoidMimicGen outperform policies trained only on real-world data by 20\% . Figure 1 : HumanoidMimicGen Overview. We present HumanoidMimicGen, a method for humanoid legged loco-manipulation demonstration generation. Left : a human teleoperator collects a loco-manipulation task demonstration. Center : HumanoidMimicGen generates thousands of demonstrations across scene and object layouts by adapting local segments of the human demonstration via whole-body planning and control. Right : these demonstrations train performant loco-manipulation policies in simulation and real-world settings. 2 Related Work Automated Data Generation. MimicGen [ 40 ] introduced a data generation method for generating large-scale datasets by adapting a small set of expert demonstrations to new object poses. This method has been extended to support stationary bimanual dexterous manipulation [ 30 ] and incorporate planning and optimization techniques [ 20 , 55 , 34 ] and Reinforcement Learning (RL) [ 57 ] to improve data quality. MoMaGen [ 33 ] applied planning and skill adaptation [ 20 ] to mobile manipulation and incorporated soft visibility constraints to aid visuomotor policy learning. WBCMimicGen [ 35 ] also addressed mobile manipulation, but focused on a quadratic programming approach to improving its tracking controller. Task and Motion Planning (TAMP) [ 19 ] algorithms have been used for data generation [ 42 , 14 , 39 ] ; but, they require a planning model, which is prohibitive for contact-rich tasks. These approaches all rely on the assumption of stable and independent end-effector control per limb, which does not transfer to legged humanoids, where careful whole-body coordination is required during both locomotion and manipulation. Learning Manipulation from Demonstrations. Behavior Cloning (BC) [ 45 , 47 , 28 , 41 , 13 ] is a key method for training policies from demonstrations via supervised learning. Though this method has proven to be effective for robot manipulation [ 5 , 11 , 7 , 32 , 8 , 6 ] , its success relies on having large-scale high-quality datasets to learn from. Recent evidence has shown that simulation datasets can supplement or replace real-world human demonstrations to produce high-performing real-world manipulation policies [ 38 , 53 , 6 , 12 , 51 , 56 , 23 ] . Here, we use sim-and-real co-training to train real-world policies. Loco-Manipulation. Planning and control for humanoid loco-manipulation predates recent learning systems. Early work studied manipulating objects while walking and integrating dynamic walking with whole-body motion planning [ 16 , 15 ] . Other lines formulated humanoid manipulation as multimodal or whole-body planning, including mode-switching manipulation tasks