Opening the Sim-to-Real Door for Humanoid Pixel-to-Action Policy Transfer

Haoru Xue 1,2∗ , Tairan He 1,3∗ , Zi Wang 1∗ , Qingwei Ben 1,4 , Wenli Xiao 1,3 , Zhengyi Luo 1 , Xingye Da 1 , Fernando Castañeda 1 , Guanya Shi 3 , Shankar Sastry 2 , Linxi “Jim” Fan 1† , Yuke Zhu 1† 1 NVIDIA 2 UC Berkeley 3 CMU 4 CUHK ∗ Equal Contribution † Project Leads · 2025

Read Opening the Sim-to-Real Door for Humanoid Pixel-to-Action Policy Transfer by Haoru Xue 1,2∗ , Tairan He 1,3∗ , Zi Wang 1∗ , Qingwei Ben 1,4 , Wenli Xiao 1,3 , Zhengyi Luo 1 , Xingye Da 1 , Fernando Castañeda 1 , Guanya Shi 3 , Shankar Sastry 2 , Linxi “Jim” Fan 1† , Yuke Zhu 1† 1 NVIDIA 2 UC Berkeley 3 CMU 4 CUHK ∗ Equal Contribution † Project Leads (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-01061.txt.

Introduction

Haoru Xue and a large team from NVIDIA and universities open a path from simulation to real humanoid robots in a 2025 paper. Modern GPU simulators can render photorealistic worlds and randomize physics and visuals at scale. Policies trained there can generalize beyond tidy lab settings.

The team builds a teacher-student-bootstrap learning framework for vision-based humanoid loco-manipulation. Their test case is articulated-object interaction, like opening hinged or jointed objects while moving. A strong teacher guides a student that sees only pixels, and bootstrapping improves both. Success would let humanoids learn skills in simulation that still work on real hardware.

Catalog record

CREATORHaoru Xue 1,2∗ , Tairan He 1,3∗ , Zi Wang 1∗ , Qingwei Ben 1,4 , Wenli Xiao 1,3 , Zhengyi Luo 1 , Xingye Da 1 , Fernando Castañeda 1 , Guanya Shi 3 , Shankar Sastry 2 , Linxi “Jim” Fan 1† , Yuke Zhu 1† 1 NVIDIA 2 UC Berkeley 3 CMU 4 CUHK ∗ Equal Contribution † Project Leads
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-01061

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Opening the Sim-to-Real Door for Humanoid Pixel-to-Action Policy Transfer Haoru Xue 1,2∗ , Tairan He 1,3∗ , Zi Wang 1∗ , Qingwei Ben 1,4 , Wenli Xiao 1,3 , Zhengyi Luo 1 , Xingye Da 1 , Fernando Castañeda 1 , Guanya Shi 3 , Shankar Sastry 2 , Linxi “Jim” Fan 1† , Yuke Zhu 1† 1 NVIDIA 2 UC Berkeley 3 CMU 4 CUHK ∗ Equal Contribution † Project Leads Abstract Recent progress in GPU-accelerated, photorealistic simulation has opened a scalable data-generation path for robot learning, where massive physics and visual randomization allow policies to generalize beyond curated environments. Building on these advances, we develop a teacher-student-bootstrap learning framework for vision-based humanoid loco-manipulation, using articulated-object interaction as a representative high-difficulty benchmark. Our approach introduces a staged-reset exploration strategy that stabilizes long-horizon privileged-policy training, and a GRPO-based fine-tuning procedure that mitigates partial observability and improves closed-loop consistency in sim-to-real RL. Trained entirely on simulation data, the resulting policy achieves robust zero-shot performance across diverse door types and outperforms human teleoperators by up to 31.7% in task completion time under the same whole-body control stack. This represents the first humanoid sim-to-real policy capable of diverse articulated loco-manipulation using pure RGB perception. \abscontent 1 Introduction Figure 1 : Real-world generalization of DoorMan. Top: diverse handle visuals and physical shapes. Middle: diverse wall panel visuals. Bottom: pushing and pulling open doors naturalistically. The reality of robotics is that humanoid kung fu and backflips are solved before they can open doors using only RGB vision. Everyday loco-manipulation remains one of the hardest frontiers for humanoid autonomy. Seemingly simple household interactions, such as pulling a drawer, twisting a knob, or unlatching a gate, all require precise perception-action coupling, contact-rich control, and whole-body coordination under uncertainty. Among these tasks, door opening offers a particularly demanding instance: the robot must identify the grasping location from a moving egocentric camera, rotate a spring-loaded handle, track the compliant circular motion of the door panel, and maintain balance under hinge-induced forces. These tightly coupled requirements make door opening a strong stress test for any general-purpose loco-manipulation system. Our goal in this work is to develop a generalizable learning pipeline for vision-based humanoid loco-manipulation, with door opening serving as a challenging, real-world representative task. Existing systems focusing specifically on doors typically fall short of this broader ambition. Many rely on depth sensing, object-centric features, or hard-coded motion primitives on wheeled platforms ( 6 ; 45 ; 43 ) . Others simplify contact mechanics or require accurate object localization ( 51 ) . DARPA Robotics Challenge-era systems ( 30 ) depended heavily on scripting and operator intervention, while more recent teleoperation-centered pipelines ( 23 ) remain brittle. These designs do not produce a scalable solution for the diverse loco-manipulation skills needed in everyday environments. Recent advances in simulation, hardware, and RL have enabled strong sim-to-real results in locomotion ( 53 ; 42 ; 26 ; 33 ; 46 ; 4 ) , motion imitation ( 24 ; 27 ; 16 ) , and dexterous manipulation ( 39 ; 10 ; 25 ; 1 ; 13 ) . However, applying these techniques to loco-manipulation, where perception, balance, contact, and navigation interact, remains under-explored. In this setting, we identify two fundamental challenges for generalizable learning: (i) the algorithm itself must be simple, scalable, and robust to partial observability, capable of producing autonomous policies that coordinate vision and whole-body control (WBC) across diverse tasks. These requirements remain unmet in prior work; and (ii) the visual sim-to-real gap spans a vast space of appearance and physics variation, requiring broad, heterogeneous data rather than a few curated scenes. To address the first challenge, we introduce a novel, scalable teacher-student-bootstrap learning pipeline. First, a teacher with privileged states (e.g., door pose and articulation state) is trained via reinforcement learning (RL) with stage-conditioned rewards. To improve training efficiency, we introduce an exploration scheme that resets environments from late-stage snapshots, leveraging the recoverability of the simulator. Next, we distill the teacher into an RGB-based student using DAgger ( 34 ) , fusing a vision encoder with proprioception under aggressive visual randomization. Finally, to mitigate the partial observability inherent to vision-only control, we apply GRPO fine-tuning that stabilizes long-horizon behavior and encourages keeping task-relevant regions in view. To tackle the second challenge, we build a large-scale domain randomization pipeline in IsaacLab ( 29 ) that spans both physics and appearance variation at scale. Physically, we randomize door types, dimensions, hinge damping, latch dynamics, handle placement, and resistive torques. Visually, we randomize materials, lighting, and camera intrinsics/extrinsics. Rather than recreating specific scenes, we intentionally expose the policy to a broad variability envelope, a prerequisite for transferable humanoid loco-manipulation from simulation to the real world. Across real-world evaluations, the learned policy not only generalizes across diverse articulation mechanisms, appearances, and spatial layouts, but also exceeds human teleoperation in both success rate and efficiency, achieving an 83% success rate versus 80% (expert) and 60% (non-expert), and completing interactions 23.1%–31.7% faster using the same whole-body controller, suggesting that our pipeline produces robust, efficient, autonomous loco-manipulation behavior. Figure 2 : DoorMan training pipeline. All phases are done interactively with IsaacLab. In Phase 1, we train a teacher policy with privileged observations. In Phase 2, we distill it into an RGB student policy using DAgger. In Phase 3, we further train the student policy with GRPO using a binary success signal. To summarize, the main contributions of our work are: • We present one of the first humanoid sim-to-real policy capable of diverse articulated loco-manipulation from pure RGB perception. • We introduce a teacher-student-bootstrap pipeline for whole-body loco-manipulation, including a stage-reset exploration mechanism for stable teacher training and GRPO-based fine-tuning to mitigate the student policy’s partial observability. • We provide a physically accurate and visually diverse synthetic-generation pipeline in IsaacLab for humanoid navigation with interactable doors, designed to scale in parallel and distributed RL workflows. • We demonstrate a 31.7% improvement over human teleoperation using the same whole-body controller, highlighting the potential of photorealistic simulation for scaling vision-based whole-body loco-manipulation learning. 2 RGB Loco-Manipulation via Teacher-Student-Bootstrap Here we present DoorMan’s three-phase training, building on classical teacher–student distillation. We first outline a visual sim-to-real pipeline for whole-body loco-manipulation, emphasizing two design elements: a multi-stage exploration scheme tailored to long-horizon tasks and a bootstrapped refinement strategy that mitigates partial observability in the student. We then describe a large-scale synthetic generation pipeline in IsaacLab ( 29 ) that produces physically realistic and visually diverse door environments for training and evaluation, treating door opening as a representative loco-manipulation task. 2.1 Visual RL and Teacher-Student Distillation Preliminary . Consider a partially observable Markov decision process (POMDP) \mathcal{P}=(\mathcal{S},\mathcal{A},\mathcal{O},T,\mathcal{R},\mathcal{O},\gamma,\rho_{0}) , where \mathcal{S} is the state space, \mathcal{A} the action space, \mathcal{O} the observation space, T(s^{\prime}|s,a) the transition kernel, \mathcal{R}(s,a) the reward, \mathcal{O}(o|s) the observation, \gamma\in[0,1) the discount factor, and \rho_{0} the initial state distribution. In humanoid whole-body control literature, the policy is responsible for outputting target joint positions, which, in the case of a Unitree G1 robot, includes 29 body joints and 14 hand joints, resulting in an extremely high action space dimension of 33. These joint angles are then tracked by low-level motors using a PD control law. Contrary to quasi-static manipulation

Read the complete text