SCDP: Learning Humanoid Locomotion from Partial Observations via Mixed-Observation Distillation
Milo Carroll, Tianhu Peng, Lingfan Bao, Chengxu Zhou and Zhibin Li · 2026
Read SCDP: Learning Humanoid Locomotion from Partial Observations via Mixed-Observation Distillation by Milo Carroll, Tianhu Peng, Lingfan Bao, Chengxu Zhou and Zhibin Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-09574.txt.
Introduction
Milo Carroll and colleagues present Sensor-Conditioned Diffusion Policies, which teach humanoid locomotion from offline data using only onboard sensors. Older methods need privileged full-body states and costly state estimation. Their training mixes what the model sees, sensor histories, with what it must predict, privileged future state-action paths. That forces it to infer motion it cannot directly observe. Added steps curb train-deploy mismatch, and in simulation the policies rival full-state baselines.
Catalog record
| CREATOR | Milo Carroll, Tianhu Peng, Lingfan Bao, Chengxu Zhou and Zhibin Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30100 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.09574
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SCDP: Learning Humanoid Locomotion from Partial Observations via Mixed-Observation Distillation Milo Carroll, Tianhu Peng, Lingfan Bao, Chengxu Zhou and Zhibin Li Abstract Distilling humanoid locomotion control from offline datasets into deployable policies remains a challenge, as existing methods rely on privileged full-body states that require complex and often unreliable state estimation. We present Sensor-Conditioned Diffusion Policies (SCDP) that enables humanoid locomotion using only onboard sensors, eliminating the need for explicit state estimation. SCDP decouples sensing from supervision through mixed-observation training: diffusion model conditions on sensor histories while being supervised to predict privileged future state–action trajectories, enforcing the model to infer the motion dynamics under partial observability. We further develop restricted denoising, context distribution alignment, and context-aware attention masking to encourage implicit state estimation within the model and to prevent train–deploy mismatch. We validate SCDP on velocity-commanded locomotion and motion reference tracking tasks. In simulation, SCDP achieves near-perfect success on velocity control (99–100%) and 93% tracking success in AMASS test set, performing comparable to privileged baselines while using only onboard sensors. Finally, we deploy the trained policy on a real G1 humanoid at 50 Hz, demonstrating robust real robot locomotion without external sensing or state estimation. I INTRODUCTION Humanoid robot control has advanced rapidly in recent years, progressing from task-specific reinforcement learning controllers [ 15 , 21 , 18 ] to motion reference tracking methods [ 19 , 7 , 6 , 2 ] . These approaches enable diverse whole-body behaviors and have supported applications such as real-time teleoperation and multi-skill locomotion in both graphics [ 24 ] and robotics [ 7 , 6 , 32 , 30 , 4 ] . The ability to reproduce large skillets within a single controller is essential for adaptive behaviors, as demonstrated by multi-expert learning that synthesizes adaptive locomotion by combining different motor skills to handle varying task conditions [ 29 ] . Recently, diffusion models have become promising for learning more expressive control by modeling full distributions of expert behavior rather than deterministic action mappings [ 26 , 25 , 3 ] . Their flexibility offers task adaptation via direct conditioning or classifier guidance [ 23 , 12 ] . In robotics, diffusion-based policies have demonstrated strong performance in visuomotor manipulation [ 5 ] , bipedal locomotion [ 9 , 17 ] , and physics-based humanoid control [ 27 ] . Guided state-action diffusion approaches for humanoids [ 10 , 13 ] further show the ability to perform look-ahead planning and multitask control within a unified framework. Despite these advances, current humanoid diffusion controllers rely fundamentally on privileged full-body state information at deployment. These methods assume access to global position, orientation, base velocity, and rigid-body position, requiring complex and often unreliable state estimation pipelines on real robots outside the lab setting. The removal of privileged inputs dramatically degrades performance, with catastrophic failures even in simple tasks such as joystick locomotion [ 13 ] . This dependence is not viable in most practical deployment scenarios, as only direct onboard proprioceptive sensing is reliably available. Learning solely from onboard sensing induces a partially observable Markov decision process (POMDP), in which policies must infer hidden global states from incomplete observations. Existing diffusion-based controllers are not designed to operate under partial observability. We address this limitation with our proposed framework, SCDP, a diffusion-based distillation framework for humanoid control using only onboard proprioceptive measurements. Our key idea is to decouple sensing from supervision via mixed-observation training. During training, the model conditions only on onboard sensor histories while being supervised to predict privileged full-body state trajectories. This asymmetry enforces internal representation learning that captures global body dynamics from partial sensing, eliminating explicit state estimation at deployment. Fig. 1 : Deployment of Sensor-Conditioned Diffusion Policies (SCDP) on Unitree G1, performing robust locomotion at 50 Hz using only proprioceptive sensors, without external motion capture or state estimation. Unlike prior teacher–student transfer methods developed for MLP-based locomotion policies [ 21 , 20 , 7 , 11 ] , which distill reactive mappings from observation to action, SCDP addresses a fundamentally different problem: distilling a generative trajectory planner from offline datasets. While recent work has explored distilling RL policies into interpretable models for locomotion [ 1 ] , our goal here is to enable such distillation under partial observability without privileged state information, where the student policy must jointly denoise temporally coherent state-action sequences with incomplete information. Our proposed training formulation resolves this and enables deployment without privileged sensing. Fig. 2 : Sensor-Conditioned Diffusion Policies (SCDP) architecture and training framework. The state-action diffusion policy conditions on sensor observation history \{o_{t}\} , past actions \{a_{t}\} , and commands c_{t} , while predicting future trajectories containing privileged states \{s_{t}\} and actions. This mixed-observation formulation enables learning global dynamics from partial sensing. The key contributions of this work are as follows: • Mixed observation training, which conditions on sensor histories while predicting privileged state trajectories, enables implicit inference of global body dynamics. • Restricted denoising, which excludes base velocity from denoising inputs while retaining it in supervision, forces the model to infer velocity from context, enabling control without velocity feedback. • Context distribution alignment, which maintains consistent causal relationships between states and actions across training and inference. • Context-aware attention masking enables bidirectional attention within the context window to facilitate inference of latent dynamics from partial observations. • Experimental validation via deployment on physical Unitree G1 at 50 Hz (Fig. 1 ), and systematic ablations on data collection, context length, and architectural choices. II Method We present SCDP, a framework for distilling a diffusion-based controller from an expert RL policy to achieve whole-body humanoid control from onboard sensing. Our approach consists of four key components: (1) a Multi-Motion Tracking Policy (MMP) serving as an expert demonstrator; (2) our diffusion distillation framework; (3) a data collection methodology for robust distillation; and (4) a real-time deployment configuration for the Unitree G1. We describe each component below, showing how they combine to enable sensor-based control. II-A Multi-Motion Tracking Policy The foundation of our distillation framework is a Multi-Motion Policy (MMP), an RL-trained expert for multi-motion tracking that is built upon the reward function and PD controller from [ 13 ] . All quantities are expressed in the anchor-centric (set as the torso), heading-aligned frame via R_{\mathrm{yaw}} , the rotation aligning the global frame with the root heading. For each tracked body b\in\mathcal{B} , we compute local positions, orientations, and velocities as: \begin{split}\tilde{p}_{b}=R_{\text{yaw}}(p_{b}-p_{\text{anchor}}),\quad\tilde{R}_{b}=R_{\text{yaw}}R_{b},\\ \tilde{v}_{b}=R_{\text{yaw}}v_{b},\quad\tilde{\omega}_{b}=R_{\text{yaw}}\omega_{b}\end{split} (1) o_{\text{robot}}=[h_{\text{anchor}},\,\{\tilde{p}_{b},\tilde{R}_{b},\tilde{v}_{b},\tilde{\omega}_{b}\}_{b\in\mathcal{B}},\,a_{t-1}] is the self-observation. The task observation provides both absolute and relative future states for each reference body b_{m}\in\mathcal{B}_{m} over a look-ahead horizon of H steps: o_{\text{task}}=\big[\{\hat{p}_{b_{m}}^{(k)},\,\Delta p_{b_{m}}^{(k)},\,\hat{R}_{b_{m}}^{(k)},\,\Delta R_{b_{m}}^{(k)}\}_{k=1}^{H}\big], (2) where \hat{p}_{b_{m}}^{(k)}=R_{\text{yaw}}(p_{b_{m}}^{(k)}-p_{\text{anchor}}) and \Delta p_{b_{m}}^{(k)}=R_{\text{yaw}}(p_{b_{m}}^{(k)}-p_{b}) capture absolute and relative positions respectively, with orientations defined analogously. II-B Mixed-Observation Distillation: Learning Global Dynamics from Partial Sensing The key idea of mixed-observation distillation is to decouple sensing from supervision during training. In particular, we condition the diffusion model on historical observations from onboard sensors ( o_{t} ), while supervising it to predict future trajectories that include privileged full-body states ( s_{t} ). This asymmetry, shown in Fig. 2 , enables the model to learn an implicit forward model of global body dynamics, allowing deployment without explicit state estimation. II-B 1 Problem Formulation We consider a humanoid robot with