PhysMoDPO: Physically-Plausible Humanoid Motion with Preference Optimization

Yangsong Zhang 1, Anujith Muraleedharan 1, Rikhat Akizhanov 1, Abdul Ahad Butt 1, Gül Varol 2, Pascal Fua 3, Fabio Pizzati 1, Ivan Laptev 1 · 2026

Read PhysMoDPO: Physically-Plausible Humanoid Motion with Preference Optimization by Yangsong Zhang 1, Anujith Muraleedharan 1, Rikhat Akizhanov 1, Abdul Ahad Butt 1, Gül Varol 2, Pascal Fua 3, Fabio Pizzati 1, Ivan Laptev 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-13228.txt.

Introduction

Yangsong Zhang and co-authors present PhysMoDPO, a method for physically plausible humanoid motion. Diffusion models make text-guided human motion, but a Whole-Body Controller must adapt it for robots. That step enforces physics yet can drift far from the source motion. PhysMoDPO places the controller inside training and uses Direct Preference Optimization. Physics-based and task rewards rank the synthesized trajectories for preference learning. Tests on text-to-motion and spatial control show gains in realism and task scores, including on a real G1 humanoid.

Catalog record

CREATORYangsong Zhang 1, Anujith Muraleedharan 1, Rikhat Akizhanov 1, Abdul Ahad Butt 1, Gül Varol 2, Pascal Fua 3, Fabio Pizzati 1, Ivan Laptev 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55055
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.13228

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PhysMoDPO: Physically-Plausible Humanoid Motion with Preference Optimization Yangsong Zhang 1, Anujith Muraleedharan 1, Rikhat Akizhanov 1, Abdul Ahad Butt 1, Gül Varol 2, Pascal Fua 3, Fabio Pizzati 1, Ivan Laptev 1 Abstract Recent progress in text-conditioned human motion generation has been largely driven by diffusion models trained on large-scale human motion data. Building on this progress, recent methods attempt to transfer such models for character animation and real robot control by applying a Whole-Body Controller (WBC) that converts diffusion-generated motions into executable trajectories. While WBC trajectories become compliant with physics, they may expose substantial deviations from original motion. To address this issue, we here propose PhysMoDPO, a Direct Preference Optimization framework. Unlike prior work that relies on hand-crafted physics-aware heuristics such as foot-sliding penalties, we integrate WBC into our training pipeline and optimize diffusion model such that the output of WBC becomes compliant both with physics and original text instructions. To train PhysMoDPO we deploy physics-based and task-specific rewards and use them to assign preference to synthesized trajectories. Our extensive experiments on text-to-motion and spatial control tasks demonstrate consistent improvements of PhysMoDPO in both physical realism and task-related metrics on simulated robots. Moreover, we demonstrate that PhysMoDPO results in significant improvements when applied to zero-shot motion transfer in simulation and for real-world deployment on a G1 humanoid robot. 1 Introduction Figure 1 : PhysMoDPO generates motions that follow textual instructions while respecting physical constraints. Compared to prior methods, our approach produces motions that remain stable and physically realistic when deployed on the Unitree G1 robot. The progress of diffusion models has largely advanced the text driven motion generation. Given an input condition ( e.g . , a text description or additional spatial constraints), a model synthesizes a human motion sequence, enabling applications for animation, virtual avatars, and gaming [ 44 , 5 , 52 , 50 ] . Among these applications, embodied downstream tasks, especially humanoid robotics, are particularly compelling: if a generative model could reliably produce physically consistent, controllable motions, it could provide a scalable source of reference behaviors for motion tracking and policy training. However, deploying generated motions in a physics-based setting exposes a key limitation of current generators. Diffusion models are typically trained and evaluated in a kinematic space, where performance is judged by distributional similarity and alignment with the condition signal. In contrast, robotics requires motions that remain feasible under dynamics and contacts: feet should not skate, the center of mass must stay supported. In practice, when a generated motion is executed via a Whole-Body Controller (WBC) in simulation, a standard strategy in humanoid control [ 29 , 30 , 21 ] , the controller may significantly alter the implausible motion to satisfy constraints. This introduces a discrepancy between what the generator produces and what is actually realized in the simulation. As a result, a model that performs well under kinematic metrics may still be unreliable for embodied deployment. To allow plausible human motion for deployment in real robotics embodiments, current efforts toward physically plausible motion modeling follow two main directions. One line injects physics priors through test-time hand-crafted losses or auxiliary refinement modules [ 20 , 38 , 57 , 56 ] . While effective in specific cases, such approaches can shift the output distribution to adapt physics constraints and thus may largely harm the task-specific performance. Another line optimizes generators with heuristics rewards via reinforcement learning [ 7 , 48 ] . Although promising and visually plausible, the performance highly depends on the heuristics functions, i.e . , floating, and sliding, which makes it difficult to measure complex physical dynamics. Therefore, directly scaling hand-crafted rewards to the complicated real-world scenario is non-trivial. In this work, we propose PhysMoDPO, a physics-guided post-training framework for diffusion-based motion generators. Specifically, we integrate WBC into our training pipeline to measure how close the motion is to transfer to executable trajectory. In this way, the reward could directly cover the physical aspects such as dynamics, floating and jittering. As for our finetuning framework, inspired by DPO [ 37 ] alignment in image and video generation [ 46 , 22 ] , we automatically construct preference data through pretrained WBC. Concretely, for each condition, we exploit stochastic sampling to generate multiple candidate motions, execute each candidate through the WBC, DeepMimic [ 29 ] , to obtain simulated motions, and then compute (i) physics-based rewards that reflect trackability and contact realism for robots, and (ii) task-specific rewards that measure whether the tracked motion still matches the input condition. Importantly, computing task rewards after tracking directly targets the evaluation mismatch: we optimize the generator for motions that remain both physically feasible and condition-faithful. Extensive experiments on text-to-motion and spatial control tasks show that PhysMoDPO consistently improves physical realism while preserving and often improving task-related metrics on simulated robots. Moreover, we retarget and deploy the generated motions to real robots in a zero-shot way, i.e., without additional motion refinement. We demonstrate the zero-shot generalization to simulation and real-world deployment on Unitree G1, suggesting that post-training a generator with physics-guided preferences can produce motions that transfer beyond kinematic benchmarks. Contributions. In summary, our contributions are three-fold: (1) We propose PhysMoDPO, an automatic generate–finetune pipeline that leverages a pretrained WBC to post-train diffusion motion generators toward robotics-oriented physical consistency. (2) We design physics-based rewards that measure trackability and contact realism, together with task-specific rewards that evaluate condition fidelity after tracking policy, enabling preference supervision aligned with embodied deployment. (3) We conduct extensive experiments on text-to-motion and spatial control, demonstrating improved physical realism and task-related metrics in simulation, and showing zero-shot transfer to Unitree G1 in both simulation and real-world deployment. 2 Related Works Controllable human motion generation. Human motion generation has been studied under various conditioning signals, including action labels [ 32 ] , speech audio [ 16 , 59 ] , music [ 13 , 45 ] , text descriptions [ 5 , 44 , 55 , 33 ] . More recently, in the domain of text-to-motion generation, research has shifted towards more fine-grained controllable motion synthesis, exploring temporal or spatial composition [ 2 , 3 , 34 ] , streaming generation [ 50 ] , integrating scene context [ 47 , 58 ] , or object [ 15 , 14 ] into the generation framework and detailed spatial joint control [ 12 , 52 , 4 , 35 ] . Despite this progress, generated motions often fail to execute in physics-based simulators, exhibiting artifacts such as the center of mass that lies outside the body support. To address this gap, we integrate a pre-trained physics-based method to compute physics-based rewards as part of learning signals for DPO [ 37 ] fine-tuning, thereby improving the physical plausibility. Physically plausible human motion modeling. As shown in Table 1 , one direction in physically plausible motion modeling is to apply hand-craft optimization [ 20 , 38 ] or additional models [ 57 , 56 , 43 ] to project the predicted noisy human motions. Previous works [ 20 , 38 ] typically apply optimization through the Euler-Lagrange equations. PhysPT [ 57 ] further proposes a physics-aware transformer through self-supervised learning with Euler-Lagrange equations. Recent works [ 56 , 19 , 54 ] further use physics-based

Read the complete text