DynaFlow: Dynamics-embedded Flow Matching for Physically Consistent Motion Generation from State-only Demonstrations
Sowoo Lee, Dongyun Kang, Jaehyun Park, Hae-Won Park · 2025
Read DynaFlow: Dynamics-embedded Flow Matching for Physically Consistent Motion Generation from State-only Demonstrations by Sowoo Lee, Dongyun Kang, Jaehyun Park, Hae-Won Park (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-19804.txt.
Introduction
Motion demos for robots often record only body states, not the motor commands behind them. Sowoo Lee and three co-authors build DynaFlow, which learns from state-only demos while respecting physics. A differentiable simulator sits inside the generative model. The model proposes actions, the simulator turns them into state paths, and every output is physically feasible by construction.
Training then infers the hidden action sequences behind the demos. The team deployed the learned actions on a real Go1 quadruped robot. It reproduced varied gaits from the data and carried out long motion sequences under open-loop control. Even unfeasible human-style demos were reshaped into executable, stylish moves. Physics-checked generation could ease robot teaching across many body types.
Catalog record
| CREATOR | Sowoo Lee, Dongyun Kang, Jaehyun Park, Hae-Won Park |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-19804
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DynaFlow: Dynamics-embedded Flow Matching for Physically Consistent Motion Generation from State-only Demonstrations Sowoo Lee, Dongyun Kang, Jaehyun Park, Hae-Won Park Abstract This paper introduces DynaFlow, a novel framework that embeds a differentiable simulator directly into a flow matching model. By generating trajectories in the action space and mapping them to dynamically feasible state trajectories via the simulator, DynaFlow ensures all outputs are physically consistent by construction. This end-to-end differentiable architecture enables training on state-only demonstrations, allowing the model to simultaneously generate physically consistent state trajectories while inferring the underlying action sequences required to produce them. We demonstrate the effectiveness of our approach through quantitative evaluations and showcase its real-world applicability by deploying the generated actions onto a physical Go1 quadruped robot. The robot successfully reproduces diverse gait present in the dataset, executes long-horizon motions in open-loop control and translates infeasible kinematic demonstrations into dynamically executable, stylistic behaviors. These hardware experiments validate that DynaFlow produces deployable, highly effective motions on real-world hardware from state-only demonstrations, effectively bridging the gap between kinematic data and real-world execution. I Introduction Generative models, such as Diffusion Models and Flow Matching, have recently achieved unprecedented success across various domains, including image [ 1 , 2 , 3 ] , audio [ 4 ] , and text generation [ 5 ] . They have demonstrated a remarkable ability to learn intricate data distributions from large-scale datasets, producing highly natural and diverse outputs. Inspired by this success, these models are increasingly being recognized as powerful tools for generating complex motion trajectories in fields like robotics and computer graphics [ 6 , 7 , 8 ] . Indeed, their application to kinematic motion generation has seen significant progress, largely driven by the increasing availability of state demonstration data from sources such as motion capture and raw video. However, directly applying these generative models to character animation and robot control presents significant challenges. A primary limitation is the lack of physical consistency. Most generative models learn a statistical approximation of the data distribution from a finite set of examples, rather than the underlying physical principles governing the data. Consequently, there is no guarantee that the generated outputs will adhere to intrinsic physical principles or dynamic constraints. This means that when generating novel behaviors, the resulting motions can be either physically implausible, with artifacts like ground penetration, character floating, and foot sliding, or dynamically inconsistent, making them unsuitable to execute in the physical world. The issue becomes particularly pronounced when models are trained on datasets with inherent physical inconsistencies, such as those sourced from motion capture or generated through kinematic retargeting. Another major hurdle is the scarcity of action-labeled data. While state trajectories can often be obtained from motion capture or other sources, the corresponding action sequences (e.g., joint torques or motor commands) are rarely available and are costly to collect, typically being hardware-specific. Prior diffusion-based control approaches can be categorized into two principal ways. One option is to directly train a policy to predict actions from true action data, but this is rarely viable given the limited availability of true action data. Alternatively, a hierarchical framework can be employed, where the diffusion model generates desired state trajectories that are then executed by a low-level tracking controller. However, this hierarchical strategy has its own drawback: the tracking controller usually requires extensive fine-tuning for each new motion, and ensuring robustness against the distributional gap between planned trajectories and the controller remains a significant challenge [ 9 ] . To overcome these limitations, we propose DynaFlow, a novel framework that guarantees physically consistent motion generation by embedding dynamics directly into the generation process, while simultaneously inferring actions from state-only demonstration data. The core idea of DynaFlow is to integrate a differentiable simulator at the output of the flow matching prediction module. This simulator layer acts as a mapping from the space of action trajectories to the space of dynamically feasible state trajectories, ensuring that the model’s output strictly adheres to the laws of physics by construction. Furthermore, its differentiable nature allows the entire model to be trained end-to-end. During this process, the model naturally discovers the action trajectory required to reconstruct a given state trajectory in a dynamically consistent manner, even without explicit action labels. We conduct a series of experiments to validate the effectiveness of DynaFlow. Our quantitative analysis compares DynaFlow against several baselines, evaluating both dynamic feasibility and distributional similarity on two distinct datasets: a rich, strictly feasible dataset of quadruped locomotion and a challenging single-trajectory dataset from retargeted motion capture. Our results demonstrate that DynaFlow consistently generates strictly feasible trajectories, even when trained on a physically inconsistent dataset, while remaining competitive in distributional similarity. To showcase its real-world applicability, we deploy action trajectories generated by DynaFlow on a physical Go1 quadruped robot. The robot successfully reproduces diverse gaits observed in the training data and executes long-horizon motions with high accuracy in challenging open-loop experiments, validating the precision and coherence of the generated actions. Furthermore, we demonstrate its ability to translate infeasible retargeted motions into dynamically executable and stylistic behaviors on hardware, bridging the gap between kinematic demonstration and real-world execution. The main contributions of this paper are as follows: • Dynamics-embedded generative modeling : We propose DynaFlow, a novel generative model that embeds a differentiable simulator into a flow matching framework to guarantee all generated trajectories are strictly dynamically consistent by construction. • Learning from state-only data : Our method overcomes the common challenge of unavailable action data by leveraging analytical gradients, learning action directly from state-only demonstrations. • Real-world validation : We demonstrate the practical viability of our approach through successful hardware deployment of the generated motion on a physical quadruped robot, bridging the gap between motion generation and real-world execution. II Related Works Fig. 1: Schematic illustration of proposed framework. Given state-only demonstrations that are not guaranteed to be physically feasible, DynaFlow generates dynamically consistent trajectories while also inferring deployable action sequences. The entire model is trained end-to-end using analytical gradients provided by the differentiable simulator. II-A Generative Models for Control Tasks Generative models have been largely explored for physics-based character animation and robotic control. Prior works can be broadly categorized into two main paradigms. The first paradigm is the hierarchical approach, where the generative model serves as a high-level state planner, while a separate low-level control module produces executable actions. This factorized design decouples planning and control, offering the advantage of addressing the problem in two stages and enabling the generative model to focus on state trajectory generation while other control modules are used for execution. A key design choice in this paradigm is how to implement the control module. For example, Decision Diffuser [ 10 ] uses ground-truth action labels to train an inverse dynamics network via supervised learning. In the absence of action labels, one common approach is to pair the planner with a reinforcement learning-based tracking controller [ 11 , 12 ] . Alternatively, model-based approaches combine generative models with optimization-based controllers, where diffusion models either generate intermediate subgoals that are tracked by Model Predictive Control (MPC) [ 13 ] or provide initial guesses that are refined by trajectory optimization [ 14 ] . While effective, these approaches are often limited by their reliance