Dynamics-aware Diffusion Models for Planning and Control

Darshan Gadginmath, Fabio Pasqualetti · 2025

Read Dynamics-aware Diffusion Models for Planning and Control by Darshan Gadginmath, Fabio Pasqualetti (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-00236.txt.

Introduction

Diffusion models can generate realistic motion, but for robots and other control tasks the motion also has to obey physics. Darshan Gadginmath and Fabio Pasqualetti present a framework that builds the system's dynamics directly into the model's denoising steps. At each step the model predicts a trajectory and then projects it so that it respects the physical constraints, in rhythm with the noise schedule. The result is motion that both looks like the expert examples and can actually be carried out.

The method can produce the most likely trajectories and can even recover trajectories made by linear feedback controllers without being told the dynamics explicitly. Tests cover standard control tasks plus a harder problem that mixes waypoint tracking with collision avoidance in a non-convex setting. The authors argue that weaving dynamics into generation, rather than checking afterward, makes diffusion models practical for planning and control in complex environments.

Catalog record

CREATORDarshan Gadginmath, Fabio Pasqualetti
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-00236

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Dynamics-aware Diffusion Models for Planning and Control Darshan Gadginmath, Fabio Pasqualetti Abstract This paper addresses the problem of generating dynamically admissible trajectories for control tasks using diffusion models, particularly in scenarios where the environment is complex and system dynamics are crucial for practical application. We propose a novel framework that integrates system dynamics directly into the diffusion model’s denoising process through a sequential prediction and projection mechanism. This mechanism, aligned with the diffusion model’s noising schedule, ensures generated trajectories are both consistent with expert demonstrations and adhere to underlying physical constraints. Notably, our approach can generate maximum likelihood trajectories and accurately recover trajectories generated by linear feedback controllers, even when explicit dynamics knowledge is unavailable. We validate the effectiveness of our method through experiments on standard control tasks and a complex non-convex optimal control problem involving waypoint tracking and collision avoidance, demonstrating its potential for efficient trajectory generation in practical applications. Our code repository is available at www.github.com/darshangm/dynamics-aware-diffusion . I Introduction Diffusion models have emerged as powerful tools for learning complex data distributions, demonstrating significant potential in control and robotics, particularly for high-dimensional trajectory generation [ 1 ] . Their ability to learn and replicate expert demonstrations makes them attractive for imitation learning and decision-making. However, a critical limitation arises from their inherent lack of explicit dynamics awareness. Standard diffusion models, trained on diverse datasets, often produce trajectories that violate the underlying physical constraints of specific systems. This issue is exacerbated in robotics, where datasets often include demonstrations on different robots with varying dynamics, hindering the model’s ability to generalize to individual robot behaviors. Consequently, generated trajectories may necessitate computationally expensive post-processing or real-time corrections to ensure feasibility, particularly in safety-critical applications where constraint violations can lead to failures. To mitigate this challenge, we introduce a novel dynamics-aware diffusion framework that integrates system dynamics directly into the denoising process. By employing a sequential prediction and projection mechanism, our method ensures that generated trajectories adhere to the physical laws governing a specific robot. This approach is particularly advantageous when dealing with diverse robotic datasets, as it enables the diffusion model to specialize its output to the dynamics of a target robot. Our framework eliminates the need for external corrective mechanisms, facilitating the generation of physically plausible trajectories that are consistent with expert demonstrations. Furthermore, our approach is designed to be adaptable, offering robustness even when explicit system dynamics are partially known or approximated. By enforcing dynamics awareness, we enhance the practicality and safety of diffusion-based trajectory generation, paving the way for more reliable and efficient robotic control. I-A Related work Diffusion models have demonstrated significant success across various domains, including image synthesis, natural language processing, and control. Their ability to model complex data distributions is particularly relevant for trajectory generation in robotics, reinforcement learning, and control. We review relevant literature in three key areas: (1) physics-informed diffusion models, (2) diffusion models for motion planning, and (3) diffusion models for control. Physics-informed diffusion models. Integrating physical constraints into deep generative models is a growing research area. Many approaches incorporate physical constraints into the training or inference process by penalizing dynamics violations in the loss function [ 2 , 3 ] . These methods, while effective, do not guarantee strict adherence to system dynamics. Some methods, such as [ 4 ] , modify the score function to enforce conservation laws. However, these methods rely on approximate penalties rather than exact constraints. Diffusion models for robotic motion planning. Diffusion models have been applied to motion planning, particularly in imitation and reinforcement learning settings [ 5 , 6 , 7 , 8 , 9 , 10 ] . Diffuser [ 5 ] models multi-step trajectories as a generative process but does not explicitly incorporate system dynamics, often requiring additional controllers for correction. Similarly, [ 11 ] uses iterative refinement for robotic manipulation. While [ 12 ] penalizes general constraint violations in the loss function, it still does not enforce hard dynamics constraints. Diffusion models for control. Diffusion models have also been explored for control tasks. For example, [ 13 ] uses a diffusion model for Model Predictive Control, and [ 14 ] predicts stochastic aspects of a dynamical system for trajectory optimization. Our previous work [ 15 ] directly applies noising-denoising to control channels, but successfully applied to only driftless systems. The most related works are [ 16 ] and [ 17 ] , which use projection onto a feasible set during denoising. However, they require full knowledge of system dynamics and online computation of the feasible set at each time step. Although [ 17 ] doesn’t explicitly use system dynamics, they assume access to a perfect simulator that mimics the dynamics of the system. Furthermore, the projection step in [ 16 ] and [ 17 ] involves solving a nonlinear optimization problem, leading to high computational costs during inference. While [ 16 ] applies projections at every denoising iteration, [ 17 ] uses stochastic projections only at low noise levels. In contrast, our method can generate admissible trajectories even with unknown system dynamics. We employ a sequence of small projections through a simple matrix multiplication that is aligned with the forward diffusion noise schedule. This allows us to refine the generated trajectory while maintaining consistency with the system dynamics. I-B Contributions The primary contributions of our work are two-fold: 1. Dynamics-aware denoising via projection: We propose a novel algorithm that integrates system dynamics into diffusion models by incorporating a projection step within the denoising process. This projection step enforces maximum-likelihood trajectory consistency with the system dynamics, augmenting the existing neural network-based denoising process. 2. Applicability to known and unknown systems: We demonstrate the efficacy of our approach in solving complex control problems for linear systems, showcasing adaptability across scenarios with both known and unknown system dynamics. Furthermore, we theoretically show the method’s ability to recover trajectories generated by linear feedback controllers, highlighting its practical relevance. II Problem formulation and preliminaries Consider the stochastic discrete-time LTI system: x(t+1)=Ax(t)+Bu(t)+w(t), (1) where x(t)\in\mathbb{R}^{n} represents the state vector, u(t)\in\mathbb{R}^{m} the control input vector, and w(t)\in\mathbb{R}^{n} is the process noise vector with mean \mathbb{E}[w(t)]=0 , at time t . The system dynamics are defined by matrices A\in\mathbb{R}^{n\times n} and B\in\mathbb{R}^{n\times m} . The objective is to solve the following control problem: \displaystyle\underset{u(0:T-1)}{\text{max}} \displaystyle\mathcal{R}(x(0:T),u(0:T-1),\mathcal{E}) (2) \displaystyle\text{s.t.}\quad x(t+1) \displaystyle=Ax(t)+Bu(t)+w(t), \displaystyle x(0) \displaystyle=x_{\text{init}}, Here, x(0:T)=[x(0)^{\top}\ x(1)^{\top}\ \dots\ x(1)^{\top}]^{\top} and u(0:T-1)=[u(0)^{\top}\ u(1)^{\top}\ \dots\ u(T-1)^{\top}]^{\top} denote the concatenated state and control input sequences, respectively. The environmental variable \mathcal{E} encapsulates task-specific information. For instance, \mathcal{E} can encode the reward function parameters, obstacle configurations, or reference trajectories. Note that the initial state x_{0} is fixed. We seek to determine the optimal state and control sequence (x(0:T),u(0:T-1)) that maximizes the expected reward \mathcal{R} while adhering to the system dynamics. This problem is challenging due to potential non-convexities and randomness in the reward function \mathcal{R} introduced by the environmental variable \mathcal{E} . Traditional control methods relying on convexity and Gaussian assumptions may be inadequate in such scenarios. We denote the trajectory of states and control inputs as \tau=[x(0:T)^{\top}\ u(0:T-1)^{\top}]^{\top} . To address this control challenge, we assume access to state and control trajectories of expert demonstrations, denoted as \tau_{0} . Each \tau_{0} represents successful a task execution under

Read the complete text