Port–Hamiltonian Diffusion Models: A Control-Theoretic Perspective on Generative Modeling
Majid Darehmiraki · 2026
Read Port–Hamiltonian Diffusion Models: A Control-Theoretic Perspective on Generative Modeling by Majid Darehmiraki (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-06071.txt.
Introduction
Majid Darehmiraki gives diffusion models a control-theory foundation in a 2026 paper. Diffusion models generate images and other data by reversing a noise-adding process. They are usually treated as black-box stochastic systems, with little insight into why sampling stays stable.
Darehmiraki places both directions of the process inside the port-Hamiltonian framework, a way of modeling systems through energy flow. The score function becomes the gradient of a learnable energy. The reverse, generative process then looks like a feedback-controlled system where dissipation, the controlled loss of energy, stabilizes sampling. The setup yields stability guarantees that do not depend on how accurate the score estimate is. A simple worked example illustrates the idea.
Catalog record
| CREATOR | Majid Darehmiraki |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-06071
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Port–Hamiltonian Diffusion Models: A Control-Theoretic Perspective on Generative Modeling Majid Darehmiraki Abstract Diffusion models have recently achieved remarkable success in generative modeling, yet they are commonly formulated as black-box stochastic systems with limited interpretability and few structural guarantees. In this paper, we establish a control-theoretic foundation for diffusion models by embedding them within the port–Hamiltonian (PH) systems framework. We show that the score function can be interpreted as the gradient of a learnable Hamiltonian energy, allowing both the forward and reverse diffusion processes to be formulated as structured PH dynamics. The reverse-time generative process is further interpreted as a feedback-controlled PH system, where dissipation plays a fundamental role in stabilizing sampling dynamics. This formulation yields intrinsic stability guarantees that are independent of score estimation accuracy. A simple analytical example illustrates the proposed framework. 1 Introduction Diffusion models constitute a powerful class of generative models based on stochastic dynamical systems. By defining a forward noise-injection process and learning its reverse-time dynamics, these models enable high-quality sample generation in complex, high-dimensional spaces. Despite their empirical success, diffusion models are typically treated as black-box neural stochastic differential equations, offering limited interpretability and few guarantees related to stability or physical consistency. In contrast, PH systems provide a well-established framework in control theory for modeling physical systems based on energy conservation, dissipation, and interconnection structure. PH systems naturally encode passivity and stability through an explicit Hamiltonian energy function and structured dynamics. This paper establishes a principled connection between diffusion models and port–Hamiltonian systems. By interpreting the score function as the gradient of a learnable Hamiltonian energy, we formulate both the forward and reverse diffusion processes within a unified PH framework. This perspective enables a control-theoretic interpretation of generative sampling and yields structural stability guarantees. The quest to model and generate complex data distributions lies at the heart of modern machine learning. Generative models, which learn to approximate the underlying data manifold from observed samples, have witnessed remarkable progress, largely driven by deep learning architectures. Among these, Variational Autoencoders (VAEs) [ 1 ] and Generative Adversarial Networks (GANs) [ 2 ] have emerged as prominent paradigms. VAEs frame generation as a problem of variational inference, learning an encoder-decoder framework to approximate the posterior distribution of latent variables given data and a decoder to reconstruct data from these latent variables. GANs, on the other hand, employ an adversarial training process where a generator network competes against a discriminator network, with the former aiming to produce realistic data indistinguishable from true samples, and the latter striving to differentiate between real and generated data. While both VAEs and GANs have achieved impressive results in various domains, they are not without limitations. VAEs often suffer from producing overly blurry or simplistic samples due to the choice of approximate posterior distribution or the nature of the reconstruction loss. GANs are notoriously difficult to train, plagued by issues such as mode collapse (where the generator produces a limited variety of samples), training instability, and a lack of reliable, universally accepted evaluation metrics. These challenges have motivated the exploration of alternative generative frameworks that offer more stable training dynamics, stronger theoretical guarantees, and improved sample quality. In recent years, diffusion models have risen to prominence as a powerful class of generative models, demonstrating state-of-the-art performance in tasks such as image synthesis, audio generation, and molecular modeling [ 3 , 12 ] . The core inspiration for diffusion models stems from non-equilibrium statistical physics. They define a forward process , which gradually transforms a data sample from the true data distribution into a simple, tractable prior distribution (typically an isotropic Gaussian) by iteratively adding Gaussian noise over a series of timesteps. This forward process is usually a Markov chain, or in its continuous-time generalization, a Stochastic Differential Equation (SDE). The generative capability then arises from learning a reverse process , which aims to reverse this noising procedure, starting from the simple prior and iteratively denoising it to generate a new sample from the learned data distribution. The seminal work by Sohl-Dickstein et al. [ 9 ] first introduced the concept of diffusion probabilistic models, demonstrating that deep neural networks could be trained to reverse a carefully constructed forward diffusion process. A significant simplification and popularization of this idea came with Denoising Diffusion Probabilistic Models (DDPMs) by Ho et al. [ 3 ] . They showed that by parameterizing the reverse transition as conditional Gaussian distributions and optimizing a simplified variational lower bound on the data likelihood, high-quality samples could be generated. Concurrently, the score-based generative modeling framework, pioneered by Song and Ermon [ 4 ] , offered a complementary perspective. This approach focuses on learning the score function , defined as the gradient of the log-density of the data distribution, \nabla_{\mathbf{x}}\log p(\mathbf{x}) . Using techniques like score matching [ 5 ] , one can train a neural network to estimate this score function without requiring explicit knowledge of the partition function. Once the score is learned, samples can be generated via Langevin dynamics, an iterative MCMC method that perturbs noise with the learned score to converge to regions of high data density. These two perspectives—diffusion models and score-based models—were elegantly unified under a continuous-time SDE framework by Song et al. [ 12 ] . They demonstrated that both the forward noising process and the reverse generative process can be described by SDEs. Specifically, a forward SDE of the form d\mathbf{x}_{t}=\mathbf{f}(\mathbf{x}_{t},t)dt+g(t)d\mathbf{W}_{t} can be associated with a reverse-time SDE d\mathbf{x}_{t}=[\mathbf{f}(\mathbf{x}_{t},t)-g(t)^{2}\nabla_{\mathbf{x}_{t}}\log p_{t}(\mathbf{x}_{t})]dt+g(t)d\bar{\mathbf{W}}_{t} , where p_{t}(\mathbf{x}_{t}) is the marginal distribution at time t and \bar{\mathbf{W}}_{t} is a reverse-time Wiener process. This continuous-time formulation not only provides a flexible and unifying theoretical underpinning but also enables the derivation of deterministic sampling methods known as probability flow Ordinary Differential Equations (ODEs) [ 6 ] , which can sometimes offer faster sampling. Despite their empirical success, diffusion and score-based models are often formulated as black-box stochastic systems. The learned reverse dynamics, whether SDE or ODE based, typically lack explicit structural guarantees concerning stability, passivity, or robustness to perturbations in the learned score function. The generative process relies heavily on the accuracy of the score estimation, and the underlying dynamics do not inherently enforce an energy-based or control-theoretic structure that could provide intrinsic stability or interpretability. The concept of Energy-Based Models (EBMs) offers another long-standing approach to generative modeling [ 13 ] . In EBMs, a probability distribution over data \mathbf{x} is defined via an energy function E_{\theta}(\mathbf{x}) as p_{\theta}(\mathbf{x})=\frac{\exp(-E_{\theta}(\mathbf{x}))}{Z_{\theta}} , where Z_{\theta} is the often intractable partition function ensuring normalization. The learning objective is to adjust the parameters \theta so that the model assigns low energy to data points drawn from the true data distribution and high energy elsewhere. The score function is directly related to the gradient of the energy: \nabla_{\mathbf{x}}\log p_{\theta}(\mathbf{x})=-\nabla_{\mathbf{x}}E_{\theta}(\mathbf{x}) . Thus, score-based models can be viewed as a practical method for learning and sampling from implicit, time-dependent EBMs. While EBMs provide a conceptually appealing probabilistic framework and a clear link to statistical physics, they often face challenges in training due to the intractability of Z_{\theta} and the reliance on MCMC methods for both estimation and sampling, which can be computationally intensive and suffer from slow mixing. Furthermore, traditional EBMs do not typically impose an explicit, structured dynamical