Minimum-Excess-Work Guidance
Christopher Kolloff 1 2, Tobias Höppe 3 4, Emmanouil Angelis 3 4, Stefan Bauer 3 4, Simon Olsson 1, 4 Helmholtz AI, Munich · 2025
Read Minimum-Excess-Work Guidance by Christopher Kolloff 1 2, Tobias Höppe 3 4, Emmanouil Angelis 3 4, Stefan Bauer 3 4, Simon Olsson 1, 4 Helmholtz AI, Munich (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-13375.txt.
Introduction
Christopher Kolloff and co-authors guide image-making models with an idea borrowed from heat physics, in a paper from two thousand twenty-five. Trained flow and diffusion models can make new samples, but science users often have few target samples or only partial data. Extra guidance must not waste those scarce samples.
Their frame steers the model by cutting excess work, a physics measure with links to optimal transport. One mode steers samples toward rare states set by the user. Another mode aligns output with lab measures while keeping variety. On a protein model, the method cut bias and raised sample efficiency.
Catalog record
| CREATOR | Christopher Kolloff 1 2, Tobias Höppe 3 4, Emmanouil Angelis 3 4, Stefan Bauer 3 4, Simon Olsson 1, 4 Helmholtz AI, Munich |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 81 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-13375
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Minimum-Excess-Work Guidance Thanks: Joint last authors. Christopher Kolloff 1 2, Tobias Höppe 3 4, Emmanouil Angelis 3 4, Stefan Bauer 3 4, Simon Olsson 1, 4 Helmholtz AI, Munich Abstract We propose a regularization framework inspired by thermodynamic work for guiding pre-trained probability flow generative models (e.g., continuous normalizing flows or diffusion models) by minimizing excess work, a concept rooted in statistical mechanics and with strong conceptual connections to optimal transport. Our approach enables efficient guidance in sparse-data regimes common to scientific applications, where only limited target samples or partial density constraints are available. We introduce two strategies: Path Guidance for sampling rare transition states by concentrating probability mass on user-defined subsets, and Observable Guidance for aligning generated distributions with experimental observables while preserving entropy. We demonstrate the framework’s versatility on a coarse-grained protein model, guiding it to sample transition configurations between folded/unfolded states and correct systematic biases using experimental data. The method bridges thermodynamic principles with modern generative architectures, offering a principled, efficient, and physics-inspired alternative to standard fine-tuning in data-scarce domains. Empirical results highlight improved sample efficiency and bias reduction, underscoring its applicability to molecular simulations and beyond. Figure 1: Schematic comparison of observable and path guidance. Both panels show the evolution of probability density over time t (blue heat map) with marginal distributions p(\mathbf{x}_{1}) and p(\mathbf{x}_{0}) on the sides (blue: reference model, red dashed: guided model). (A) Observable guidance perturbs the score function (red arrows) to match experimental observables (yellow) with unknown data distribution p(\mathbf{x}_{0}) using minimal excess work. (B) Path guidance steers sampling trajectories (black solid) toward specific regions defined by guidance samples \mathcal{X}^{g}=\{\mathbf{x}_{0}^{i}\}_{i=1}^{M} (dotted grey). 1 Introduction Probability flow generative models, such as normalizing flows [ 66 , 53 , 1 , 51 ] and diffusion models [ 80 , 30 ] , enable the modeling of complex, high-dimensional data distributions across a wide range of applications. These models generate samples through the integration of differential equations evolving a tractable distribution into an approximation of the data distribution. Although these models excel at general distribution learning, many scientific applications require precise control over generated samples to meet sparse observational constraints (e.g., limited transition state configurations or partial density constraints from experiments). Current guidance methods struggle in data-scarce regimes as they typically rely on either specialized training or abundant reward signals. Existing approaches often involve fine-tuning [ 86 , 8 , 25 ] , incorporating conditional information during training [ 29 , 60 ] , or training an additional noise-aware discriminative model [ 80 ] . While effective, these methods may be impractical in sparse-data settings. A prominent class of alternative approaches, known as loss guidance , perturbs the score of a frozen foundation model with guidance signals obtained via backpropagation through the model [ 4 , 23 , 79 , 39 ] or through the full ODE [ 6 ] . Although successfully used for post hoc control, they can suffer from high gradient variance in high-dimensional, structured spaces, motivating the need for a more stable and principled regularization framework. Inspired by statistical mechanics, we introduce an approach for regularizing guidance of probability flow generative models based on the principle of minimum excess work (MEW). In this context, “work” is a measure of the physical effort, e.g., energy, needed to transform a system from one macrostate to another, where a macrostate is characterized by a probability density function. MEW thereby acts as a natural, physics-inspired regularization scheme for guiding generative models. We develop the theoretical framework for MEW-based regularization of generative models, explicitly connecting it to optimal transport theory, and validate its effectiveness through extensive benchmarks across multiple systems, including a coarse-grained protein Boltzmann Emulator. In addition to introducing the MEW framework, we propose a simple yet effective form of path guidance tailored to sparse sampling problems. We specialize MEW guidance to address two problems frequently encountered in molecular dynamics simulations. First, Observable Guidance : a bias correction method to align distributions with experimental observables while preserving distributional entropy. Second, Transition State Sampling : a path-guidance-based sampling strategy to focus sampling on a user-defined subset, e.g., the low-probability transition region between states. 1 1 1 All data and code will be made publicly available upon publication. 2 Background and Preliminaries Diffusion models learn a stochastic process that maps a simple prior distribution p_{1} to an approximation p_{0} of the data distribution q_{0} . This is typically done by reversing a known noising process governed by an Ornstein–Uhlenbeck SDE, \,\mathrm{d}\mathbf{x}_{t}=\mathbf{f}(\mathbf{x}_{t},t)\,\mathrm{d}t+g(t)\,\mathrm{d}\mathbf{w}_{t} with \mathbf{f}(\mathbf{x}_{t},t) linear in \mathbf{x}_{t} . This process induces a family of marginals q_{t} with simple forward transitions q_{t}(\mathbf{x}_{t}|\mathbf{x}_{0})=\mathcal{N}(\mathbf{x}_{t};\alpha_{t}\mathbf{x}_{0},\sigma_{t}^{2}\mathbf{I}) , where \alpha_{t},\sigma_{t} are determined by the SDE coefficients. Given access to q_{1} and the score \nabla_{\mathbf{x}_{t}}\log q_{t}(\mathbf{x}_{t}) , one can sample from q_{0} via the time-reversal [ 2 ] : \,\mathrm{d}\mathbf{x}_{t}=[\mathbf{f}(\mathbf{x}_{t},t)-g(t)^{2}\nabla_{\mathbf{x}_{t}}\log q_{t}(\mathbf{x}_{t})]\,\mathrm{d}t+g(t)\,\mathrm{d}\widetilde{\mathbf{w}}_{t}\ ,\qquad\mathbf{x}_{1}\sim q_{1}\ , (1) where \widetilde{\mathbf{w}}_{t} is a reverse-time Wiener process, or via the probability flow ODE [ 54 , 80 ] : \frac{\,\mathrm{d}\mathbf{x}_{t}}{\,\mathrm{d}t}=\mathbf{f}(\mathbf{x}_{t},t)-\frac{1}{2}g(t)^{2}\nabla_{\mathbf{x}_{t}}\log q_{t}(\mathbf{x}_{t})\ ,\qquad\mathbf{x}_{1}\sim q_{1}\ , (2) both having the same time-marginals q_{t} as the forward process. In practice, the score is approximated by a score model \mathbf{s}_{\theta}(\mathbf{x}_{t},t) , and a simple distribution p_{1}\approx q_{1} is used as initial distribution at t=1 : \displaystyle\,\mathrm{d}\mathbf{x}_{t} \displaystyle=[\mathbf{f}(\mathbf{x}_{t},t)-g(t)^{2}\mathbf{s}_{\theta}(\mathbf{x}_{t},t)]\,\mathrm{d}t+g(t)\,\mathrm{d}\widetilde{\mathbf{w}}_{t}\qquad \displaystyle\mathbf{x}_{1} \displaystyle\sim p_{1} (3) \displaystyle\frac{\,\mathrm{d}\mathbf{x}_{t}}{\,\mathrm{d}t} \displaystyle=\mathbf{f}(\mathbf{x}_{t},t)-\frac{1}{2}g(t)^{2}\mathbf{s}_{\theta}(\mathbf{x}_{t},t)\quad \displaystyle\mathbf{x}_{1} \displaystyle\sim p_{1} (4) We will denote by \{p_{t}\}_{t\in[0,1]} the probability path induced by Eq. 3 or Eq. 4 . Equilibrium sampling of the Boltzmann distribution. A key challenge in statistical mechanics is to generate independent samples from the Boltzmann distribution \mathbf{x}\sim p(\mathbf{x})\propto\exp(-\beta U(\mathbf{x})), (5) where \beta=(k_{\textrm{B}}T)^{-1} is the inverse temperature and U(\mathbf{x}) is the potential energy of a configuration \mathbf{x}\in\Omega\subseteq\mathbb{R}^{d} . This distribution underlies estimation of macroscopic observables, such as \mathbb{E}_{p(\mathbf{x})}[O_{i}(\mathbf{x})] , which allow for a direct comparison to experimental data. However, sampling from p(\mathbf{x}) is notoriously difficult due to the rugged energy landscape U(\mathbf{x}) . Traditional methods such as Molecular Dynamics (MD) or Markov Chain Monte Carlo (MCMC) suffer from slow mixing and generate highly correlated samples that often fail to cross energy barriers between metastable states. This leads to biased estimates and poor coverage of transition configurations, i.e., regions in state space that are severely undersampled but mechanistically crucial. Recent work on Boltzmann Generators [ 61 , 42 , 56 , 43 , 57 , 81 ] addresses these challenges by learning direct mappings from simple priors to Boltzmann-like distributions. Yet, two issues remain: inaccuracies in the potential energy model can bias the learned distribution [ 46 , 41 ] , and physically important but low-probability states (e.g., transition states) remain exponentially rare. In this work, we address both problems by guiding a generative model using sparse experimental or structural information, leveraging a coarse-grained Boltzmann emulator inspired by Arts et al. 2023 . Maximum Entropy Reweighting is a broadly adopted technique to overcome force field inaccuracies in potential energy models [ 70 , 21 , 62 , 63 , 12 , 87 , 5 , 33 , 10 ] . The result of this optimization is a tilted distribution which depends on a set of Lagrange multipliers, \{\lambda_{i}\} , each corresponding to an experimental observable of interest. The solution p^{\prime}(\mathbf{x})\propto p(\mathbf{x})\exp\!\big(\!-\sum_{i=1}^{M}\lambda_{i}O_{i}(\mathbf{x})\big) minimizes the KL divergence from the reference distribution p(\mathbf{x}) , subject to the constraints \mathbb{E}_{p^{\prime}(\mathbf{x})}[O_{i}(\mathbf{x})]=o_{i} . A