Sampling Boltzmann distributions via normalizing flow approximation of transport maps

Zia Ur Rehman, Gero Friesecke · 2026

Read Sampling Boltzmann distributions via normalizing flow approximation of transport maps by Zia Ur Rehman, Gero Friesecke (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-14258.txt.

Introduction

Rehman and Friesecke put flow-based sampling of Boltzmann distributions on firm math ground. A 2019 method by Noé and co-authors samples such distributions by learning a transport map with a normalizing flow. The authors prove a flow exists that matches the true distribution to any set error in Wasserstein distance. The proof covers rough molecular cases with Coulomb and Lennard-Jones forces. Tests on a toy system and the alanine dipeptide molecule confirm the closeness in practice.

Catalog record

CREATORZia Ur Rehman, Gero Friesecke
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36315
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2603.14258

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Sampling Boltzmann distributions via normalizing flow approximation of transport maps Zia Ur Rehman, Gero Friesecke Abstract In a celebrated paper [ NOKW19 ] , Noé, Olsson, Köhler and Wu introduced an efficient method for sampling high-dimensional Boltzmann distributions arising in molecular dynamics via normalizing flow approximation of transport maps. Here, we place this approach on a firm mathematical foundation. We prove the existence of a normalizing flow between the reference measure and the true Boltzmann distribution up to an arbitrarily small error in the Wasserstein distance. This result covers general Boltzmann distributions from molecular dynamics, which have low regularity due to the presence of interatomic Coulomb and Lennard-Jones interactions. The proof is based on a rigorous construction of the Moser transport map for low-regularity endpoint densities and approximation theorems for neural networks in Sobolev spaces. Numerical simulations for a simple model system and for the alanine dipeptide molecule confirm that the true and generated distributions are close in the Wasserstein distance. Moreover we observe that the RealNVP architecture does not just successfully capture the equilibrium Boltzmann distribution but also the metastable dynamics. 1 Introduction Our goal in this paper is to put the recent method of Noé et al. [ NOKW19 ] for sampling from high-dimensional Boltzmann distributions on a firm mathematical footing. Sampling from Boltzmann distributions is of great interest in computational physics, chemistry, and biochemistry, because the conformations of a molecule are described by the dominant regions of the associated Boltzmann distribution. Sampling from this distribution is challenging for two reasons: first, the configuration space on which the distribution lives is high-dimensional, of dimension 3N , where N is the number of atoms in the molecule. Second, trajectory methods, i.e. using long-time samples of solutions of the underlying Langevin stochastic differential equation, while in principle correct, are expensive; this is because trajectories typically get trapped for a long time in metastable regions separated by energetic or entropic barriers, leading to very long simulation times for sufficient exploration of the configuration space. Traditional approaches to this sampling problem include Markov state models [ CSPD07 ] , metadynamics [ LP02 ] , and umbrella sampling [ TV77 ] . While useful, these methods often either require careful hand-tuning of collective variables or suffer from high computational cost in high dimensions. A novel approach based on ideas from machine learning was introduced in a pioneering paper by Noé et al. [ NOKW19 ] , who proposed Boltzmann generators —invertible neural networks (normalizing flows) trained to map an easy-to-sample reference distribution (or prior) on the high-dimensional configuration space, for instance a Gaussian, to the target Boltzmann distribution. Note that, unlike in standard approaches in machine learning for approximating high-dimensional distributions, the domain of the prior is not dimension-reduced. Once the flow is trained, a single forward pass through the flow of statistically independent samples drawn from the prior yields statistically independent equilibrium samples. This bypasses long-time stochastic trajectories and enables efficient exploration of metastable states. This approach builds on the rapid development of normalizing flows [ DSDB17 , KD18 , PNR+21 ] and deep generative modeling for physical systems [ HBG+19 , WMPN18 ] . Despite impressive empirical successes, a mathematical foundation of flow-based Boltzmann sampling is hitherto missing. Several open questions present themselves: • Dealing with singularities: Physical Boltzmann distributions vanish on the collision set where two atoms collide, due to the singularities of the underlying Coulomb and Lennard-Jones potentials. Such zero regions, in turn, prevent the existence of smooth transport maps (for a proof of this interesting phenomenon see section 3 ). Thus it is not even clear whether any transport map exists between the Gaussian reference and the Boltzmann distribution which belongs to the regularity classes covered by expressivity results for neural networks. • Indeterminacy: Even if singularities are absent or have been removed by some controlled approximation, the transport condition is highly degenerate. Which of the infinite-dimensionally many transport maps should be targeted for theoretical approximation results (and practical training)? • Approximability by normalizing flows: Because of the need to efficiently evaluate the Jacobian of the transport map, a suitable class of neural networks is given by normalizing flow architectures such as RealNVP [ DSDB17 ] . Do these architectures possess sufficient expressive power to approximate the required transport maps between low-regularity densities well enough to produce correct samples? The first problem is overcome by a simple regularization of the underlying molecular potential in high-energy regions, which entails a controlled L^{1} error on the Boltzmann distribution. See section 3 . Regarding the second problem, a natural idea would be to use the Brenier map supplied by optimal transport theory [ Bre91 , Vil03 , Fri24 ] . For image generation, methods based on the Brenier maps from Gaussian noise to subsets of training images have proven useful [ LCBH+23 , LGL23 , CHSW25 , TMF+23 , PNS+23 ] . Neural network based solvers for more general optimal transport problems have been introduced in [ KLG+21 , UC23 ] , based on input convex eural networks (ICNNs) respectively multi-layer perceptrons (MLPs). But the Brenier map, and the underlying flow, are not easy to compute between continuous distributions in high dimensions, and known regularity results for the map [ Caf91 , DPF11 ] require strong assumptions on the densities. We therefore focus on a related but easier-to-compute and more regular transport map between continuous distributions, namely the Dacorogna-Moser map, and its underlying flow. We generalize its classical construction [ Mos65 , DM90 ] from smooth densities to low-regularity densities (see Theorem 2 a)). We remark that for a uniform reference density, the governing problem correponds to a linearization of the optimal transport problem [ Fri24 ] . The practical question of how to efficiently bias the learning of the flow towards the Dacorogna-Moser flow lies beyond the scope of this paper. Finally, the third problem, rigorous approximability, is addressed in Theorem 2 c). We prove that the Moser map between continuously differentiable, everywhere positive densities can be approximated by normalizing flow architechtures such as RealNVP in the Sobolev space W^{1,p} . Combining these results yields existence of a normalizing flow between the reference measure and the true Boltzmann distribution of a molecular system up to an arbitrarily small error in the Wasserstein distance (see Theorem 4 ), thus providing a theoretical guarantee that the Boltzmann generator method gives correct samples. Numerical simulations for a simple synthetic system and for the alanine dipeptide molecule (see section 6.1 and 6.2 ) confirm that the learned flows yield correct samples reproducing the equilibrium densities. 2 Molecular dynamics at thermal equilibrium In equilibrium molecular dynamics, the state of a many-body system can be described by the Boltzmann probability distribution d\rho(x)=\frac{1}{Z}\exp\Bigl(-\frac{U(x)}{\kappa_{B}T}\Bigr)\mathrm{d}x, (1) where x=(x_{1},...,x_{N}) with x_{i}\in{\mathbb{R}}^{3} denoting the position of the i -th atom, \kappa_{B} is a physical constant, T is the temperature, and U is the potential energy function of the system. One assumes that the position vector x of all atoms is confined to some bounded domain D\subset{\mathbb{R}}^{3N} , and Z is a normalization constant so that \int_{D}\rho=1 . The potential energy function is typically taken to be of the form \displaystyle U(x)= \displaystyle\sum_{\ell_{ij}\text{ bond lengths}}b_{ij}(\ell_{ij}-\overline{\ell_{ij}})^{2}+\sum_{\alpha_{ijk}\text{ bond angles}}a_{ijk}(\alpha_{ijk}-\overline{\alpha_{ijk}})^{2} (2) \displaystyle+\sum_{\phi_{ijkl}\text{ torsion angles}}\sum_{n=1}^{n_{max}}\kappa_{ijkl,n}\left[1+\cos(n\phi_{ijkl}-\overline{\phi_{ijkl,n}})\right] \displaystyle+\sum_{i,j}\frac{q_{i}q_{j}}{|x_{i}-x_{j}|}+\sum_{i,j}\left(\frac{A_{ij}}{|x_{i}-x_{j}|^{12}}-\frac{B_{ij}}{|x_{i}-x_{j}|^{6}}\right),

Read the complete text