Diffusion models learn distributions generated by complex Langevin dynamics

Kai Zhou · 2024

Read Diffusion models learn distributions generated by complex Langevin dynamics by Kai Zhou (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-01919.txt.

Introduction

Diaa Habibi and co-authors ask if AI diffusion models can learn the output of a tricky physics process in a paper from 2024. The process, complex Langevin dynamics, is used for theories with a sign problem. What spread of values it truly samples is not known in advance and is hard to pin down.

Diffusion models learn spreads of data by example. The team trained one on data from the Langevin process. They then checked how well the model matched the true spread. Success would give physicists a new way to study such systems. The work links modern generative AI with hard problems in quantum field theory.

Catalog record

CREATORKai Zhou
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-01919

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Diffusion models learn distributions generated by complex Langevin dynamics Kai Zhou Abstract The probability distribution effectively sampled by a complex Langevin process for theories with a sign problem is not known a priori and notoriously hard to understand. Diffusion models, a class of generative AI, can learn distributions from data. In this contribution, we explore the ability of diffusion models to learn the distributions created by a complex Langevin process. [a]Diaa E. Habibi 1 Introduction Theories with a complex Boltzmann weight are hard to simulate using conventional numerical methods based on importance sampling, due to the sign and overlap problems [ 1 ] . A prime example is QCD at nonzero baryon density, in which the quark determinant is complex for real quark chemical potential [ 2 , 3 ] , \left[\det M(\mu)\right]^{*}=\det M(-\mu^{*})\in\mathbb{C}. (1) Complex Langevin (CL) dynamics, in which the degrees of freedom are analytically extended, provides a potential solution, as it does not rely on importance sampling but explores a complexified manifold via a stochastic process [ 4 , 5 ] . It is an extension of stochastic quantisation [ 6 , 7 ] , which is equivalent to path integral quantisation. CL has been shown to work in lattice field theories in three [ 8 ] and four [ 9 ] Euclidean dimensions with a severe sign problem, including in QCD [ 10 , 11 , 12 , 13 , 14 ] , but it may also fail, even in simple models [ 15 , 16 , 17 ] . This situation was clarified a few years ago [ 18 , 19 , 20 ] by the derivation of the formal relation between the complex distribution on the real manifold and the real and positive distribution on the complexified manifold, which is effectively sampled during the CL process, leading to practical criteria for correctness which need to be verified a posteriori. Nevertheless, issues remain and the reliability of the method depends on a precise understanding of the behaviour of the distribution at infinity and near poles in the CL drift. Recent work can be found in e.g. Refs. [ 21 , 22 , 23 , 24 , 25 ] . As should be clear, a crucial role is played by the distribution on the complexified manifold. Unfortunately, this distribution turns out to be elusive, as the Fokker-Planck equation (FPE) linked to the CL process cannot be solved in general. In fact, even convergence is hard to understand, except in some simple cases, such as Gaussian models [ 26 ] and models in which one can prove the dynamics takes place in a strip (see below) [ 27 ] . A better characterisation of the distribution would therefore be welcome. Diffusion models [ 28 , 29 , 30 , 31 , 32 , 33 , 34 ] are a class of generative AI, which learn distributions from data. They are widely popular and used in e.g. DALL-E [ 35 ] and Stable Diffusion [ 36 ] . The methodology of diffusion models relies on a stochastic process, similar to stochastic quantisation, but instead of using a known drift term derived from the underlying distribution, it learns the drift from data previously generated or collected. We have recently explored the relation between diffusion models and stochastic quantisation in scalar [ 37 , 38 ] and U(1) gauge theories [ 39 ] , and studied the evolution of higher-order cumulants in detail [ 40 ] . Further connections between diffusion models and field theory are pointed out in Refs. [ 41 , 42 ] . Given the success of diffusion models to learn distributions and the elusiveness of the distribution sampled in the CL process, it makes sense to combine these two approaches to deepen our understanding of the latter. In the next two sections we first remind the reader of CL dynamics for theories with a complex Boltzmann distribution and then briefly introduce diffusions models. In Sec. 4 we then combine these in two simple cases with a single degree of freedom: the exactly solvable Gaussian case with a complex mass parameter, and the quartic model with a complex mass parameter, for which the distribution can be proven to be confined to a strip in the complex plane. 2 Complex Langevin dynamics Consider one degree of freedom x , with a Boltzmann weight \rho(x) , such that \langle O(x)\rangle=\int dx\,\rho(x)O(x),\qquad\quad\rho(x)=\frac{1}{Z}\exp[-S(x)],\qquad\quad Z=\int dx\,\rho(x). (2) The Langevin process and drift read \dot{x}(t)=K[x(t)]+\eta(t),\qquad\quad K(x)=\frac{d}{dx}\log\rho(x)=-\frac{dS(x)}{dx}, (3) where the dot indicates the Langevin time derivative and the noise satisfies \langle\eta(t)\eta(t^{\prime})\rangle=2\delta(t-t^{\prime}) . The corresponding FPE is \partial_{t}\rho(x;t)=\partial_{x}\left[\partial_{x}-K(x)\right]\rho(x;t), (4) and for a real Boltzmann weight and drift this process converges to the stationary solution \rho(x) , typically exponentially fast [ 7 ] . When the weight is complex, one may extend x\to z=x+iy into the complex plane and write \dot{z}(t)=K[z(t)]+\eta(t),\qquad\quad K(z)=\frac{d}{dz}\log\rho(z)=-\frac{dS(z)}{dz}. (5) However, in this case the FPE cannot be used to show convergence as the corresponding Fokker-Planck Hamiltonian is no longer semi-positive definite [ 7 ] . We may consider the CL process, \displaystyle\dot{x}(t)=K_{x}+\eta_{x}(t), \displaystyle\qquad\quad K_{x}=\mbox{Re}\,\frac{d}{dz}\log\rho(z),\qquad\langle\eta_{x}(t)\eta_{x}(t^{\prime})\rangle=2N_{x}\delta(t-t^{\prime}), (6) \displaystyle\dot{y}(t)=K_{y}+\eta_{y}(t), \displaystyle\qquad\quad K_{y}=\mbox{Im}\,\frac{d}{dz}\log\rho(z),\qquad\langle\eta_{y}(t)\eta_{y}(t^{\prime})\rangle=2N_{y}\delta(t-t^{\prime}), (7) with noise satisfying N_{x}-N_{y}=1 . The FPE equation for this process reads \partial_{t}P(x,y;t)=\left[\partial_{x}\left(N_{x}\partial_{x}-K_{x}\right)+\partial_{y}\left(N_{y}\partial_{y}-K_{y}\right)\right]P(x,y;t), (8) such that \langle O[x(t)+iy(t)]\rangle_{\eta}=\int dxdy\,P(x,y;t)O(x+iy). (9) It is preferable to consider real noise, N_{x}=1,N_{y}=0 [ 18 ] . The CL process yields the correct answer if a stationary solution to this FPE exists, such that \int dxdy\,P(x,y)O(x+iy)=\int dx\,\rho(x)O(x), (10) or, shifting the integration variables at a formal level, \rho(x)=\int dy\,P(x-iy,y). (11) Considerable effort has been invested in deriving criteria for correctness related to the behaviour of P(x,y) at infinity and near poles of the drift (if there are any), which can be used a posteriori to justify the results [ 18 , 19 , 20 , 21 , 22 , 23 , 24 , 25 ] . A better understanding of P(x,y) in the stationary limit would therefore be very welcome. We emphasise that unlike the original weight \rho(z) , P(x,y;t) is real and semi-positive definite, as it represents the real Langevin process in the two-dimensional plane. 3 Diffusion models Diffusion models, as a class of probabilistic generative models, gradually corrupt data with incrementally increasing noise and are trained to reverse the process to build a generative model of the data [ 28 , 29 , 30 , 31 , 32 ] . We use the description in terms of stochastic differential equations (SDEs) [ 31 , 33 , 34 ] and follow the notation of Ref. [ 40 ] . The diffusion process consists of two parts. The noise-injecting or forward process is described by the following SDE, \dot{x}(t)=K(x(t),t)+g(t)\eta(t), (12) where K(x(t),t) is a drift term, \eta\sim\mathcal{N}(0,1) is Gaussian noise and g(t) , the diffusion coefficient, is the time-dependent noise strength. The initial conditions for this process are determined by the target distribution x(0)=x_{0}\sim P_{0}(x_{0}) and the process runs between 0\leq t\leq T . Properties of the distribution at the end of this process, P(x,T) , have been studied in Ref. [ 40 ] . The second part corresponds to the denoising or backward process. Written in terms of reverse time \tau=T-t , the SDE reads [ 43 ] x^{\prime}(\tau)=-K(x(\tau),T-\tau)+g^{2}(T-\tau)\partial_{x}\log P(x,T-\tau)+g(T-\tau)\eta(\tau), (13) with 0\leq\tau\leq T . Initial conditions

Read the complete text