Non-asymptotic Analysis of Diffusion Annealed Langevin Monte Carlo for Generative Modelling

Paula Cordero-Encinar, Ö. Deniz Akyildiz, Andrew B. Duncan · 2025

Read Non-asymptotic Analysis of Diffusion Annealed Langevin Monte Carlo for Generative Modelling by Paula Cordero-Encinar, Ö. Deniz Akyildiz, Andrew B. Duncan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-09306.txt.

Introduction

Paula Cordero-Encinar, Deniz Akyildiz, and Andrew Duncan supply error guarantees for a sampling method behind a family of generative models. Diffusion annealed Langevin Monte Carlo walks a chain of distributions from a simple starting shape to the data distribution. Theory for the method had gaps, especially outside neat assumptions.

The authors prove non-asymptotic error bounds under weak conditions on the data distribution, for paths built by Gaussian blurring as in diffusion models. They then extend the analysis to heavy-tailed paths based on the Student's t distribution, giving the first guarantees of that kind for heavy-tailed data. The results frame score-based generation more broadly than the standard noising process does.

Catalog record

CREATORPaula Cordero-Encinar, Ö. Deniz Akyildiz, Andrew B. Duncan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE160 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-09306

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Non-asymptotic Analysis of Diffusion Annealed Langevin Monte Carlo for Generative Modelling Paula Cordero-Encinar, Ö. Deniz Akyildiz, Andrew B. Duncan Abstract We investigate the theoretical properties of general diffusion (interpolation) paths and their Langevin Monte Carlo implementation, referred to as diffusion annealed Langevin Monte Carlo ( DALMC ) , under weak conditions on the data distribution. Specifically, we analyse and provide non-asymptotic error bounds for the annealed Langevin dynamics where the path of distributions is defined as Gaussian convolutions of the data distribution as in diffusion models. We then extend our results to recently proposed heavy-tailed (Student’s t t ) diffusion paths, demonstrating their theoretical properties for heavy-tailed data distributions for the first time. Our analysis provides theoretical guarantees for a class of score-based generative models that interpolate between a simple distribution (Gaussian or Student’s t t ) and the data distribution in finite time . This approach offers a broader perspective compared to standard score-based diffusion approaches, which are typically based on a forward Ornstein-Uhlenbeck (OU) noising process. 1 Introduction Score-based generative models (SGMs) [ Song et al. 2021 ; Ho et al. 2020 ] have become immensely popular in recent years due to their excellent performance in generating high-quality data. This success has led to widespread adoption across various generative modelling tasks, e.g., image generation [ Dhariwal and Nichol 2021 ; Rombach et al. 2022 ; Saharia et al. 2022 ] , audio generation [ Ruan et al. 2023 ] , reward maximisation [ Janner et al. 2022 ; He et al. 2023 ] . Additionally, their remarkable performance has sparked significant interest within the theoretical community to better understand the structure and properties of these models [ Lee et al. 2022 ; Chen et al. 2022 ; Chen et al. 2023 ; Benton et al. 2024 ] . The goal of generative modelling is to learn the underlying probability distribution \pid from a given set of samples. Diffusion models, a particular class of SGMs , achieve this by using a forward process , typically an OU process, to construct a path of probability distributions from the data distribution towards a simpler one – a Gaussian. The time-reversed process can be characterised [ Anderson 1982 ] but necessitates the knowledge of the scores of the marginal distributions along this path. These scores are usually intractable - hence they are learnt by noising the data and applying score matching techniques [ Hyvärinen and Dayan 2005 ; Vincent 2011 ; Song et al. 2020 ] . The learnt scores are then used to sample from the path by discretising the time-reversed diffusion process [ Song et al. 2021 ] . (a) Geometric path (b) Diffusion path Figure 1 : A visual comparison of the geometric path versus the diffusion path for (\mu_{t})_{t\in[0,1]} . The base distribution is given by \mu_{0}:=\mathcal{N}(0,1) and the data distribution, \mu_{1}:=\pid , is a mixture of a Gaussian and a smoothed uniform distribution (see Section 3 ). As observed by Chehab et al. 2025 , the geometric path in (a) creates intermediate multimodal distributions which are hard to sample from. In contrast, the diffusion path in (b) stays unimodal throughout, offering more favourable properties. While the forward OU process is mathematically convenient, it does not capture the whole idea of bridging distributions and requires infinite time to interpolate between the data distribution \pid and a Gaussian measure. In practice, however, diffusion models consider the evolution of the OU process only up to a finite final time T . Thus, the path does not fully bridge \pid and a standard Gaussian. During generation, these models instead evolve samples along a sequence of interpolated distributions between the final marginal distribution of the OU process at time T and \pid (although, in practice, they are initialised from a Gaussian). Specifically, this interpolation is characterised by defining intermediate random variables X_{t}\sim\mu_{t} 1 1 1 In our case, the base (simple) distribution is defined at time 0 as \mu_{0} , and the data distribution is defined at time T , \mu_{T}=\pid . This contrasts with standard diffusion models where the base distribution is defined at time T and the data distribution at time 0 . [ Chehab and Korba 2024 ] as \displaystyle X_{t}=\sqrt{\lambda_{t}}X+\sqrt{1-\lambda_{t}}Z, (1) for t\in[0,T] , where X\sim\pi_{\text{data}} , Z\sim\mathcal{N}(0,I) is independent of X and a schedule \lambda_{t}=\min\{1,e^{-2(T-t)}\} . The interpolation perspective of diffusion models has been investigated, see, e.g., Albergo et al. 2023 ; Gao et al. 2024 . Notably, the path in Eq. ( 1 ) is a special case of the one-sided stochastic interpolants [ Albergo et al. 2023 ] . As outlined in these works, the reverse process can be made to exactly interpolate between a base distribution \nu and \pi_{\text{data}} in finite time by using an appropriate schedule \lambda_{t} and introducing control terms in the corresponding stochastic differential equations (SDEs) . Similarly to the score term in diffusion models, these control terms are intractable and need to be learnt. In this work, we adopt a practical approach to general linear interpolation paths between a simple base distribution \nu and \pi_{\text{data}} , that is, X_{t}=\sqrt{\lambda_{t}}X+\sqrt{1-\lambda_{t}}Z , where X\sim\pid , Z\sim\nu independent of X and \lambda_{t}\in[0,1] , \lambda_{T}=1 . In particular, we explore the behaviour of Langevin dynamics driven by the gradients of \log\mu_{t} for t\in[0,T] , where \mu_{t} are the intermediate distributions, i.e., X_{t}\sim\mu_{t} . Our approach is akin to earlier generative modelling methods based on annealed Langevin dynamics [ Song and Ermon 2019 ] which led to the development of diffusion models. However, there has been limited work analysing these methods under minimal assumptions on \pid . Block et al. 2022 provide the first theoretical analysis in Wasserstein distance under smoothness and dissipativity of the data distribution. They show that the error depends exponentially on the dimension. In contrast, Lee et al. 2022 provides a non-asymptotic bound in total variation under smoothness conditions and a bounded log-Sobolev constant of the data distribution. Specifically, we make the following contributions. Contributions • We provide an analysis of annealed Langevin dynamics methods driven by general linear interpolation paths between \nu and \pi_{\text{data}} , which we term diffusion annealed Langevin Monte Carlo ( DALMC ). In the case where \nu is a Gaussian distribution, we derive non-asymptotic convergence bounds in Kullback-Leibler (KL) divergence under different assumptions. By assuming that \pid has a finite second-order moment M_{2} , \log\pid has Lipschitz gradients and either \pid is strongly convex outside a ball or \nabla^{2}\log\pid decays to 0 sufficiently fast (as is the case for Student’s t -like distributions), we show in Corollary 3.5 that DALMC requires \mathcal{O}\left(\frac{d(M_{2}\vee d)^{2}L_{\max}^{2}}{\varepsilon^{6}}\right) steps to achieve \varepsilon^{2} -accurate sampling from \pid in KL divergence with a sufficiently accurate score estimator. Here, d is the dimension of the data and L_{\max}:=\max_{t\in[0,T]}L_{t} where L_{t} denotes the Lipschitz constant of \nabla\log\mu_{t} , which we prove to be finite in Lemma 3.2 , improving the results of Gao et al. 2024 under the specified conditions. Furthermore, under slightly less restrictive assumptions involving smoothness of \pid with constant L_{\pi} , bounded second order moment M_{2} and \mathbb{E}_{\pid}\left\|\nabla\log\pid\left(Y\right)\right\|^{8}\leq K_{\pi}^{2} , we demonstrate that the data distribution can be approximated to \varepsilon^{2} -accuracy in KL divergence with \mathcal{O}\left(\frac{(M_{2}\vee d)^{2}(d^{2}\vee L_{\pi}^{2}d\vee K_{\pi})L_{\pi}}{\varepsilon^{6}}\right) steps. To

Read the complete text