A Sharp KL-Convergence Analysis for Diffusion Models under Minimal Assumptions

Nishant Jain Tong Zhang University of Illinois Urbana-Champaign · 2025

Read A Sharp KL-Convergence Analysis for Diffusion Models under Minimal Assumptions by Nishant Jain Tong Zhang University of Illinois Urbana-Champaign (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-16306.txt.

Introduction

Diffusion models build images by reversing a slow noising process, and theory has lagged on how many steps that reversal truly needs. Jain and Zhang sharpen the error accounting under weak assumptions, with no smoothness demanded of the data. Their analysis splits each generation step into a clean reverse move plus a small fresh noising, which lets one kind of error be converted into another that is easier to bound.

The payoff is a step count that grows only linearly with the data's dimension and much more gently with the target accuracy than the best earlier result. The authors present the scheme as a cleaner route to guarantees for these widely used generators.

Catalog record

CREATORNishant Jain Tong Zhang University of Illinois Urbana-Champaign
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE94 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-16306

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Sharp KL-Convergence Analysis for Diffusion Models under Minimal Assumptions Nishant Jain Tong Zhang University of Illinois Urbana-Champaign Abstract Diffusion-based generative models have emerged as highly effective methods for synthesizing high-quality samples. Recent works have focused on analyzing the convergence of their generation process with minimal assumptions, either through reverse SDEs or Probability Flow ODEs. The best known guarantees, without any smoothness assumptions, for the KL divergence so far achieve a linear dependence on the data dimension d d and an inverse quadratic dependence on ε \varepsilon . In this work, we present a refined analysis that improves the dependence on ε \varepsilon . We model the generation process as a composition of two steps: a reverse ODE step, followed by a smaller noising step along the forward process. This design leverages the fact that the ODE step enables control in Wasserstein-type error, which can then be converted into a KL divergence bound via noise addition, leading to a better dependence on the discretization step size. We further provide a novel analysis to achieve the linear d d -dependence for the error due to discretizing this Probability Flow ODE in absence of any smoothness assumptions. We show that O ~ ​ ( d ​ log 3 / 2 ​ ( 1 δ ) ε ) \tilde{O}\left(\tfrac{d\log^{3/2}(\frac{1}{\delta})}{\varepsilon}\right) steps suffice to approximate the target distribution corrupted with Gaussian noise of variance δ \delta within O ⁡ ( ε 2 ) O(\varepsilon^{2}) in KL divergence, improving upon the previous best result, requiring O ~ ​ ( d ​ log 2 ​ ( 1 δ ) ε 2 ) \tilde{O}\left(\tfrac{d\log^{2}(\frac{1}{\delta})}{\varepsilon^{2}}\right) steps. 1 Introduction Recently, diffusion based models have picked up momentum for the trending generative modelling scenario. They are being extensively used for image-generation [ 29 , 7 , 24 , 26 , 25 , 28 , 12 ] , video-generation [ 8 , 5 ] , semantic editing [ 24 ] , generating text [ 22 ] or audio signals [ 23 ] , protein design analysis [ 10 , 11 ] and many other areas. The success of these diffusion models largely stems from their ability to generate high-quality samples using a denoising mechanism. This is achieved by defining a forward noising process that gradually perturbs data from the target distribution, during which a score function is learned. New samples are then generated by iteratively applying the reverse of this process, guided by the learned score function. The forward process can be modeled as a Stochastic Differential Equation (SDE) [ 30 ] , and consequently the generation can be carried out by simulating its reverse-time SDE through discretization. Corresponding to this reverse-time SDE, there also exists a Probability Flow Ordinary Differential Equation (ODE) [ 30 ] , which shares the same marginal distributions at all times. Consequently, two main approaches have emerged for sample generation: simulating the reverse SDE [ 30 , 4 ] and simulating this Probability Flow ODE [ 31 ] . Several works [ 4 , 6 , 13 , 1 , 20 ] have targetted the theoretical underpinnings behind the working of these diffusion models, under various assumptions. These have established polynomial convergence w.r.t. data dimension under accurate score estimation, smoothness of true score at all times, bounded support assumptions. A recent focus [ 2 , 20 , 1 ] is on further minimizing the assumptions and achieving good convergence just using the estimated score with error \tilde{O}(\varepsilon) . The best recent result [ 20 ] is achieving O(d/T) convergence rate w.r.t TV distance for the DDPM diffusion model [ 12 ] . A recent work [ 1 ] also achieved linear dependence on the data dimension for convergence w.r.t. KL divergence and requires \tilde{O}(\frac{d}{\varepsilon^{2}}) steps to achieve KL divergence within \varepsilon^{2} w.r.t. to Gaussian perturbation of the true data distribution. Since TV is bounded by square root of the KL divergence, it is an important issue to investigate whether a better convergence rate is achievable in the KL-divergence. Even though the linear dependence on d seems fine still the dependence on \frac{1}{\varepsilon^{2}} might not be optimal. In this work, we are interested in investigating the following question: Can we improve the dependence of the KL-divergence error on the \varepsilon and thereby arrive at the improved convergence rate for diffusion models? To achieve this goal, we explore the line of works [ 31 , 9 , 21 ] which consider the reverse Probability Flow ODE. This is motivated from the finding that we can have better discretization dependence for each interval when analysing the Wasserstein type error directly using the ODEs [ 3 ] . However, aggregating and bounding the error across all the intervals just based on this ODE requires additional assumptions either related to the error in Divergence [ 21 ] or the Jacobi [ 20 ] between the true and approximated score. Therefore, [ 3 ] instead considers smoothness of true and approximate score function at all times to bound the Wasserstein error in each interval using the reverse ODE and adds a noising step utilizing Langevin dynamics to then convert the Wasserstein error to TV. However, this noising via Langevin finally results in a suboptimal dependence on \varepsilon . Given the improved dependence on step size the reverse Probability Flow ODE can offer, we also consider using it but instead of additional assumptions or the Langevin dynamics, we just consider taking a smaller step in the forward (noising) direction. This way we are able to consider the error due to discretization on the reverse ODE and then convert it into KL error via the noise addition with a better dependence on step size for each interval, which can then be aggregated across all the intervals. This ODE step and a smaller noise step can be interpreted as an alternative simulation of the reverse SDE based generation process. The idea of noise addition along the forward process to convert the Wasserstein type error to KL is inspired from a recent work [ 15 ] which provided convergence analysis for the consistency model framework [ 27 ] . Unlike [ 3 ] , we consider the minimal assumptions scenario [ 2 , 1 ] and just consider the accurate score estimation assumption. To achieve an optimal d -dependence under this setup for our considered ODE path, we take inspiration from [ 1 ] (which considers the reverse SDE and by establishing equivalence to stochastic localization directly picks up a known result from the literature) and investigate additional relations between the score function and its Jacobian. Furthermore, as discussed in the paper, the analysis along this ODE path involves terms containing Laplacian of the score function along with the terms containing both score function and its Jacobian which makes the analysis more complicated than the SDE counterpart. By establishing the required novel relations between the score function and its higher order gradient terms, we are able to achieve the linear dependence on data dimension d for the ODE, matching the previous best result [ 1 ] . Due to our improved dependence on discretization step size, this results in a new state-of-the-art guarantee for the KL convergence requiring \tilde{O}(d/\varepsilon) iterations to achieve \varepsilon^{2}- KL divergence improving up

Read the complete text