On the Robustness of Langevin Dynamics to Score Function Error

Daniel Yiming Cao, August Y. Chen, Karthik Sridharan, Yuchen Wu · 2026

Read On the Robustness of Langevin Dynamics to Score Function Error by Daniel Yiming Cao, August Y. Chen, Karthik Sridharan, Yuchen Wu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-11319.txt.

Introduction

Daniel Yiming Cao and coauthors deliver a warning for score-based generative modeling: Langevin dynamics is not robust to small errors in the learned score function. Diffusion models tolerate small mean-square score errors and still sample faithfully under mild assumptions, which made estimated scores look safe to reuse. The authors show that even for simple high-dimensional distributions, Langevin runs of any polynomial length land far from the target in total variation distance, however tiny the score error. The result cautions against Langevin sampling with learned scores.

Catalog record

CREATORDaniel Yiming Cao, August Y. Chen, Karthik Sridharan, Yuchen Wu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE85114
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.11319

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

On the Robustness of Langevin Dynamics to Score Function Error Daniel Yiming Cao, August Y. Chen, Karthik Sridharan, Yuchen Wu Abstract We consider the robustness of score-based generative modeling to errors in the estimate of the score function. In particular, we show that Langevin dynamics is not robust to the L 2 L^{2} errors (more generally L p L^{p} errors) in the estimate of the score function. It is well-established that with small L 2 L^{2} errors in the estimate of the score function, diffusion models can sample faithfully from the target distribution under fairly mild regularity assumptions in a polynomial time horizon. In contrast, our work shows that even for simple distributions in high dimensions, Langevin dynamics run for any polynomial time horizon will produce a distribution far from the target distribution in Total Variation (TV) distance, even when the L 2 L^{2} error (more generally L p L^{p} ) of the estimate of the score function is arbitrarily small. Considering such an error in the estimate of the score function is unavoidable in practice when learning the score function from data, our results provide further justification for diffusion models over Langevin dynamics and serve to caution against the use of Langevin dynamics with estimated scores. † † Alphabetical ordering. Emails: {[email protected], [email protected], [email protected], [email protected]} 1 Introduction Many sampling algorithms ubiquitous in statistics and Machine Learning (ML) – used from Bayesian inference to modern generative modeling – are score-based sampling algorithms. These sampling algorithms are widely used in a range of scientific and engineering applications, such as image generation (see e.g. Croitoru et al. 2023 ), inverse problems in applied mathematics (e.g. Sanz-Alonso et al. 2023 ), physical sciences (e.g. Zheng et al. 2025 ), protein design and computational biology (e.g. Guo et al. 2024 ), and medical image reconstruction (e.g. Chung et al. 2022 ). Many such score-based or related sampling algorithms exist. An incomplete list includes Langevin dynamics (see e.g. Welling and Teh 2011 ; Durmus et al. 2018 ; Chewi 2025 ), diffusion models (e.g. Ho et al. 2020 ; Song and Ermon 2019 ; Song et al. 2021a ; Song and Ermon 2020 ; Song et al. 2021b for some foundational early works), flow matching (e.g. Lipman et al. 2023 ), and stochastic interpolants (e.g. Albergo et al. 2025 ). Among these sampling algorithms, we investigate Langevin dynamics and diffusion models. Langevin dynamics is a classical technique for sampling from target distributions in statistics and ML, while diffusion models are a modern, popular and effective method for generative AI. At a high level, these algorithms approximately sample from a target distribution \pi_{\rm tar} in \mathbb{R}^{d} by running a stochastic process driven by the score function \nabla\log\pi_{\rm tar} in the case of Langevin dynamics, or a suitable sequence of score functions \nabla\log\pi_{0},\nabla\log\pi_{1},\ldots,\nabla\log\pi_{k} (the annealed score functions ) in the case of diffusion models, where \pi_{0}\approx\pi_{\rm tar} and \pi_{0},\ldots,\pi_{k} forms a gradually noised version of the target distribution \pi_{\rm tar} . The continuous-time idealization of both these processes converges to \pi_{\rm tar} under mild assumptions on \pi_{\rm tar} , see Section 2.2 . Our focus: In generative modeling applications, the score functions \nabla\log\pi_{\rm tar} or \nabla\log\pi_{0} , \nabla\log\pi_{1} , \ldots , \nabla\log\pi_{k} are not explicitly known and must be estimated from data (from \pi_{\rm tar} ). This is done in practice by score matching : training a suitable parametric model (e.g., neural network) to learn these functions from data, by minimizing a suitable L^{2} or similar loss. See, e.g., Ho et al. 2020 ; Song and Ermon 2019 ; Song et al. 2021a ; Song and Ermon 2020 ; Song et al. 2021b ; Karras et al. 2022 ; Chen et al. 2023b for diffusion models, and Koehler et al. 2023 ; Pabbaraju et al. 2023 ; Koehler and Vuong 2024 ; Koehler et al. 2025 for Langevin dynamics. This yields estimates of the score function(s) that are accurate in, e.g., L^{2} . It is a priori unclear whether running Langevin dynamics or diffusion models with these estimates – as done in practice – leads to faithful samples from the target \pi_{\rm tar} as happens with the respective idealized continuous-time processes. This motivates the fundamental question: Main Question: Is small L^{2} (or more generally L^{p}) score estimation error with respect to \pi_{\rm tar} sufficient for the success of score-based sampling algorithms? This question has been answered affirmatively in the context of diffusion models (see e.g. Chen et al. 2023a ; Benton et al. 2024 ; Li et al. 2024 ; Liang et al. 2025 among many more works) for general target distributions \pi_{\rm tar} with bounded second moment. Here we emphasize that this result for diffusion models assumes that a suitable weighted average of the L^{2} score estimation errors of all of \nabla\log\pi_{0},\nabla\log\pi_{1},\ldots,\nabla\log\pi_{k} (with respect to \pi_{0},\pi_{1},\ldots,\pi_{k} respectively) is small, rather than just small L^{2} estimation error of \nabla\log\pi_{\rm tar} . In particular, let \widehat{\pi}_{\rm tar} denote the output distribution. With an estimated score s and appropriate discretization, it is known that within a number of iterations polynomial in d , the sampling error scales linearly with the L^{2} score estimation error: \displaystyle\mathrm{TV}(\pi_{\rm tar},\widehat{\pi_{\rm tar}})\lesssim\varepsilon_{\rm score}, where \mathrm{TV} is Total Variation (TV) distance and \varepsilon_{\rm score}^{2} is a suitable weighted average of the L^{2} score estimation errors of \nabla\log\pi_{0},\nabla\log\pi_{1},\ldots,\nabla\log\pi_{k} with respect to \pi_{0},\pi_{1},\ldots,\pi_{k} respectively. Such a result justifies the empirical success of diffusion models run with estimated score functions, such as those learned via score matching. In sharp contrast, the Main Question has not been answered for Langevin dynamics . For an overview of related work: • Several works such as Das et al. 2023 ; Huang et al. 2024 have studied the robustness of Langevin dynamics to L^{\infty} bounds on the score estimate \hat{s} . However L^{\infty} bounds on the score function error do not arise naturally when learning the score estimate \hat{s} from data in practice with score matching. Indeed, L^{2} and more generally L^{p} bounds on score estimation error with respect to \pi_{\rm tar} are more realistic ( Chen et al. 2023a ; Koehler and Vuong 2024 ; Koehler et al. 2025 ) . 1 1 1 In this paper, L^{2} and more generally L^{p} norms are implicitly taken with respect to \pi_{\rm tar} unless stated otherwise. As per Chen et al. 2023a , we cannot hope to learn the score in regions not well-covered by the data. We note Lee et al. 2022 studies the robustness of Langevin dynamics with L^{2} error bounds on \hat{s} (their Theorem 2.1). However, their Theorem 2.1 requires an error bound that is often exponentially small in dimension , depending on the \chi^{2} -divergence between the initialization and \pi_{\rm tar} . 2 2 2 This \chi^{2} -divergence is e^{\Omega(d)} for many natural initializations, such as those we consider here. This is not a suitable assumption for generative modeling where one learns the score function to a prescribed constant error in extremely high-dimensional problems, as per e.g. Song and Ermon 2019 ; Song and Ermon 2020 ; Karras et al. 2022 . Lee et al. 2022 noted informally that this dependence on L^{2} score matching error, often exponential in d , is needed. Formalizing this remark into a proof

Read the complete text