Beyond Scores: Proximal Diffusion Models
Zhenghan Fang, Mateo Díaz, Sam Buchanan, Jeremias Sulam · 2025
Read Beyond Scores: Proximal Diffusion Models by Zhenghan Fang, Mateo Díaz, Sam Buchanan, Jeremias Sulam (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-08956.txt.
Introduction
Zhenghan Fang, Mateo Diaz, Sam Buchanan, and Jeremias Sulam replace the core ingredient of diffusion models in a 2025 study. Diffusion generators sample data by following the score, the gradient of log density at many noise levels. Denoisers supply estimates of that score, and a forward stepping scheme solves the reverse-time equation.
The authors instead step backward through the equation using proximal maps in place of scores. Recent results on proximal matching let them learn those maps from data. Their models promise theoretical and practical gains from the switch. The work widens the design space for a family of generators now used across images and other data.
Catalog record
| CREATOR | Zhenghan Fang, Mateo Díaz, Sam Buchanan, Jeremias Sulam |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 121 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-08956
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Beyond Scores: Proximal Diffusion Models Zhenghan Fang, Mateo Díaz, Sam Buchanan, Jeremias Sulam Abstract Diffusion models have quickly become some of the most popular and powerful generative models for high-dimensional data. The key insight that enabled their development was the realization that access to the score—the gradient of the log-density at different noise levels—allows for sampling from data distributions by solving a reverse-time stochastic differential equation (SDE) via forward discretization, and that popular denoisers allow for unbiased estimators of this score. In this paper, we demonstrate that an alternative, backward discretization of these SDEs, using proximal maps in place of the score, leads to theoretical and practical benefits. We leverage recent results in proximal matching to learn proximal operators of the log-density and, with them, develop Proximal Diffusion Models ( ProxDM ). Theoretically, we prove that 𝒪 ~ ( d / ε ) \widetilde{\mathcal{O}}(d/\sqrt{\varepsilon}) steps suffice for the resulting discretization to generate an ε \varepsilon -accurate distribution w.r.t. the KL divergence. Empirically, we show that two variants of ProxDM achieve significantly faster convergence within just a few sampling steps compared to conventional score-matching methods. 1 Introduction Within a remarkably brief period, diffusion models ( song2019generative ; ho2020denoising ) have overtaken generative artificial intelligence, emerging as the de facto solution across diverse domains including medical imaging ( Chung2022-bv ) , video ( Kong2020-hb ) and audio ( Ho2022-ab ) , drug discovery Corso2022-wi , and protein docking prediction ( Chu2024-cm ) . Diffusion models combine a forward diffusion process that converts the data distribution we wish to sample into noise and a reverse-time process that reconstructs data from noise. The forward process is easy to simulate by progressively adding noise to data. The reverse process, which allows for sampling data from noise, involves the so-called score function—the gradient of the log-density of the noisy data at any time point. Though unknown in general, such a score can be estimated by common denoising algorithms that approximate minimum mean-squared-error solutions. Various diffusion algorithms have been recently proposed ( song2020score ; Lu2022-hr ; wu2024stochastic ) , all relying on forward discretizations of the reverse stochastic differential equation, and allowing for impressive generative modeling performance. Despite these capabilities, current state-of-the-art diffusion-based methods face drawbacks: high-quality samples require a large number of model evaluations, which tends to be computationally expensive, and they are sensitive to hyperparameter choices and the lack of regularity of the data distribution ( salimans2022progressive ; karras2022elucidating ) . Naturally, computational cost, and sensitivity to hyperparameters and data regularity are not unique to diffusion models. Many numerical analysis and optimization algorithms grounded on forward discretizations of continuous-time processes share similar limitations. For instance, when optimizing a smooth convex function f , the go-to algorithmic solution, gradient descent (GD), which updates x_{+}\leftarrow x-h\nabla f(x) , represents a forward Euler discretization of gradient flow \dot{x}=-\nabla f(x) ( Ambrosio2008-xq ) . GD is known to converge when the learning rate h is on the order of 1/L where L is the gradient Lipschitz constant. Consequently, when f approaches nonsmoothness (i.e., L is large), GD must proceed with very small steps, thus converging slowly. Backward discretization schemes for continuous-time processes offer a potential remedy to these issues. For example, the backward Euler discretization for gradient flow updates iterates via the implicit equation x_{+}=x-h\nabla f(x_{+}) . This algorithm is known as the Proximal Point Method, and, remarkably, it converges for any positive h ( rockafellar1976monotone ) . The tradeoff is that x_{+} is defined implicitly, requiring solving an auxiliary sub-problem that is potentially as expensive as the original one. However, in the context of generative models, where f represents the log-density of data distribution, one could learn such an update directly from data via neural networks (instead of learning the score), making the per-step complexity of a backward discretization comparable to that of a forward discretization. This motivates the central question of this work. Can backward discretization improve diffusion models? In this paper, we give a partial affirmative answer to this question. We develop a diffusion sampler based on an implicit, backward discretization scheme of the reverse-time stochastic differential equation (SDE). Our approach leverages recent results that allow us to train proximal operators from data via proximal matching Fang2024-vk . We study two variants: one relying exclusively on backward discretization, and another hybrid approach that combines backward and forward terms. Our methods are competitive with score-based diffusion models—including those based on probability flow—when using a large number of discretization steps, while significantly outperforming them with fewer steps. Additionally, we provide supporting convergence theory that yields state-of-the-art rates under the idealized assumption of having access to the exact implicit update or proximal operator. Employing backward discretization of stochastic processes has been employed in both earlier ( pereyra2016proximal ; Bernton2018-dd ; durmus2018efficient ; wibisono2019proximal ; Salim2019-bz ; Lee2020-op ; shen2020composite ; hodgkinson2021implicit ) as well as more recent ( chen2022improvedb ; liang2022proximal ; fan2023improved ; liang2024proximal ; zhou2024proximal ; habring2024subgradient ; lau2024non ; liang2025characterizing ; mitra2025fast ; wibisono2025mixing ) works, mostly in the context of proximal version of Langevin dynamics. To our knowledge, no backward discretization has yet been explored for diffusion models. We defer a more thorough discussion of related works to after the introduction of the necessary background. 2 Background Diffusion and score-based generative models. Diffusion models perform generative modeling by posing a reversed stochastic differential equation (SDE) of a process that transforms a sample from the data distribution, X_{0}\sim p_{0} , X_{0}\in\mathbb{R}^{d} , into Gaussian noise ( song2019generative ; ho2020denoising ) . A widely adopted SDE for the forward process is given by \displaystyle dX_{t}=-\frac{1}{2}\beta(t)X_{t}dt+\sqrt{\beta(t)}dW_{t},\quad t\in[0,T]. (1) where W_{t} is a standard Wiener process in \mathbb{R}^{d} (i.e. standard Brownian motion) ( song2020score ) . At inference time, one can produce a new sample from p_{0} by reversing the SDE above, resulting in the stochastic process \displaystyle dX_{t}=\left[-\frac{1}{2}\beta(t)X_{t}-\beta(t)\nabla\ln p_{t}(X_{t})\right]dt+\sqrt{\beta(t)}d\bar{W}_{t}, (2) where \bar{W}_{t} is a standard Brownian motion (with time flowing backwards from T to 0 ). This process can be simulated as long as the score function, s_{t}(x)=\nabla\ln{p_{t}}(x) , can be computed (or approximated for unknown real-world distributions). The continuous-time process in ( 2 ) must be discretized to be implemented. By far, the most common strategy is applying the forward Euler-Maruyama discretization, leading to the score-based sampling algorithm: X_{k-1}=X_{k}+\gamma_{k}\left[\frac{1}{2}X_{k}+\nabla\ln p_{t_{k}}(X_{k})\right]+\sqrt{\gamma_{k}}z, (Euler-Maruyama) where \gamma_{k}=\beta(t_{k})(t_{k}-t_{k-1}) and z\sim\mathcal{N}(0,I) . Many variations of these processes have been proposed. For instance, instead of the variance-preserving formulation of the process in ( 1 ), one could instead consider a variance-exploding alternative (by removing the drift) ( song2019generative ; song2020score ) . Likewise, instead of considering stochastic processes, one can find deterministic ordinary differential equations (ODEs) that reverse the forward process and match the marginals of the reversed SDE, resulting in a probability-flow ODE ( song2020score ; song2020denoising ) . In order to apply these sampling algorithms for generative modeling on real-world data, corresponding score functions must be obtained for every distribution p_{t} . The popular score matching approach ( hyvarinen2005estimation ; song2019generative ; song2019sliced ; pang2020efficient ) learns parametric regression functions s_{\theta}(x,t) (with parameters \theta ) by minimizing the objective \displaystyle\underset{{t,X_{0},\varepsilon}}{\mathbb{E}}\left\{\lambda(t)\left\|s_{\theta}(X_{t},t)-\frac{-\varepsilon}{\sqrt{1-\alpha_{t}}}\right\|_{2}^{2}\right\}, (3) where X_{0}\sim p_{0} , \varepsilon\sim\mathcal{N}(0,I_{d}) , \alpha_{t}=\exp\left(-\int_{0}^{t}\beta(s)ds\right) , X_{t}=\sqrt{\alpha_{t}}X_{0}+\sqrt{1-\alpha_{t}}\varepsilon , and \lambda(t) is a function that weighs different terms (for