Adaptive Stochastic Coefficients for Accelerating Diffusion Sampling
Ruoyu Wang, Beier Zhu, Junzhi Li, Liangyu Yuan, Chi Zhang · 2025
Read Adaptive Stochastic Coefficients for Accelerating Diffusion Sampling by Ruoyu Wang, Beier Zhu, Junzhi Li, Liangyu Yuan, Chi Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-23285.txt.
Introduction
Ruoyu Wang, Beier Zhu, Junzhi Li, Liangyu Yuan, and Chi Zhang introduce AdaSDE, a faster sampler for diffusion generative models. Diffusion sampling solves a differential equation, and solvers trade speed against quality. Their theory shows ODE solvers build up irreducible gradient error, while SDE solvers amplify discretization error when steps are few.
AdaSDE is a single-step stochastic solver with adaptive coefficients that aims to unite ODE efficiency with SDE resilience. Smarter step sizes could cut the cost of image and media generation. The method targets the low-step regime where current samplers degrade most.
Catalog record
| CREATOR | Ruoyu Wang, Beier Zhu, Junzhi Li, Liangyu Yuan, Chi Zhang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-23285
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Adaptive Stochastic Coefficients for Accelerating Diffusion Sampling Ruoyu Wang, Beier Zhu, Junzhi Li, Liangyu Yuan, Chi Zhang Abstract Diffusion-based generative processes, formulated as differential equation solving, frequently balance computational speed with sample quality. Our theoretical investigation of ODE- and SDE-based solvers reveals complementary weaknesses: ODE solvers accumulate irreducible gradient error along deterministic trajectories, while SDE methods suffer from amplified discretization errors when the step budget is limited. Building upon this insight, we introduce AdaSDE , a novel single-step SDE solver that aims to unify the efficiency of ODEs with the error resilience of SDEs. Specifically, we introduce a single per-step learnable coefficient, estimated via lightweight distillation, which dynamically regulates the error correction strength to accelerate diffusion sampling. Notably, our framework can be integrated with existing solvers to enhance their capabilities. Extensive experiments demonstrate state-of-the-art performance: at 5 NFE, AdaSDE achieves FID scores of 4.18 4.18 on CIFAR-10, 8.05 8.05 on FFHQ and 6.96 6.96 on LSUN Bedroom. Codes are available in https://github.com/WLU-wry02/AdaSDE . $\star$ $\star$ footnotetext: Equal contribution. † Corresponding author. 1 Introduction Diffusion Models (DMs) [ 1 , 2 , 3 , 4 , 5 ] have revolutionized generative modeling, achieving state-of-the-art performance across a broad range of applications [ 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 ] . Rooted in non-equilibrium thermodynamics, DMs learn to reverse a diffusion process: data are first gradually corrupted by Gaussian noise in a forward phase, and then reconstructed from pure noise through a learned reverse dynamics. This principled design offers stable training and exact likelihood modeling [ 15 ] , resolving long-standing challenges in earlier approaches, e.g. , GANs [ 16 ] and VAEs [ 17 ] . Recent advances in diffusion models have highlighted the role of differential-equation solvers in balancing sampling speed and generation quality. We first develop a unified error analysis that decomposes the total approximation error into two orthogonal components: (1) gradient error , the discrepancy between the learned score function and the ground-truth score; and (2) discretization error , introduced by time discretization during sampling. Viewed through this lens, existing solvers exhibit complementary behaviors. Ordinary differential equation (ODE) based methods offer deterministic trajectories with modest discretization error for low number of function evaluations (NFEs), but their performance is fundamentally constrained by the irreversible accumulation of gradient error [ 18 , 19 , 20 , 21 ] . In contrast, stochastic differential equation (SDE) based methods inject stochasticity that can mitigate gradient error and enhance sample diversity; however, effectively suppressing gradient error in practice usually requires large step counts ( e.g. , 100–1,000 NFEs) [ 2 , 22 ] . Hybrid strategies such as restart sampling [ 23 ] alternate forward noise injection with backward ODE integration to combine these advantages, yet they still operate in high-NFE regimes. Building on the above analysis, we introduce AdaSDE , a novel single-step SDE solver that unifies the computational efficiency of ODEs with the error resilience of SDEs under low-NFE budgets. Unlike traditional SDE solvers [ 24 , 2 ] that inject fixed noise based on a predetermined time schedule, AdaSDE employs an adaptive noise injection mechanism controlled by a learnable stochastic coefficient \gamma_{i} at each denoising step i . To effectively optimize {\gamma_{i}} , we further develop a process-supervision optimization framework that provides fine-grained guidance at each intermediate step rather than only supervising the final reconstruction. This design is inspired by the observation that diffusion trajectories exhibit consistent low-dimensional geometric structures across solvers and datasets [ 25 , 26 ] . By aligning the geometry of the trajectories using \gamma_{i} , AdaSDE reduces gradient error through adaptive stochastic injection, while preserving deterministic efficiency of ODE solvers. Extensive experiments on both pixel-space and latent-space DMs demonstrate the superiority of AdaSDE . Remarkably, with only 5 NFE, AdaSDE achieves FID scores of 4.18 on CIFAR-10 [ 27 ] and 8.05 on FFHQ 64 \times 64 [ 28 ] , surpassing the leading AMED-Solver [ 20 ] by 1.8 \times . Our contributions are threefold: • We conduct a theoretical comparison of SDE and ODE error dynamics, demonstrating that SDEs offer more robust gradient error control. • We introduce AdaSDE , the first single-step SDE solver that achieves efficient sampling ( < 10 NFEs) by optimizing adaptive \gamma -coefficients. Moreover, AdaSDE serves as a universal plug-in module that can enhance existing single-step solvers. • Extensive evaluations on multiple generative benchmarks show that our AdaSDE achieves state-of-the-art performance with significant FID gains over existing solvers. 2 Related Work Recent advancements in accelerating DMs primarily progress along two directions: improved numerical solvers and training-based distillation. Improved numerical solvers. Early studies [ 2 , 24 ] accelerated sampling by improving noise-schedule design, and DDIM [ 29 ] later introduced a non-Markovian formulation that enabled deterministic and much faster sampling. The establishment of the probability-flow ODE view [ 15 ] further unified diffusion formulations and paved the way for higher-order numerical schemes and practical preconditioning strategies, exemplified by EDM [ 30 ] . Following this insight, a series of ODE/SDE integrators have emerged to push the accuracy–speed frontier. For instance, DEIS [ 31 ] , DPM-Solver [ 21 ] , and DPM-Solver++ [ 22 ] exploit exponential integration, Taylor expansion, and data-prediction parameterization to achieve robust few-step sampling. Linear multistep variants, including iPNDM [ 32 , 31 ] and UniPC [ 33 ] , further enable efficient DMs sampling with \sim 10 NFE. Hybrid and stochastic extensions extend beyond deterministic solvers: Restart Sampling [ 23 ] alternates ODE trajectories with SDE-style noise injection; SA-Solver [ 34 ] introduces a training-free stochastic Adams multi-step scheme with variance-controlled noise. Training-based distillation. Two main paradigms dominate this research direction. The first is trajectory approximation , which uses compact student networks to approximate trajectories generated by teacher models, reducing computational steps. This can be achieved offline: by curating datasets from pre-generated samples [ 35 ] , or online through progressive distillation that gradually decreases the number of sampling steps [ 36 , 18 ] . The second paradigm is temporal alignment , which enforces coherence across sampling trajectories by aligning intermediate predictions between adjacent timesteps [ 37 , 38 ] , or by minimizing distributional gaps between real and synthesized data [ 39 , 40 ] . While these methods improve generation quality and efficiency, they typically require substantial computational resources and complex training protocols, limiting their practicality. Recent distillation-based solvers—such as AMED [ 20 ] , EPD [ 41 ] , and D-ODE [ 37 ] —achieve few-step sampling through lightweight tuning rather than full retraining. Complementary efforts on time schedule optimization, including LD3 [ 42 ] , DMN [ 43 ] , and GITS [ 26 ] , further improve efficiency. While most few-step samplers are rooted in ODE formulations, our approach introduces few-step SDE-driven generation by learning stochastic coefficients under a computationally lightweight objective. 3 Preliminaries 3.1 Diffusion Models with Differential Equations DMs define a forward process that perturbs data into a noise distribution, followed by a learned reverse process that inverts this perturbation to generate samples. The forward process is designed as a stochastic trajectory governed by a predefined noise schedule, which can be described by: \mathrm{d}\mathbf{x}=\tfrac{\dot{s}(t)}{s(t)}\mathbf{x}+s(t)\sqrt{2\sigma(t)\dot{\sigma}(t)}\mathrm{d}\mathbf{w}