STORK: Faster Diffusion and Flow Matching Sampling by Resolving both Stiffness and Structure-Dependence

Zheng Tan, Weizhen Wang, Andrea L. Bertozzi, Ernest K. Ryu · 2025

Read STORK: Faster Diffusion and Flow Matching Sampling by Resolving both Stiffness and Structure-Dependence by Zheng Tan, Weizhen Wang, Andrea L. Bertozzi, Ernest K. Ryu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-24210.txt.

Introduction

Zheng Tan, Weizhen Wang, Andrea Bertozzi, and Ernest Ryu speed up image and video generation models in a 2025 paper. Diffusion and flow models make strong media, but sampling from them takes many model calls, which makes use costly. Fast sampling methods exist, yet many fail on two fronts: stiff equations and reliance on one model family's structure.

Their method, called STORK, builds on a stabilized Taylor method with an orthogonal Runge-Kutta scheme. It handles stiffness while staying independent of the semi-linear structure that limits rival methods. Across image and video tests, it consistently improved sampling quality at a given budget of calls. The authors share their code in public. Faster sampling could cut the cost of generative media tools.

Catalog record

CREATORZheng Tan, Weizhen Wang, Andrea L. Bertozzi, Ernest K. Ryu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-24210

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

STORK: Faster Diffusion and Flow Matching Sampling by Resolving both Stiffness and Structure-Dependence Zheng Tan, Weizhen Wang, Andrea L. Bertozzi, Ernest K. Ryu Abstract Diffusion models (DMs) and flow-matching models have demonstrated remarkable performance in image and video generation. However, such models require a significant number of function evaluations (NFEs) during sampling, leading to costly inference. Consequently, quality-preserving fast sampling methods that require fewer NFEs have been an active area of research. However, prior training-free sampling methods fail to simultaneously address two key challenges: the stiffness of the ODE (i.e., the non-straightness of the velocity field) and dependence on the semi-linear structure of the DM ODE (which limits their direct applicability to flow-matching models). In this work, we introduce the Stabilized Taylor Orthogonal Runge–Kutta (STORK) method, addressing both design concerns. We demonstrate that STORK consistently improves the quality of diffusion and flow-matching sampling for image and video generation. Code is available at https://github.com/ZT220501/STORK . 1 Introduction Diffusion models (DMs) ( Sohl-Dickstein et al., 2015 ; Ho et al., 2020 ; Song et al., 2021 ) have demonstrated remarkable achievements during the past several years on various tasks, including image generation ( Dhariwal & Nichol, 2021 ; Meng et al., 2022 ) , text-to-image generation ( Ramesh et al., 2022 ; Rombach et al., 2022 ; Gu et al., 2022 ; Podell et al., 2023 ; Mo et al., 2023 ; Zhang et al., 2023 ) , video generation ( Ho et al., 2022 ; Kong et al., 2024 ; Jin et al., 2025 ; Liu et al., 2025 ) , and diffusion policy ( Chi et al., 2024 ) . As shown in Song et al. (2021) , the sampling of DMs can be treated as solving an SDE or an equivalent ODE backward in time. However, DMs require a significant number of function evaluations (NFEs) of the learned model when performing sampling, leading to costly inference. Consequently, quality-preserving fast sampling methods have become an active area of research, and many methods that achieve effective sampling with fewer NFEs have been proposed ( Song et al., 2022 ; Liu et al., 2022 ; Zhang & Chen, 2023 ; Lu et al., 2022 ; Lu et al., 2025 ; Xie et al., 2025 ; Zhao et al., 2023 ) . As noted in ( Liu et al., 2024a ) , the “straightness” of the velocity field is a key consideration in such fast sampling methods, and this observation corresponds to the notion of stiffness in classical numerical analysis ( Burden & Faires, 2011 ) . Building on this connection, exponential integrator techniques for stiff ODEs ( Hochbruck & Ostermann, 2010 ) have been successfully adapted into the DPM-Solver ( Lu et al., 2022 ) and DEIS ( Zhang & Chen, 2023 ) samplers. However, these approaches rely on the semi-linear structure of the ODE formulation in noise-based diffusion models, and thus cannot be directly applied to flow-matching-based models. In such cases, additional approximations, such as the data prediction step, are required ( Lu et al., 2025 ; Xie et al., 2025 ) . Contribution. In this work, we introduce a fast training-free sampler, the S tabilized T aylor O rthogonal R unge– K utta (STORK) method, built upon stabilized Runge–Kutta (SRK) methods ( Abdulle, 2002 ; Meyer et al., 2014 ; Skaras et al., 2021 ) . As emphasized in Figure 4 , STORK is a stiff solver that does not rely on the semi-linear structure of noise-based diffusion model’s ODE formulation, making it applicable to both noise-based and flow-based models. Our experiments show that STORK consistently improves the quality of diffusion and flow-matching sampling for image and video generation. Flow-Euler Flow-DPM-Solver++ Flow-UniPC STORK (Ours) ‘‘A STORK holding a plaque with the text "STORK" on it. Cyberpunk, 8K resolution, highly detailed, RTX-On, super resolution’’ We have the correct word with better details. ‘‘A young black cowboy country music singer performing with a guitar on his horse in a field outside the city to a crowd of fans, 8k, full HD’’ We have a more vivid background and better realism. ‘‘Joker logo with the initials of the letter Q’’ Only our method has both the Joker logo and the letter Q. ‘‘Create an image that evokes nostalgia, using imagery of video games, movies, and other objects that remind us of our past’’ Our image is further detailed and has more diverse objects matching the prompt. Figure 1: Comparison between the Flow-Euler, Flow-DPM-Solver++ ( Lu et al., 2025 ; Xie et al., 2025 ) , Flow-UniPC ( Zhao et al., 2023 ) , and STORK. All images are generated using the SANA 1.6B model ( Xie et al., 2025 ) at 1024\times 1024 resolution with only 8 NFEs. Prompts are displayed beneath each image pair, accompanied by our commentary explaining why STORK’s generations are superior. STORK achieves much better visual fidelity at the extremely low NFE case, showing its effectiveness as a fast sampling method. Zoom in for better visual details. (a) Flow-UniPC video generation, 8 NFEs (b) STORK video generation, 8 NFEs Figure 2: Video generation on Hunyuan model ( Kong et al., 2024 ) with prompt: ‘‘Iron Man is walking towards the camera in the rain at night, with a lot of fog behind him. Science fiction movie, close-up’’ . Our video portrays Iron Man more clearly and has rain in the background. 2 Background and related works Diffusion models. Diffusion models (DMs) generate samples by numerically solving the reverse-time ODE \displaystyle\frac{d\bm{x}}{dt}=f(t)\bm{x}(t)+\frac{g(t)^{2}}{2\sigma_{t}}\bm{\epsilon}_{\theta}(\bm{x}(t),t),\quad t\in[0,T], (1) where the “initial” condition \bm{x}_{T} is sampled as a Gaussian, f(t) , g(t) , \sigma_{t} are known functions, and \bm{\epsilon}_{\theta}(\bm{x}(t),t) is the noise prediction model, a trained neural network. For further information on how diffusion models are trained and how they are able to generate high-quality images, we refer the readers to standard references ( Sohl-Dickstein et al., 2015 ; Ho et al., 2020 ; Song et al., 2022 ; Song et al., 2021 ) . Notice that equation 1 exhibits a semi-linear structure with a linear term f(t)\bm{x}(t) and a non-linear term involving \bm{\epsilon}_{\theta} . The DPM-Solver ( Lu et al., 2022 ) is a numerical ODE solver that exploits the semi-linear structure of equation 1 , and it is one of the most widely used fast sampling methods for diffusion models. Flow matching objectives. Flow matching is a class of generative models closely related to diffusion models and has recently attracted significant attention. Unlike diffusion models, which learn a noise model (score function), flow matching models directly learn a vector field \bm{v}_{\theta} and generate samples by numerically solving the forward-time ODE \displaystyle\frac{d\bm{x}}{dt}=\bm{v}(\bm{x}(t),t),\quad t\in[0,T], (2) where the initial condition \bm{x}_{0} is sampled as a Gaussian. For further information on how flow matching models are trained and how they are able to generate high-quality images, we refer the readers to standard references ( Lipman et al., 2023 ; Podell et al., 2023 ; Xie et al., 2025 ) . Because the flow matching ODE equation 2 lacks a semi-linear structure, the DPM-Solver ( Lu et al., 2022 ) cannot be directly applied. Although follow-up works ( Lu et al., 2025 ; Xie et al., 2025 ; Zheng et al., 2023 ) circumvent this limitation using a so-called

Read the complete text