CAB: Accelerating Flow and Diffusion Sampling via Rectification and Corrected Adams-Bashforth

Anuska Roy, Pravin Nair · 2026

Read CAB: Accelerating Flow and Diffusion Sampling via Rectification and Corrected Adams-Bashforth by Anuska Roy, Pravin Nair (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16736.txt.

Introduction

Roy and Nair propose CAB, a training-free sampler that speeds up flow and diffusion image models. Existing acceleration either needs distillation training or relies on high-order solvers that can degrade quality at low step counts. CAB first transforms sampling dynamics to a common rectified coordinate system, then applies a multistep Adams-Bashforth predictor with a correction from past velocity evaluations, adding no function evaluations. It reaches at least third-order local and second-order global error, and improves quality-per-step in the 6-to-20-step regime.

Catalog record

CREATORAnuska Roy, Pravin Nair
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65876
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16736

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CAB: Accelerating Flow and Diffusion Sampling via Rectification and Corrected Adams-Bashforth Anuska Roy, Pravin Nair Abstract Flow and diffusion models achieve high-fidelity, high-resolution image synthesis, but often require many function evaluations (NFEs) at sampling time. Existing acceleration methods either require additional training through distillation or rely on training-free high-order solvers, and both can degrade sample quality at low NFE budgets. We propose CAB (Corrected Adams-Bashforth), a training-free sampler that accelerates both flow and diffusion models. CAB first transforms the sampling dynamics to a common rectified coordinate system, and then applies a multistep Adams–Bashforth predictor augmented with a simple correction term based on past velocity evaluations and therefore incurs no additional NFEs. The resulting method is simple, has the same algorithmic form across model classes, and has at least third-order local truncation error and second-order global error. Experiments on pretrained flow and diffusion models, including class-conditional and large-scale text-to-image benchmarks, show that CAB improves quality–NFE trade-offs in the low-step regime of 6 6 – 20 20 NFEs. It also remains competitive with strong training-free samplers at higher step counts across most tested models. The official implementation is available at https://github.com/Anuska-Roy/CAB . 1 Introduction Flow and diffusion models have become the dominant choice for high-fidelity image and video generation [ 9 , 17 , 10 ] , and they increasingly serve as backbones for editing and restoration pipelines [ 11 , 29 , 25 , 16 , 38 ] . Despite their impressive quality, sampling from these models remains computationally expensive because generation often involves numerically integrating a learned reverse-time ordinary differential equation over many neural network evaluations [ 17 , 34 , 23 ] . This cost is particularly limiting in practical deployment, where latency and throughput matter, motivating continued interest in training-free few-step samplers that improve the quality-compute trade-off without any additional training [ 23 , 32 , 45 ] . The most important regime is often the low-NFE setting, where only 6 to 20 network evaluations are affordable, but it is also the most challenging, since discretization errors accumulate rapidly and visibly degrade sample fidelity [ 23 , 45 ] . Training-free ODE solvers have greatly accelerated flow and diffusion sampling, but each family comes with its own limitations. First-order methods such as DDIM are simple and robust, yet typically require many function evaluations for high-quality generation [ 24 ] . Multistep methods such as PNDM improve over first-order baselines, but the low-NFE regime remains challenging [ 45 , 18 ] . Dedicated high-order diffusion solvers such as DEIS and DPM-Solver exploit the semi-linear structure of diffusion ODEs, though prior fast high-order samplers can become unstable under large guidance scales, motivating stabilized variants such as DPM-Solver++ [ 44 , 23 , 24 ] . UniPC improves few-step accuracy over DPM-Solver++, but satisfactory sampling below 10 steps remains difficult in general [ 45 ] . DPM-Solver-v3 improves low-NFE quality by introducing empirical model statistics computed on the pretrained model, which yields a more model-adaptive solver requiring additional model-dependent estimation [ 46 ] . STORK reduces the cost of stabilized Runge–Kutta sampling through virtual NFEs based on Taylor approximation, improving efficiency at the expense of added approximation and solver simplicity [ 36 ] . Consequently, existing samplers still face a practical trade-off among accuracy, stability, generality, and simplicity in the low-NFE regime [ 45 , 24 , 36 ] . Figure 1 illustrates this low-NFE trade-off, where existing training-free samplers can exhibit noise, oversmoothing, or structural distortions at low NFE budget. Euler / DDIM DPM-Solver++ STORK CAB-2 Prompt 1: “A green bus with signage on a city street.” CAB-2 produces a sharper and detail-enhanced sample at 6 NFEs, while existing samplers either retain strong noise artifacts or oversmooth the sample. Prompt 2: “The tennis player looks solemn holding his racket.” CAB-2 preserves facial structure, pose, and racket details better at 6 NFEs, while competing solvers show grain and distortion. Class-conditional generation: CAB-2 produces a more realistic sample with clearer global structure, while competing samplers show oversmoothing, artifacts, or distorted texture at 8 NFEs. Figure 1 : Qualitative comparison of training-free samplers on QWEN-Image 1024\times 1024 flow generation [ 39 ] and DiT 256\times 256 VP diffusion generation [ 27 ] . Contribution: In this work, we propose Corrected Adams–Bashforth (CAB) , a simple framework for constructing explicit multistep samplers for flow and diffusion models via an appropriate rectification of the reverse-time ODE. CAB augments Adams–Bashforth (AB) updates with a lightweight correction term that improves low-NFE stability while retaining the key efficiency advantage of a single network evaluation per iteration. Unlike UniPC, which is formulated in log-SNR diffusion coordinates, CAB applies a noise-to-signal rectification to obtain a common explicit learned-field ODE for both diffusion and flow models. We also prove that the corrected schemes preserve the convergence order of the underlying AB solvers. Empirically, CAB improves quality–NFE trade-offs across academic benchmarks and large-scale text-to-image/video models. For example, CAB produces sharper and more coherent samples in the low-NFE settings illustrated in Figure 1 . 2 Background and Related Work Let \boldsymbol{x}_{0}\in\mathbb{R}^{d} denote a data sample drawn from an unknown distribution p_{0} . Flow and diffusion models define a family of intermediate marginals \{p_{t}\}_{t\in[0,T]} that transport p_{0} to a tractable reference distribution p_{T} , typically chosen as \mathcal{N}(\mathbf{0},\mathbf{I}) [ 9 , 34 , 5 , 7 ] . We use the forward direction t:0\to T to describe the corruption process, while sampling integrates the corresponding reverse-time dynamics from t=T to t=0 starting from the simple prior p_{T} . Since p_{0} is unknown, the intermediate marginals are specified through a forward transition kernel p_{0t}(\boldsymbol{x}_{t}\mid\boldsymbol{x}_{0}) [ 9 , 17 ] , which induces p_{t}(\boldsymbol{x})=\mathbb{E}_{\boldsymbol{x}_{0}\sim p_{0}}\!\left[p_{0t}(\boldsymbol{x}\mid\boldsymbol{x}_{0})\right]. A useful unifying viewpoint is that many widely used constructions, including VP/DDPM-type diffusion models [ 9 , 34 ] , VE/EDM-type parameterizations [ 34 , 12 ] , and rectified-flow paths [ 19 ] , admit the affine-Gaussian forward form \boldsymbol{x}_{t}=s_{t}\boldsymbol{x}_{0}+\sigma_{t}\epsilon,\qquad\epsilon\sim\mathcal{N}(\mathbf{0},\mathbf{I}), (1) or equivalently, p_{0t}(\boldsymbol{x}_{t}\mid\boldsymbol{x}_{0})=\mathcal{N}(s_{t}\boldsymbol{x}_{0},\sigma_{t}^{2}\mathbf{I}). Different model families correspond to different choices of nonnegative scalar schedules s_{t},\sigma_{t}\geq 0 [ 9 , 34 , 12 , 19 ] . On intervals where s_{t}>0 , we define the noise-to-signal ratio \rho_{t}:={\sigma_{t}}/{s_{t}} . For all the commonly used schedules in [ 9 , 34 , 12 , 19 , 17 ] , \rho_{t} is differentiable and strictly increasing. Under this regularity condition, the affine path ( 1 ) can be equivalently realized by a linear forward stochastic differential equation (SDE) initialized at \boldsymbol{x}_{0}\sim p_{0} , [ 13 , 23 ] , d\boldsymbol{x}_{t}=f(t)\boldsymbol{x}_{t}\,dt+g(t)\,d\boldsymbol{w}_{t},\qquad f(t)=\frac{\dot{s}_{t}}{s_{t}},\qquad g(t)^{2}=2\,\sigma_{t}\!\left(\dot{\sigma}_{t}-\frac{\dot{s}_{t}}{s_{t}}\sigma_{t}\right), (2) where \boldsymbol{w}_{t} denotes a standard Wiener process. In particular, the monotonicity condition \dot{\rho}_{t}\geq 0 ensures that the diffusion coefficient g(t) is real-valued and nonnegative. This monotonicity condition is also required for the noise-to-signal rectification used to derive the proposed solver in Section 3 . Given the forward SDE in ( 2 ), there exists a corresponding reverse-time generative process [ 34 ] . Starting from the prior \boldsymbol{x}_{T}\sim\mathcal{N}(\mathbf{0},\mathbf{I}) , samples from the data distribution can be generated by integrating the associated reverse-time ODE from t=T to t=0 . In the noise-prediction parameterization commonly used in diffusion models, the reverse-time ODE is, \frac{d\boldsymbol{x}_{t}}{dt}=f(t)\boldsymbol{x}_{t}+\frac{g(t)^{2}}{2\sigma_{t}}\,\epsilon_{\theta}(\boldsymbol{x}_{t},t),\qquad t\in[0,T], (3) with initialization \boldsymbol{x}_{T}\sim p_{T} [ 34 , 24 , 45 , 36 ] . Here,

Read the complete text