VDE: Training-Free Accelerating Rectified Flow Model via Velocity Decomposition and Estimation

Junwen TanJinglin LiangHongyuan Chen, Shuangping HuangSouth China University of Technology {eetjw, eeljl, 202230250013}@mail.scut.edu.cn, [email protected] · 2026

Read VDE: Training-Free Accelerating Rectified Flow Model via Velocity Decomposition and Estimation by Junwen TanJinglin LiangHongyuan Chen, Shuangping HuangSouth China University of Technology {eetjw, eeljl, 202230250013}@mail.scut.edu.cn, [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-23381.txt.

Introduction

Tan and three colleagues speed up rectified flow models for image, video, and 3D creation, whose slow inference blocks practical use. Older tricks reuse cached features, but stale caches drift from the changing input and hurt quality. Their training-free method, VDE, instead splits the model's velocity into parts along and across the input, using their steady patterns for precise estimates, with periodic full passes to stop errors piling up. It speeds Flux by 3.22 times with little quality loss.

Catalog record

CREATORJunwen TanJinglin LiangHongyuan Chen, Shuangping HuangSouth China University of Technology {eetjw, eeljl, 202230250013}@mail.scut.edu.cn, [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29653
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.23381

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

VDE: Training-Free Accelerating Rectified Flow Model via Velocity Decomposition and Estimation Junwen TanJinglin LiangHongyuan Chen, Shuangping HuangSouth China University of Technology {eetjw, eeljl, 202230250013}@mail.scut.edu.cn, [email protected] Abstract Though rectified flow models have achieved remarkable performance in image, video, and 3D generation, their practical deployments are challenged by slow inference speeds. Prior acceleration methods reuse cached features from previous steps, which neglects the growing mismatch between static caches and the evolving input, leading to reduced output fidelity. This work proposes Velocity Decomposition and Estimation (VDE), a training-free acceleration method that shifts the paradigm from caching-and-reusing to decomposing-and-estimating. Specifically, VDE decomposes the model’s velocity into components parallel and orthogonal to the input, exploiting their temporal predictability and directional stability for precise, input-adaptive estimation. To prevent error accumulation, it periodically anchors the model’s state via full forward passes. Extensive experiments on image and video generation tasks demonstrate that VDE achieves substantial acceleration with minimal loss in visual quality. Notably, VDE accelerates Flux by 3.22 × \times and achieves an LPIPS of 0.069 on Qwen-Image, outperforming the best baseline with a 52.2% reduction. Code: https://github.com/Tan-Junwen/VDE Figure 1 : Qualitative comparison between VDE and standard 50-step sampling across Flux, Qwen-Image, and Wan2.1. VDE achieves almost the same visual quality with significantly reduced runtime. † † ∗ Corresponding author. Figure 2 : Comparison between standard feature caching and our VDE. Left: VDE decomposes the velocity into parallel and orthogonal components, estimating their evolution via linear extrapolation and directional reuse to ensure adaptive, input-aligned estimation. Right: Prior methods reuse static features, which fail to evolve with the dynamic input and inherently cause cache-input mismatch. 1 Introduction Recently, rectified flow models have achieved strong performance in image 1 ; 8 ; 48 , video 46 ; 16 ; 14 , and 3D asset synthesis 49 ; 13 ; 19 ; 20 ; 18 . However, their inference typically requires executing dozens of iterative sampling steps, leading to high latency and limited deployment in real-time or compute-constrained scenarios. To mitigate the high inference cost, training-free acceleration methods 30 ; 17 ; 6 ; 27 ; 53 have gained significant traction. These approaches typically follow a cache-and-reuse paradigm, where intermediate features from previous steps are stored and reused in subsequent steps to skip redundant computation. For example, some methods 53 ; 7 ; 15 cache and reuse the outputs of attention layers, while other methods like TeaCache 26 and EasyCache 56 cache and reuse the residuals of Transformer blocks and the residuals of the whole model, respectively. Although these methods may trigger reusing based on a low rate-of-change in certain metrics, the fundamental mismatch between the static cache and the dynamic input inevitably propagates into the model’s output. This cache-input mismatch results in an output-input mismatch, where the approximated output fails to accurately respond to the current input state, ultimately degrading the visual fidelity of generated content. In this work, we revisit training-free acceleration and propose Velocity Decomposition and Estimation (VDE) , a novel method that replaces the static cache reusing with estimation of output directly from the current input via an estimation function, thereby fundamentally eliminating the output-input mismatch caused by cache-input mismatch. This estimation is built upon the discovery of a robust regularity in the model’s input-output behavior during sampling. Specifically, we observed that after decomposing the velocity of models into components parallel and orthogonal to the input, there is a stable phase where two consistent patterns appear. First, the scalar coefficients of components evolve smoothly over time, showing strong local linearity between consecutive steps. This property enables reliable estimation of them based on their recent historical values. Second, the orthogonal direction remains largely constant over short intervals, allowing it to be safely reused for multiple adjacent steps without significant error. Based on these insights, VDE constructs an estimation function that dynamically computes the velocity from the current input. Concretely, VDE first executes model inference at periodic anchor steps and decomposes model-predicted velocity to obtain the scalar coefficients and orthogonal direction. Then VDE estimates the coefficients of subsequent steps by linear extrapolation based on their historical values from recent steps and reuse the latest orthogonal direction. The estimated velocity is then synthesized by combining the current input with the extrapolated coefficients and the orthogonal direction. Crucially, unlike caching-based strategies, VDE is inherently input-adaptive—each estimated output is freshly constructed from the current input, eliminating the use of stale features and enabling high-fidelity generation alongside substantial speedups. Our main contributions are summarized as follows: • We identify the cache–input mismatch problem in existing caching-based acceleration methods and review training-free acceleration as estimating the model’s input-output mapping. • We propose VDE , a novel method that shifts the acceleration paradigm from caching-and-reusing to decomposing-and-estimating, enabling precise, input-adaptive estimation of model outputs. • Extensive experiments on image and video generation demonstrate that VDE achieves 2.04-3.22 \times speedups with superior visual fidelity, reducing LPIPS by 52.2% on Qwen-Image against the best baseline. 2 Related Work 2.1 Rectified Flow Model Diffusion models have dominated high-quality visual generation 11 ; 43 ; 32 ; 37 ; 36 . Recent transformer-based architectures such as DiT 33 and related scalable variants 5 ; 4 ; 23 further push generation fidelity. Rectified Flow (RF) models 8 ; 25 reformulate generation as integrating an ODE-driven velocity field, enabling stable training and state-of-the-art synthesis across image 8 ; 48 ; 1 ; 3 , video 46 ; 16 ; 14 ; 55 , and 3D 49 ; 51 ; 13 ; 19 ; 18 ; 20 modalities. Despite their versatility, the sequential nature of RF inference remains computationally demanding, motivating the pursuit of efficient acceleration methods. 2.2 Training-Free Acceleration Methods. Existing acceleration techniques can be broadly grouped into two categories: (1) training-based methods such as distillation 38 ; 28 ; 31 ; 39 , quantization 10 ; 21 ; 41 ; 42 , consistency training 44 ; 47 ; 29 ; 45 and architecture compression/search 22 ; 22 ; 54 , and (2) training-free methods 30 ; 17 ; 6 ; 27 . Since training-based methods require additional data and optimization cycles and often reduce generalization ability, training-free methods have emerged as a promising alternative. Early caching methods for U-Net 2 ; 35 ; 37 architectures, such as DeepCache 30 and Faster Diffusion 17 , exploit spatial redundancy by reusing high-level feature maps across nearby timesteps. FORA 40 , \Delta -DiT 6 and T-GATE 27 extended this idea to DiT architectures, achieving inference speedup in image generation. For video generation, PAB 53 broadcasts attention outputs in a variance-aware pyramid schedule to maximize reuse. AdaCache 15 adjusts feature caching strategies based on content complexity. TeaCache 26 introduces a timestep-embedding–aware indicator and a rescaling strategy to better predict reuse reliability. EasyCache 56 moves toward runtime adaptivity, dynamically reusing previously computed features without offline profiling. OmniCache 7 investigates the generation trajectories across samples and uses curvature-guided selection to skip redundant steps. While effective, these methods reuse stale features, inevitably causing cache-input mismatches that accumulate errors and degrade fidelity. Figure 3 : Temporal dynamics of velocity components. Evolution of the decomposed velocity components across Flux, Qwen-Image, and Wan2.1. Top: The parallel ( \alpha_{t} ) and orthogonal ( \beta_{t} ) coefficients. Bottom: The cosine similarity of

Read the complete text