EFlow : Fast Few-Step Video Generator Training from Scratch via E fficient Solution F low
Dogyun Park, Yanyu Li, Sergey Tulyakov, Anil Kag · 2026
Read EFlow : Fast Few-Step Video Generator Training from Scratch via E fficient Solution F low by Dogyun Park, Yanyu Li, Sergey Tulyakov, Anil Kag (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-27086.txt.
Introduction
Park and co-authors present EFlow, a fast way to train few-step video generators from scratch. EFlow learns a solution flow that jumps a noised state from one time to another. A gated local-global attention block cuts per-step compute and tolerates random token dropping. A cheaper guidance path and a mean-velocity regularizer keep quality at very low step counts. Training throughput rose up to 2.5 times over standard solution flow. Inference latency fell by a factor of 45.3.
Catalog record
| CREATOR | Dogyun Park, Yanyu Li, Sergey Tulyakov, Anil Kag |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 78991 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.27086
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
EFlow : Fast Few-Step Video Generator Training from Scratch via E fficient Solution F low Dogyun Park, Yanyu Li, Sergey Tulyakov, Anil Kag Abstract Scaling video diffusion transformers is fundamentally bottlenecked by two compounding costs: the expensive quadratic complexity of attention per step, and the iterative sampling steps. In this work, we propose EFlow , a efficient few-step training framework, that tackles these bottlenecks simultaneously. To reduce sampling steps, we build on a solution-flow objective that learns a function mapping a noised state at time t t to time s s . Making this formulation computationally feasible and high-quality at video scale, however, demands two complementary innovations. First, we propose Gated Local–Global Attention , a token-droppable hybrid block which is efficient, expressive, and remains highly stable under aggressive random token-dropping, substantially reducing per-step compute. Second, we develop an efficient few-step training recipe. We propose Path-Drop Guided training to replace the expensive guidance target with a computationally cheap, weak path. Furthermore, we augment this with a Mean-Velocity Additivity regularizer to ensure high fidelity at extremely low step counts. Together, our EFlow enables a practical from-scratch training pipeline, achieving up to 2.5 × 2.5\times higher training throughput over standard solution-flow, and 45.3 × 45.3\times lower inference latency than standard iterative models with competitive performance on Kinetics and large-scale text-to-video datasets. Figure 1 : Text-to-video results generated by our EFlow with 4 inference steps. 1 Introduction Diffusion and flow-based models [ 37 , 57 , 44 , 25 , 18 ] enable high-fidelity video generation, yet scaling them to long, high-resolution clips remains computationally daunting. Video diffusion transformers (VideoDiTs) suffers from a compounding double bottleneck: (i) heavy per-step compute, as spatiotemporal self-attention scales quadratically with token count, and (ii) iterative sampling, requiring tens of denoising steps that multiply this per-step cost. Together, these constraints severely limit the practicality of training and deploying video models. Most existing research attacks these challenges in isolation. Architectural efforts reduce per-step complexity via efficient linear attention [ 42 , 5 , 59 , 54 ] , sparsity [ 49 , 50 , 51 , 40 ] , or token pruning [ 19 , 6 , 26 ] . However, aggressive token removal often harms stability or expressivity—especially in the presence of locality mechanisms (like convolutions) that implicitly assume dense, grid-like spatial neighborhoods. Conversely, sampling-focused approaches reduce the number of steps through distillation [ 46 , 45 , 53 , 29 ] or consistency-style objectives [ 33 , 38 , 56 , 11 , 23 , 28 ] , but frequently introduce substantial engineering complexity ( e.g . , pre-trained teachers, multi-stage pipelines, or adversarial components). Furthermore, Classifier-Free Guidance (CFG)—a key ingredient for controllable generation—can effectively double training compute by requiring both conditional and unconditional network evaluations per step. (a) Latency vs. tokens (b) 480p inference latency Figure 2 : (a) Feed-forward latency vs. token number for different attention designs. Softmax attention (Wan 2.1) scales poorly as the sequence length grows while our GLGA ( EFlow ) is significantly faster than softmax and remains competitive with sparse/linear baselines. Applying 75% token dropping on GLGA yields the lowest latency and the most favorable scaling. (b) 480p inference latency for our model and recent video generators. Our model achieves 1.4 \times and 45.3 \times faster diffusion inference over baselines by combining an efficient backbone with few-step sampling. Table 1 : Comparison of our method with VideoDiT families. We summarize attention complexity, training pipeline requirements (reliance on teacher or auxiliary models like discriminator), and inference cost via number of function evaluations (NFEs). N , N^{\prime} D , and W denote token count, sparse token number, dimension, and local window size, respectively. The “ \times 2 ” indicates model evaluations for classifier-free guidance. Standard (Wan 2.1, Wan2.2) Efficient (Sana, S 2 DiT) Efficient (VSA, SLA) Few-step (DMD, rCM) Ours ( EFlow ) Attention architecture Type Softmax Linear+Conv Sparse softmax Softmax GLGA Complexity \mathcal{O}(N^{2}) \mathcal{O}(ND) \mathcal{O}(N^{\prime 2}) \mathcal{O}(N^{2}) \mathcal{O}(N(D+W)) Token-Droppable ✓ ✗ ✗ ✓ ✓ Training pipeline No Teacher Model ✓ ✓ ✗ ✗ ✓ No Auxiliary Model ✓ ✓ ✓ ✗ ✓ Inference Inference NFEs 50\times 2 50\times 2 50\times 2 4 4 In this work, we propose EFlow , fast few-step VideoDiT training (see Tab. 1 ), by combining an efficient, token-droppable attention backbone with a scalable training recipe for solution-flow (SoFlow) [ 23 ] . Concretely, we build on the recent SoFlow [ 23 ] formulation, which learns a bi-time function mapping a noised state at time t to state at any time s . We select this framework for its unique advantages in few-step generation: it enables single-stage training from scratch, completely eliminating the need for pre-trained teachers [ 56 ] or auxiliary networks [ 47 ] . Furthermore, its hybrid flow-matching and solution-consistency objective avoids the memory-intensive Jacobian-Vector Products (JVPs) required by consistency-style models [ 22 , 11 ] , permitting the use of highly optimized kernels like FlashAttention [ 7 , 8 ] . However, scaling this formulation to video poses a severe computational challenge. Enforcing solution consistency across time pairs and applying CFG requires multiple full-network evaluations per training step. When compounded by the attention quadratic complexity, this multi-pass requirement makes video-scale training prohibitively expensive. We introduce two synergistic innovations for scalable few-step video training: (i) Efficient, Token-Droppable Hybrid Attention for VideoDiT. Prior linear-attention DiTs [ 5 , 54 ] use convolutional mixing for locality, which breaks under aggressive token dropping due to its reliance on a dense spatial grid. We instead propose Gated Local–Global Attention (GLGA), a hybrid block fusing global linear attention with local sliding-window attention. Because window attention operates over available tokens rather than fixed grids, it is inherently robust to severe token removal. This adaptive routing yields an expressive and highly stable VideoDiT even when dropping the vast majority of tokens. Empirically, on the Kinetics dataset, this hybrid design achieves a 13% improvement in Fréchet Video Distance (FVD) compared to linear-attention [ 5 ] (Tab. 2 ). (ii) Efficient Few-Step Training Recipe. Integrating CFG into solution-flow requires two network evaluations per sample—a steep computational cost for video. We propose Path-Drop Guided (PDG) training, which replaces the expensive unconditional branch with a computationally cheap “weak-path” forward pass obtained by skipping middle transformer layers. Furthermore, to preserve quality at few-step sampling, we introduce a global Mean-Velocity Additivity (MVA) regularizer that mitigates the integration errors in local consistency matching. Integrating the GLGA VideoDiT with Scalable Few-Step Recipe , EFlow compounds compute savings to make from-scratch, few-step video training practical. Our framework achieves 1.76 \times and 2.5 \times higher training throughput on 480p video compared to flow matching and solution-flow matching, respectively (Fig. 4 (a)). These gains extend to deployment, where EFlow achieves 1.4 \times to 45.3 \times lower inference latency (Fig. 2 ) than recent few-step methods (VSA, rCM), efficient architectures (Sana), and standard models (Wan2.1 1.3B), while maintaining competitive VBench scores on 480p text-to-video generation. In summary, our key contributions are: • Efficient, Droppable VideoDiT Architecture: We propose Gated Local–Global Attention (GLGA), which maintains high fidelity under aggressive token dropping, resulting in substantial training and inference speedups. • Path-Drop Guided (PDG) Training: We introduce a novel guidance mechanism that constructs guidance targets using a lightweight,