Learning Straight Flows: Variational Flow Matching for Efficient Generation
Chenrui Ma, Xi Xiao, Tianyang Wang, Xiao Wang, Yanning Shen · 2025
Read Learning Straight Flows: Variational Flow Matching for Efficient Generation by Chenrui Ma, Xi Xiao, Tianyang Wang, Xiao Wang, Yanning Shen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-17583.txt.
Introduction
Chenrui Ma and four co-authors aim for one-step image generation by straightening the paths a generative model travels. Flow matching learns curved trajectories between noise and data, which forces many sampling steps. Earlier attempts to straighten them altered the data coupling or modeled average velocities, and ran into approximation errors, instability, and convergence trouble. The proposed method, Straight Variational Flow Matching, adds a variational latent code that summarizes the generation overview and guides the trajectory toward straightness.
Ideally the generation paths become linear, so a single step can traverse them. Across three challenge benchmarks, the method performed competitively with existing approaches while showing advantages in both training and inference efficiency. The authors present explicit straightness enforcement, rather than indirect encouragement, as the cleaner route to fast flow-based generation.
Catalog record
| CREATOR | Chenrui Ma, Xi Xiao, Tianyang Wang, Xiao Wang, Yanning Shen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-17583
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning Straight Flows: Variational Flow Matching for Efficient Generation Chenrui Ma, Xi Xiao, Tianyang Wang, Xiao Wang, Yanning Shen Abstract Flow Matching has limited ability in achieving one-step generation due to its reliance on learned curved trajectories. Previous studies have attempted to address this limitation by either modifying the coupling distribution to prevent interpolant intersections or introducing consistency and mean-velocity modeling to promote straight trajectory learning. However, these approaches often suffer from discrete approximation errors, training instability, and convergence difficulties. To tackle these issues, in the present work, we propose S traight V ariational F low M atching ( S-VFM ), which integrates a variational latent code representing the “generation overview” into the Flow Matching framework. S-VFM explicitly enforces trajectory straightness, ideally producing linear generation paths. The proposed method achieves competitive performance across three challenge benchmarks and demonstrates advantages in both training and inference efficiency compared with existing methods. 1 Introduction The goal of generative modeling is to transform a simple prior distribution into a complex data distribution. Flow Matching Lipman et al. 2023 ; Albergo and Vanden-Eijnden 2023 ; Esser et al. 2024 pursues this objective by learning a velocity field whose associated ODE transports samples from the source distribution to the target distribution Lipman et al. 2024 . Although Flow Matching adopts linear interpolants as training trajectories, the generative paths it learns are typically curved Geng et al. 2025a ; Song et al. 2023 . This curvature arises because the commonly used independent coupling between the source and target distribution results in many intersecting linear interpolants, forcing the learned velocity field to take an average of incompatible directions Frans et al. 2025 ; Kim et al. 2024 . As a result, Flow Matching often requires many ODE integration steps to maintain sample quality, limiting its efficiency Hoogeboom et al. 2023 . Various methods attempt to alleviate this curvature problem. Some modify coupling strategies Pooladian et al. 2023 ; Ma et al. 2025c ; Albergo et al. 2024 ; Zhang et al. 2025c or learn improved coupling distributions, aiming to reduce interpolant intersections Silvestri et al. 2025 ; Tong et al. 2023 ; Klein et al. 2023 . Others, such as Rectified Flows Liu et al. 2023 ; Zhang et al. 2025d ; Lee et al. 2024 ; Esser et al. 2024 ; Geng et al. 2023 ; Salimans and Ho 2022 ; Wang et al. 2024 , iteratively refine the model in multiple distillation stages so that its trajectories gradually approach straight, optimal-transport paths Villani et al. 2008 ; Albergo et al. 2023 . Meanwhile, Consistency Models Song and Dhariwal 2024 ; Kim et al. 2024 ; Song et al. 2023 ; Sabour et al. 2025 and Mean Velocity Models Frans et al. 2025 ; Geng et al. 2025a ; Zhang et al. 2025b enforce temporal consistency in the learned dynamics, encouraging trajectories at different time steps to agree. Although these approaches embody different design principles—better couplings, iterative refinement, or self-consistency—they share a common motivation: to learn straight generative trajectories. However, they all inherit a fundamental limitation. Because the independent coupling inherently produces intersecting interpolants, any method that attempts to learn straight trajectories directly from this training structure faces an intrinsic contradiction Guo and Schwing 2025 ; Liu et al. 2023 . This misalignment often manifests as training instability, discretization artifacts, or difficulty in converging toward truly straight paths. In this work, we address this contradiction from a new direction. Rather than enforcing straight trajectories under the independent-coupling structure that inherently causes interpolant intersections, we equip the model with the ability to disambiguate these intersections. To this end, we introduce the Straight Variational Flow Matching framework, which ❶ leverages a variational latent code Kingma and Welling 2013 ; Burgess et al. 2018 ; Ma et al. 2025b to provide a global “generation overview” of each source–target pair, enabling the velocity field to choose the correct direction even when interpolants intersecting. Furthermore, we promote ❷ straight trajectory learning by penalizing the time variation of the velocity field along the generative path. Together, these components yield naturally straighter trajectories that require far fewer ODE steps to simulate while maintaining high generation quality Dao et al. 2025 ; Feng et al. 2024 . Extensive experiments demonstrate that the proposed method achieves state-of-the-art performance in generation quality, sampling efficiency, and training stability across multiple benchmark datasets. Our theoretical analysis critically clarifies why existing methods struggle to learn straight trajectories under independent couplings, and shows how our formulation resolves this challenge in a principled and effective manner. In summary, our contributions are as follows. • We identify and prove the fundamental contradiction between straight-trajectory learning and the independent coupling structure used in Flow Matching and related approaches, presenting a theoretical motivation for the proposed method. • We introduce a novel framework that overcomes this contradiction by incorporating a global latent code for disambiguating intersecting trajectories and a straightness objective that encourages time-invariant velocity fields. • Superior experimental results across three challenge benchmarks confirm our theoretical claims and demonstrate substantial improvements in generation fidelity, efficiency, and stability. 2 Related Works 2.1 Rectified Flow and Distillation To address the issue of curved generation trajectories, Rectified Flow Liu et al. 2023 ; Zhang et al. 2025d ; Lee et al. 2024 ; Esser et al. 2024 ; Geng et al. 2023 ; Salimans and Ho 2022 ; Wang et al. 2024 reformulates the flow-matching learning process into multiple iterative stages. Specifically, it first trains a basic flow-matching model, then uses the data pairs generated by this model to train a new one Zhang et al. 2025c . This process is repeated iteratively. Essentially, each subsequent model refines the quality of the training data pairs—reducing trajectory intersections and curvature—by leveraging the outputs of the previous model Liu et al. 2023 . This pipeline is also known as distillation Salimans and Ho 2022 . Through this progressive refinement, the model gradually approaches an optimal transport Kornilov et al. 2024 solution, characterized by straight, non-intersecting trajectories within the generation ODE. Despite its success in reducing curvature and improving trajectory consistency, Rectified Flows and distillation methods suffer from inefficiency: obtaining the final model requires multiple rounds of training, which are both time- and resource-intensive Wan et al. 2024 ; Mei et al. 2024 . Moreover, this iterative process may introduce error accumulation, since each subsequent model is trained on data generated by its predecessor rather than the true data distribution Yin et al. 2024a . Consequently, the final distilled model often struggles to surpass the generation fidelity of the initial model trained directly on real data Esser et al. 2024 ; Cai et al. 2025 . Plus, these multi-stage and tightly-scheduled procedures suffer from a need to specify when to end training and begin distillation Salimans and Ho 2022 ; Yin et al. 2024b . In contrast, end-to-end methods are efficient, accurate, and can be trained indefinitely to continually improve. 2.2 Consistency Model and Mean Velocity Model Consistency Models represent an important step in straight flow learning, functioning as standalone generative models that eliminate the need for explicit distillation procedures Song et al. 2023 ; Geng et al. 2025b . These models enforce consistency constraints between network outputs at different