MixFlow: Mixed Source Distributions Improve Rectified Flows

Nazir Nayal, Christopher Wewer, Jan Eric Lenssen · 2026

Read MixFlow: Mixed Source Distributions Improve Rectified Flows by Nazir Nayal, Christopher Wewer, Jan Eric Lenssen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-09181.txt.

Introduction

Nayal, Wewer, and Lenssen present MixFlow, a training method that straightens the curved paths image-making flow models follow when sampling. It mixes a fixed plain source spread with a second source shaped by a signal that lines it up better with real data. The mix cuts path bend, so models need fewer steps, gain quality, and train faster. Tests show gains of 12 percent over standard rectified flow and 7 percent over earlier baselines at a fixed sampling budget.

Catalog record

CREATORNazir Nayal, Christopher Wewer, Jan Eric Lenssen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43493
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.09181

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MixFlow: Mixed Source Distributions Improve Rectified Flows Nazir Nayal, Christopher Wewer, Jan Eric Lenssen Abstract Diffusion models and their variations, such as rectified flows, generate diverse and high-quality images, but they are still hindered by slow iterative sampling caused by the highly curved generative paths they learn. An important cause of high curvature, as shown by previous work, is independence between the source distribution (standard Gaussian) and the data distribution. In this work, we tackle this limitation by two complementary contributions. First, we attempt to break away from the standard Gaussian assumption by introducing κ ​ -FC \kappa\texttt{-FC} , a general formulation that conditions the source distribution on an arbitrary signal κ \kappa that aligns it better with the data distribution. Then, we present MixFlow, a simple but effective training strategy that reduces the generative path curvatures and considerably improves sampling efficiency. MixFlow trains a flow model on linear mixtures of a fixed unconditional distribution and a κ ​ -FC \kappa\texttt{-FC} -based distribution. This simple mixture improves the alignment between the source and data, provides better generation quality with less required sampling steps, and accelerates the training convergence considerably. On average, our training procedure improves the generation quality by 12% in FID compared to standard rectified flow and 7% compared to previous baselines under a fixed sampling budget. Code available at: https://github.com/NazirNayal8/MixFlow 1 Introduction Generative modeling, the problem of fitting and sampling from data distributions, is a heavily explored topic with remarkable success in recent years, mostly driven by progress in image generation Ho et al. 2020 ; Song et al. 2021a ; Lipman et al. 2023 . Existing generative models offer trade-offs between sampling speed, diversity, and the quality of the generated samples, referred to as the generative learning trilemma Xiao et al. 2022 . Diffusion models Song et al. 2021b ; Ho et al. 2020 ; Song et al. 2021a and their variations have pushed the performance considerably in terms of diversity and quality. However, a single inference requires several forward passes to obtain high quality samples. Therefore, several works have explored ways to reduce the number of function evaluations required for sampling. Rectified Flow Liu et al. 2023 and Flow Matching Lipman et al. 2023 tackled the problem from the perspective of straightening the generative paths by replacing the diffusion schedulers with optimal transport displacement interpolations McCann 1997 between the source and target distributions. Even though their formulations provide theoretical guarantees for requiring a fewer number of sampling steps, the amount of required steps still remains high in practice. In this work, we tackle this problem by introducing an effective training strategy for flow models to reduce the amount of steps required to generate high quality samples. Flow models learn to iteratively transform a simple source distribution, usually a standard Gaussian, to a complex data distribution. For Flow Matching, a recent line of work shows that the sampling speed is strongly influenced by the assumptions on the forward coupling Tong et al. 2024 ; Pooladian et al. 2023 ; Lee et al. 2023 . The forward coupling is the joint distribution of the source and the target, which encodes their dependence relation. Optimizing the forward coupling leads to straighter generative paths by exposing the model to source-target pairs that are more aligned Lee et al. 2023 . Inspired by this, we propose \kappa -Forward Coupling ( \kappa\texttt{-FC} ), a general formulation for learnable forward couplings that can utilize an arbitrary guiding signal \kappa to align the source distribution with the target. The more informative \kappa is of the data distribution, better alignment is achieved. Nevertheless, we show that naively optimizing the forward coupling with \kappa introduces a difficult trade-off with a regularization hyperparameter that can lead to issues like the prior hole problem Hao & Shafto 2023 . To counter this, we introduce MixFlow, a technique that uses a linear mixture of two distributions as the source distribution, one of which is fixed and the other a learnable distribution that is learned using \kappa\texttt{-FC} . The mixing encourages that samples on the interpolation path map to similar regions in the target distribution, transporting structure from the conditional to the unconditional (Gaussian) source distribution. MixFlow demonstrates overall improvement in sampling quality and requires fewer sampling steps. Furthermore, we show that, given a conditioning signal that is sufficiently informative, our formulation allows for controlling the speed-quality trade-off at test-time. To verify our findings, we present exhaustive results on common image generation benchmarks, showing that our approach improves FID by 12% compared to standard Rectified Flow and by 7% compared to the best previous method for trajectory straightening, with a comparable number of sampling steps. In contrast to previous works, our trade-off does not depend on parameters that need to be set during training. We provide an analysis of different design choices and their effect on the source distribution, generation quality, and sampling speed. In summary, our contributions are: • We propose \kappa\texttt{-FC} , a general formulation for learnable forward couplings that can be conditioned on arbitrary variables for obtaining better source distributions. • We introduce MixFlow, a method for training Rectified Flows with a linear mixture of two distributions as a source distribution, which leads to less sampling steps required to generate high quality samples. 2 Related work In general, the lines of work that study the sampling speed problem in diffusion models can be categorized into the following groups, depending on which part of the design space is examined. Distillation. One direction explores linearizing the mapping between the source and the target distribution through distillation Salimans & Ho 2022 ; Liu et al. 2023 ; Berthelot et al. 2023 ; Zhou et al. 2024 ; Luhman & Luhman 2021 ; Xie et al. 2024 , consistency constraints Song et al. 2023 ; Song & Dhariwal 2024 ; Silvestri et al. 2025 ; Geng et al. 2025 ; Yang et al. 2024 , or Reflow Liu et al. 2023 . While these methods are able to achieve reasonable generation quality with a single sampling step, they require retraining a model multiple times, and often degrade the model’s performance for higher number of sampling steps Guo & Schwing 2025 . On the other hand, we show that training MixFlow once can improve the performance for all choices of sampling steps, and can also considerably reduce the required training budget. A branch in this direction attempts to improve the Reflow operation by generalizing it to arbitrary schedules Wang et al. 2025a , or enhancing its design components Kim et al. 2025 . Furthermore, we highlight that this direction is orthogonal to our approach and these methods can be applied to any model trained with MixFlow. Faster Solvers. Another line of work focuses on developing faster samplers by utilizing better numerical ODE solvers Dockhorn et al. 2022 ; Karras et al. 2022b ; Lu et al. 2022 ; Song et al. 2021a . Despite these improvements, the sampling speed remains bounded by the curvature of the generative trajectories induced by the flow models. In this work, we tackle the same problem but from the orthogonal perspective of source distribution optimization. Hence, our method can be combined with any ODE solver to achieve

Read the complete text