Transition Flow Matching
Chenrui Ma · 2026
Read Transition Flow Matching by Chenrui Ma (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-15689.txt.
Introduction
Ma proposes Transition Flow Matching, a new way to train generative flow models. Standard flow matching learns a local velocity field step by step. Generation then needs many integration steps. Mean Velocity Flow links local speed to a global mean speed. Ma learns the transition flow itself, a global quantity. That choice supports one-step generation and jumps to any future time. He proves the link to Mean Velocity Flow. Experiments back both the method and the theory.
Catalog record
| CREATOR | Chenrui Ma |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57762 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.15689
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Transition Flow Matching Chenrui Ma Abstract Mainstream flow matching methods typically focus on learning the local velocity field, which inherently requires multiple integration steps during generation. In contrast, Mean Velocity Flow models establish a relationship between the local velocity field and the global mean velocity, enabling the latter to be learned through a mathematically grounded formulation and allowing generation to be transferred to arbitrary future time points. In this work, we propose a new paradigm that directly learns the transition flow. As a global quantity, the transition flow naturally supports generation in a single step or at arbitrary time points. Furthermore, we demonstrate the connection between our approach and Mean Velocity Flow, establishing a unified theoretical perspective. Extensive experiments validate the effectiveness of our method and support our theoretical claims. 1 Introduction The goal of generative modeling is to transform a prior distribution into the data distribution. Flow Matching [ 37 , 18 , 35 ] provides an intuitive and conceptually simple framework for constructing flow paths that transport one distribution to another. Closely related to diffusion models [ 1 , 4 , 45 ] , Flow Matching focuses on learning the velocity fields that guide the generative process during training. Both Flow Matching [ 26 ] and diffusion [ 45 ] models rely on iterative sampling during generation. Recently, significant attention has been devoted to few-step—and particularly one-step, feedforward—generative models. One common approach to accelerate Flow/Diffusion models is distillation. However, an ideal solution would allow models to be trained from scratch in an end-to-end manner without relying on pre-trained teachers. Pioneering this direction, Consistency Models [ 43 , 13 , 9 ] introduce a consistency constraint on network outputs for inputs sampled along the same trajectory. Despite their promising performance, this constraint is imposed as a behavioral property of the network, while the properties of the underlying ground-truth field that should guide learning remain unclear [ 19 , 30 ] . As a result, training can be unstable and typically requires a carefully designed discretization curriculum to progressively constrain the time domain [ 44 , 43 , 33 ] . In contrast, Mean Velocity Models [ 10 , 50 , 17 , 11 , 31 ] optimize an objective derived from the relationship between the instantaneous velocity at each time point and the mean velocity toward a future time. This formulation provides a more fundamental and elegant perspective for learning generative dynamics. In this work, we propose a principled and effective framework, termed Transition Flow Matching , for few-step generation with arbitrary numbers of steps and step sizes. Instead of regressing a local vector field as in Flow/Diffusion models [ 37 , 45 , 36 ] , our method directly models the generation trajectory itself, where the transition dynamics naturally represent a global counterpart of velocity. To this end, we derive (with proof) the Transition Flow Identity , and propose a principled training objective that enables generative models to satisfy this identity from scratch in an end-to-end manner. This formulation extends and generalizes previous Transition Models [ 49 , 38 , 32 ] and Flow Map methods [ 3 , 40 ] . Importantly, we further establish a unified perspective that clarifies the relationship between our framework and Mean Velocity methods [ 10 , 11 ] . In experiments, we conduct extensive evaluations, including generation trajectory visualization and image generation tasks across multiple datasets. The results show that our approach achieves competitive performance, demonstrating the effectiveness of modeling transition flows. In addition, we perform ablation studies to analyze key implementation design choices. Our contributions can be summarized as follows: • We propose Transition Flow Matching, a principled framework for few-step generative modeling. • We derive the Transition Flow Identity and provide a theoretically grounded training objective. • We establish a unified view connecting our method with Mean Velocity models. • We demonstrate competitive performance across multiple image generation benchmarks. 2 Related Works Flow Matching and Diffusion. Flow Matching [ 26 , 2 , 8 ] and Diffusion [ 1 , 4 , 45 ] models generate samples by parameterizing continuous-time dynamics via Ordinary Differential Equations (ODEs) or Stochastic Differential Equations (SDEs). Flow Matching learns a deterministic velocity field defining an ODE over sample evolution [ 28 ] , while Diffusion models are typically formulated as SDEs that learn the score function [ 24 ] . Through the probability flow ODE formulation, the learned score implicitly defines an equivalent velocity field [ 27 ] . In both cases, the learned velocity or score is a local quantity depending only on the current state and time. As a result, generation requires numerical integration over multiple steps to gradually transport samples from noise to data. A common strategy to alleviate trajectory conflicts is distillation [ 29 , 52 , 25 , 8 , 12 , 41 , 48 ] from a well-trained Flow or Diffusion model, which provides a better coupling distribution than the standard independent coupling setting [ 42 , 46 , 21 , 34 ] . In contrast, our Transition Flow Matching framework directly models global state transitions. Instead of regressing a local vector field, we parameterize mappings between states at different times, enabling direct transitions from a given state to an arbitrary future state without relying on local velocity regression. Consistency Model and Mean Velocity Model. To reduce the number of inference steps, Consistency Models [ 43 , 13 , 19 , 30 , 44 , 9 ] learn generation trajectories that maintain consistency over time, enforcing trajectory coherence. Meanwhile, Mean Velocity methods [ 10 , 50 , 17 , 11 , 31 ] establish a relationship between the instantaneous velocity at each time point and a mean velocity target toward a future time. By contrast, our method directly models the generation trajectory itself, where the transfer dynamics naturally represent a global counterpart of velocity. This enables generation with arbitrary step sizes and arbitrary numbers of steps. Importantly, we establish a unified perspective that clarifies the relationship between our framework and Mean Velocity methods [ 10 , 11 ] . Transition Models and Flow Map. Transition-based approaches aim to learn state transitions by preserving transition identities. Consistency Trajectory Models [ 20 ] learn mappings between arbitrary time steps, but rely on explicit ODE/SDE integration during training. Flow Map Matching [ 3 ] regresses zeroth- and first-order derivatives of flow fields, while IMM [ 53 ] performs moment matching across time steps. However, these methods either lack sufficient theoretical analysis, do not clearly connect to prior formulations, or rely on distillation. In contrast, our method is trained from scratch in an end-to-end manner and provides a clear theoretical relationship under both the Flow Matching [ 26 ] and Mean Velocity frameworks [ 10 , 11 ] . 3 Preliminaries 3.1 Notation and setup Random variables and realizations. We work in \mathbb{R}^{d} . Uppercase letters (e.g., X_{t},Z ) denote random variables (RVs), and lowercase letters (e.g., x_{t},z ) denote their realizations. For the density of an RV X_{t} , we write p_{t}(\cdot) , and for a conditional density we write p_{t\mid Z}(\cdot\mid z) . Expectations are denoted by \mathbb{E}[\cdot] . Source/target distributions and coupling. Let X_{0}\sim p_{0} be the source distribution