The Generation Phases of Flow Matching: a Denoising Perspective

Anne Gagneux, Ségolène Martin, Rémi Gribonval, Mathurin Massias · 2025

Read The Generation Phases of Flow Matching: a Denoising Perspective by Anne Gagneux, Ségolène Martin, Rémi Gribonval, Mathurin Massias (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-24830.txt.

Introduction

Anne Gagneux, Segolene Martin, Remi Gribonval, and Mathurin Massias probe how flow match models make new samples, step by step. Such models have scored big wins, yet what drives their grade is not well known. The team views the build as a clean up act, like a denoiser that clears noise in stages.

That view lets them lay flow models and denoisers on one shared ground. They then poke the build with set shifts in noise and drift, and watch where it gains or breaks. Clear build phases came out of the tests, each with its own win and fail modes. The map shows at which stage a denoiser earns its keep.

Catalog record

CREATORAnne Gagneux, Ségolène Martin, Rémi Gribonval, Mathurin Massias
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-24830

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Generation Phases of Flow Matching: a Denoising Perspective Anne Gagneux, Ségolène Martin, Rémi Gribonval, Mathurin Massias Abstract Flow matching has achieved remarkable success, yet the factors influencing the quality of its generation process remain poorly understood. In this work, we adopt a denoising perspective and design a framework to empirically probe the generation process. Laying down the formal connections between flow matching models and denoisers, we provide a common ground to compare their performances on generation and denoising. This enables the design of principled and controlled perturbations to influence sample generation: noise and drift. This leads to new insights on the distinct dynamical phases of the generative process, enabling us to precisely characterize at which stage of the generative process denoisers succeed or fail and why this matters. 1 Introduction Flow matching (FM, Lipman et al. 2023 ; Albergo and Vanden-Eijnden 2023 ; Liu et al. 2023 ) and diffusion models ( Sohl-Dickstein et al. 2015 ; Ho et al. 2020 ; Song et al. 2021 ) have achieved state-of-the-art results in generating images, videos, audio, and even text, where they are able to produce content that is virtually indistinguishable from human-produced ones. Research in the field remains extremely active, with many important questions still open: improving sample quality, making training and inference more efficient ( Karras et al. 2022 ; Rombach et al. 2022 ) and, perhaps most importantly, understanding why current generative models perform so well. Despite their striking successes, the precise mechanisms that make current generative models so effective still remain elusive. Identifying those is critical to improve them, and several leads have been proposed: analyzing the behaviour of the generative process across time ( Biroli et al. 2024 ) , exploiting connections with the exact minimizer of the training loss ( Kamb and Ganguli 2025 ; Niedoba et al. 2025 ) , explaining memorisation and generalisation ( Kadkhodaie et al. 2024 ; Sclocchi et al. 2025 ) , or the impact of optimization procedures ( Wu et al. 2025 ) . Some of these studies, of theoretical nature, have provided elegant interpretations (e.g. the “target stochasticity” of Vastola 2025 , to explain generalisation), but were later questioned by empirical findings ( Bertrand et al. 2025 ) . This highlights the need for carefully designed empirical frameworks that can probe such theories and, in doing so, guide the development of better methods through deeper theoretical understanding. In this work, we aim to bring new elements of understanding to the behaviour of flow matching by exploiting a denoising perspective. To this end, we construct a toolkit of denoisers, which differ in their parametrizations and the weighting schemes applied to their training losses. This perspective allows us to directly relate denoising performance to generative performance. By leveraging the equivalence between learning the ideal velocity field in flow matching and learning an ideal denoiser at each time step, we use this toolkit to address the following questions: Is a good generative model essentially nothing more than a good denoiser at every noise level? Are there specific times during the generative process where accuracy matters most? How do early versus late phases of generation contribute to generalisation and sample quality? To answer these questions, our contributions are: 1. We design a denoising toolkit , namely, controlled procedures to test the impact of several factors on the performance of flow matching models. We show that different denoising losses and parametrizations, though theoretically equivalent if perfectly trained, lead to very different empirical performance, where denoising and generation quality are strongly related. 2. We engineer two types of controlled perturbations applied on the generation process: drift- and noise-type perturbations. We show that they impact distinct temporal phases of generation. We further analyze these generation stages by exhibiting a discrepancy between the spatial regularities of target and learned velocity fields, at early times . 3. We exploit the generality of the denoising framework, that allows building new models in a principled manner, with similar generation quality (FID-wise) but different generation behaviours. We highlight the importance of the intermediate stage for generation by learned models, a stage that is not revealed by the closed-form optimal velocity. The structure of the paper is the following: Section 2 provides an introduction to flow matching; Section 3 lays down the theoretical equivalence between flow matching and denoising; Section 4 is dedicated to related works. Section 5 provides an empirical probe of the theoretical equivalence between denoising and generation. Section 6.1 leverages our framework to design relevant modifications of the generative process. Finally, Section 6 provides new insights on the phases of generation and their nature. 2 Background on flow matching The generative process is defined over time t\in[0,1] , with an initial sample x_{0}\sim p_{0} and a target sample x_{1}\sim p_{1} . To connect with the concept of denoisers in the sequel, we further assume that the latent distribution is standard Gaussian: p_{0}=\mathcal{N}(0,\mathrm{I}_{d}) , and we work in the setting where the coupling p_{(x_{0},x_{1})} is the product coupling p_{0}\otimes p_{1} . In flow matching, generation of new samples is performed via the numerical resolution of an ordinary differential equation (ODE) on [0,1] : \begin{cases}x(0)=x_{0}\sim p_{0}\\ \dot{x}(t)=v(x(t),t)\,\,\forall t\in[0,1]\,,\end{cases} (1) the function v:\mathbb{R}^{d}\times[0,1]\to\mathbb{R}^{d} being called the velocity . The generated sample is simply the ODE solution at time t=1 , namely x(1) ; for an appropriate velocity, it should behave like a sample from p_{1} . In practice, the velocity is parametrized by a neural network v_{\theta} and learned by solving: \min_{\theta}\,\mathbb{E}_{\begin{subarray}{c}t\sim\mathcal{U}[0,1],\\ x_{0}\sim p_{0},\\ x_{1}\sim p_{1}\end{subarray}}\left[\|v_{\theta}(x_{t},t)-(x_{1}-x_{0})\|^{2}\right], (2) where x_{t}:=(1-t)x_{0}+tx_{1} is the linear interpolation between x_{0} and x_{1} . It is well-known that the solution v^{\star} to this minimization problem (over all measurable functions) is given by a conditional expectation: v^{\star}(x_{t},t)=\mathbb{E}[x_{1}-x_{0}\mid x_{t},t]. (3) In practice, sampling from p_{1} in ( 2 ) is impossible, and points x_{1} are instead drawn from a dataset x^{(1)},\ldots,x^{(n)} of samples from p_{1} . Effectively, p_{1} is replaced in ( 2 ) by the empirical measure \hat{p}_{1}=\frac{1}{n}\sum_{i=1}^{n}\delta_{x^{(i)}} . This has an important consequence: the minimizer of ( 2 ), when p_{1} is replaced by \hat{p}_{1} , admits a closed-form \hat{v}^{\star} ( Gu et al. 2025 ; Bertrand et al. 2025 ) : \hat{v}^{\star}(x,t)=\sum_{i=1}^{n}\lambda_{i}(x,t)\frac{x^{(i)}-x}{1-t},\quad\text{where}\quad\lambda_{i}(x,t)=\softmax\left(\left(-\tfrac{\|x-tx^{(j)}\|^{2}}{2(1-t)^{2}}\right)_{j}\right)_{i}. (4) Paradoxically, using this closed-form velocity for generation can only reproduce samples from the training set. At the same time, this target velocity exhibits different behaviours across time: at t=0 , it points towards the dataset mean, while as t\to 1 it points towards a single training point. Thus, understanding why trained FM models work comes down to determining, qualitatively and quantitatively, at which times t and points x the models must deviate from the closed-form in order to generate new samples, still consistent with the data distribution. 3 Equivalence between flow matching and denoising 3.1 From flow matching to denoising We now lay down the procedure to construct a denoiser from a flow matching model. Using the identity x_{t}=(1-t)x_{0}+tx_{1} and the expression of the optimal velocity field ( 3 ), ones obtains the denoising identity 1 1 1 the denoiser is interchangeably written D(x,t) or D_{t}(x) for concision D_{t}^{\star}(x_{t}):=\mathbb{E}[x_{1}|x_{t},t]=x_{t}+(1-t)v^{\star}(x_{t},t), (5) namely the Minimum Mean Square Error estimator of the clean image x_{1} given the noisy observation x_{t} at time t . Thus,

Read the complete text