Mean Flows for One-step Generative Modeling
Zhengyang Geng, Mingyang Deng, Xingjian Bai, J. Zico Kolter, Kaiming He · 2025
Read Mean Flows for One-step Generative Modeling by Zhengyang Geng, Mingyang Deng, Xingjian Bai, J. Zico Kolter, Kaiming He (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-13447.txt.
Introduction
Zhengyang Geng and co-authors present a 2025 paper on image generation in a single step. Most image makers refine a picture over many steps, which is slow. Their method rests on a fresh notion: the average speed of the flow that turns noise into an image, rather than its speed at each instant.
A clean identity links average and instant speeds, and that identity guides training. The model needs no pre-training, no teacher model, and no staged lessons. Trained from scratch on a standard image set, it scored well with just one evaluation step. The work narrows the gap between one-step and multi-step image makers.
Catalog record
| CREATOR | Zhengyang Geng, Mingyang Deng, Xingjian Bai, J. Zico Kolter, Kaiming He |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-13447
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Mean Flows for One-step Generative Modeling Zhengyang Geng, Mingyang Deng, Xingjian Bai, J. Zico Kolter, Kaiming He Abstract We propose a principled and effective framework for one-step generative modeling. We introduce the notion of average velocity to characterize flow fields, in contrast to instantaneous velocity modeled by Flow Matching methods. A well-defined identity between average and instantaneous velocities is derived and used to guide neural network training. Our method, termed the MeanFlow model, is self-contained and requires no pre-training, distillation, or curriculum learning. MeanFlow demonstrates strong empirical performance: it achieves an FID of 3.43 with a single function evaluation (1-NFE) on ImageNet 256 × \times 256 trained from scratch, significantly outperforming previous state-of-the-art one-step diffusion/flow models. Our study substantially narrows the gap between one-step diffusion/flow models and their multi-step predecessors, and we hope it will motivate future research to revisit the foundations of these powerful models. Figure 1: One-step generation on ImageNet 256 \times 256 from scratch . Our MeanFlow ( MF ) model achieves significantly better generation quality than previous state-of-the-art one-step diffusion/flow methods. Here, iCT [ 43 ] , Shortcut [ 13 ] , and our MF are all 1-NFE generation, while IMM’s 1-step result [ 52 ] involves 2-NFE guidance. Detailed numbers are in Tab. 2 . Images shown are generated by our 1-NFE model. 1 Introduction The goal of generative modeling is to transform a prior distribution into the data distribution. Flow Matching [ 28 , 2 , 30 ] provides an intuitive and conceptually simple framework for constructing flow paths that transport one distribution to another. Closely related to diffusion models [ 42 , 44 , 19 ] , Flow Matching focuses on the velocity fields that guide model training. Since its introduction, Flow Matching has seen widespread adoption in modern generative modeling [ 11 , 33 , 35 ] . Both Flow Matching and diffusion models perform iterative sampling during generation. Recent research has paid significant attention to few-step—and in particular, one-step, feedforward—generative models. Pioneering this direction, Consistency Models [ 46 , 43 , 15 , 31 ] introduce a consistency constraint to network outputs for inputs sampled along the same path. Despite encouraging results, the consistency constraint is imposed as a property of the network’s behavior, while the properties of the underlying ground-truth field that should guide learning remain unknown. Consequently, training can be unstable and requires a carefully designed “discretization curriculum” [ 46 , 43 , 15 ] to progressively constrain the time domain. In this work, we propose a principled and effective framework, termed MeanFlow , for one-step generation. The core idea is to introduce a new ground-truth field representing the average velocity , in contrast to the instantaneous velocity typically modeled in Flow Matching. Average velocity is defined as the ratio of displacement to a time interval, with displacement given by the time integral of the instantaneous velocity. Solely originated from this definition, we derive a well-defined, intrinsic relation between the average and instantaneous velocities, which naturally serves as a principled basis for guiding network training. Building on this fundamental concept, we train a neural network to directly model the average velocity field. We introduce a loss function that encourages the network to satisfy the intrinsic relation between average and instantaneous velocities. No extra consistency heuristic is needed. The existence of the ground-truth target field ensures that the optimal solution is, in principle, independent of the specific network, which in practice can lead to more robust and stable training. We further show that our framework can naturally incorporate classifier-free guidance (CFG) [ 18 ] into the target field, incurring no additional cost at sampling time when guidance is used. Our MeanFlow Models demonstrate strong empirical performance in one-step generative modeling. On ImageNet 256 \times 256 [ 7 ] , our method achieves an FID of 3.43 using 1-NFE (Number of Function Evaluations) generation. This result significantly outperforms previous state-of-the-art methods in its class by a relative margin of 50% to 70% ( Fig. 1 ). In addition, our method stands as a self-contained generative model: it is trained entirely from scratch, without any pre-training, distillation, or curriculum learning. Our study largely closes the gap between one-step diffusion/flow models and their multi-step predecessors, and we hope it will inspire future work to reconsider the foundations of these powerful models. 2 Related Work Diffusion and Flow Matching. Over the past decade, diffusion models [ 42 , 44 , 19 , 45 ] have been developed into a highly successful framework for generative modeling. These models progressively add noise to clean data and train a neural network to reverse this process. This procedure involves solving stochastic differential equations (SDE), which is then reformulated as probability flow ordinary differential equations (ODE) [ 45 , 22 ] . Flow Matching methods [ 28 , 2 , 30 ] extend this framework by modeling the velocity fields that define flow paths between distributions. Flow Matching can also be viewed as a form of continuous-time Normalizing Flows [ 36 ] . Few-step Diffusion/Flow Models. Reducing sampling steps has become an important consideration from both practical and theoretical perspectives. One approach is to distill a pre-trained many-step diffusion model into a few-step model, e.g., [ 39 , 14 , 41 ] or score distillation [ 32 , 50 , 53 ] . Early explorations into training few-step models [ 46 ] are built upon the evolution of distillation-based methods. Meanwhile, Consistency Models [ 46 ] are developed as a standalone generative model that does not require distillation. These models impose consistency constraints on network outputs at different time steps, encouraging them to produce the same endpoints along the trajectory. Various consistency models and training strategies [ 46 , 43 , 15 , 31 , 49 ] have been investigated. In recent work, several methods have focused on characterizing diffusion-/flow-based quantities with respect to two time-dependent variables. In [ 3 ] , a Flow Map is defined as the integral of the flow between two time steps, with several forms of matching losses developed for learning. In comparison to the average velocity our method is based on, the Flow Map corresponds to displacement. Shortcut Models [ 13 ] introduce a self-consistency loss function in addition to Flow Matching, which captures relationships between the flows at different discrete time intervals. Inductive Moment Matching [ 52 ] models the self-consistency of stochastic interpolants at different time steps. 3 Background: Flow Matching Figure 2: Velocity fields in Flow Matching [ 28 ] . Left : conditional flows [ 28 ] . A given z_{t} can arise from different (x,{\epsilon}) pairs, resulting in different conditional velocities v_{t} . Right : marginal flows [ 28 ] , obtained by marginalizing over all possible conditional velocities. The marginal velocity field serves as the underlying ground-truth field for network training. All velocities shown here are essentially instantaneous velocities. Illustration follows [ 12 ] . ( Gray dots: samples from prior; red dots: samples from data. ) Flow Matching [ 28 , 30 , 1 ] is a family of generative models that learn to match the flows, represented by velocity fields, between two probabilistic distributions. Formally, given data x\sim p_{\text{data}}(x) and prior {\epsilon}\sim p_{\text{prior}}({\epsilon}) , a