Flow-Anchored Consistency Models
Yansong Peng , Kai Zhu, Yu Liu, Pingyu Wu, Hebei Li, Xiaoyan Sun, Feng Wu · 2025
Read Flow-Anchored Consistency Models by Yansong Peng , Kai Zhu, Yu Liu, Pingyu Wu, Hebei Li, Xiaoyan Sun, Feng Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-03738.txt.
Introduction
Peng and co-authors stabilize the training of consistency models, a family of image generators prized for working in very few steps, in this 2025 paper. Training only on the shortcut goal, they argue, makes the model forget the underlying flow that defines good paths. That forgetting is what destabilizes learning.
Their model, called FACM, pairs the shortcut goal with a flow matching task that acts as an anchor. An expanded time range lets one network serve both tasks without clashes. Distilled from a strong image model, FACM reached top-tier quality scores in one or two steps. A memory-saving trick let the team scale training to a very large video-era model. Inference there sped up sharply.
Catalog record
| CREATOR | Yansong Peng , Kai Zhu, Yu Liu, Pingyu Wu, Hebei Li, Xiaoyan Sun, Feng Wu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-03738
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Flow-Anchored Consistency Models Yansong Peng , Kai Zhu, Yu Liu, Pingyu Wu, Hebei Li, Xiaoyan Sun, Feng Wu Abstract Continuous-time Consistency Models (CMs) promise efficient few-step generation but face significant challenges with training instability. We argue this instability stems from a fundamental conflict: by training a network to learn only a shortcut across a probability flow, the model loses its grasp on the instantaneous velocity field that defines the flow. Our solution is to explicitly anchor the model in the underlying flow during training. We introduce the Flow-Anchored Consistency Model (FACM), a simple but effective training strategy that uses a Flow Matching (FM) task as an anchor for the primary CM shortcut objective. This Flow-Anchoring approach requires no architectural modifications and is broadly compatible with standard model architectures. By distilling a pre-trained LightningDiT model, our method achieves a state-of-the-art FID of 1.32 with two steps (NFE=2) and 1.76 with just one step (NFE=1) on ImageNet 256 × \times 256, significantly outperforming previous methods. This provides a general and effective recipe for building high-performance, few-step generative models. Our code and pretrained models: https://github.com/ali-vilab/FACM . Figure 1: Generated 1-step and 2-step samples on ImageNet 256 \times 256 by our FACM. 1 Introduction As generative models scale to unprecedented sizes and applications demand real-time synthesis, the need for efficient, few-step samplers has become paramount. Consistency Models (CMs) ( Song et al. 2023 ) have emerged as a promising paradigm for few-step generation. Early successful works were largely based on discrete-time formulations ( Song et al. 2023 ; Song & Dhariwal 2023 ; Geng et al. 2024 ) , which are inherently prone to discretization errors. While their continuous-time counterparts can circumvent these errors, they have been historically hindered by severe training instability. Recent approaches, notably sCM ( Lu & Song 2024 ) , have made significant strides in stabilizing continuous-time training through a combination of regularization techniques and architectural modifications. Concurrently, another line of research has aimed to stabilize training by reformulating the shortcut objective itself. For instance, IMM ( Zhou et al. 2025 ) introduces additional self-consistency constraints between multiple timesteps, while MeanFlow ( Geng et al. 2025 ) models the “average velocity” to arbitrary endpoints, implicitly learning about the underlying flow. Although these methods achieve stable few-step sampling, they do not explicitly decouple the task of modeling the instantaneous velocity field from the task of predicting the shortcut. We contend that this entanglement leads to sub-optimal performance, as the model must learn both the foundational flow and the shortcut simultaneously through a single, overly-coupled objective. This paper addresses the root cause of instability in the continuous CM objective from a different perspective. We posit that the standard continuous CM objective, while powerful for learning a direct “shortcut” across a probability flow, is inherently unstable when trained in isolation. This is because it implicitly assumes the model has a robust understanding of the underlying flow, yet training exclusively on the shortcut objective can cause the model’s representation of this flow to degrade, leading to training collapse. Our key insight is that stability can be achieved by explicitly anchoring the model in the very flow it is shortcutting. The most direct way to achieve this Flow-Anchoring is to re-introduce the explicit training of the instantaneous velocity field that defines the flow. We propose that an objective based on Flow Matching (FM) ( Lipman et al. 2022 ) can act as a crucial anchor, enabling the primary shortcut objective to be trained effectively. Based on this principle, we introduce the Flow-Anchored Consistency Model (FACM), which employs a simple yet effective training strategy combining two distinct objectives: • Flow-Anchoring Objective that learns the flow’s velocity field to provide stability. • Shortcut Objective that learns the efficient 1-step consistency mapping. Our method is an architecturally-agnostic training strategy. We propose two effective implementations for this mixed-objective design, including an innovative Expanded Time Interval strategy that achieves optimal results without any architectural modifications. It supports both stable training from scratch and distillation from a pre-trained FM model, with the distillation pathway achieving superior performance at a significantly lower total training cost. Our approach sets new state-of-the-art FID scores of 1.76 (NFE=1) and 1.32 (NFE=2) on the class-conditional ImageNet 256 \times 256 benchmark, providing a general recipe for building high-performance, few-step generative models. 2 Preliminaries Generative modeling aims to learn a probability flow ODE, \mathrm{d}\bm{x}_{t}/\mathrm{d}t=\bm{v}_{\theta}(\bm{x}_{t},t) , that transforms a prior distribution p_{0} (e.g., \mathcal{N}(0,I) ) to a data distribution p_{1} . 2.1 Flow Matching Flow Matching (FM) ( Liu et al. 2022 ; Albergo & Vanden-Eijnden 2022 ; Lipman et al. 2022 ) learns the vector field \bm{v}_{\theta} by regressing the network’s output against a conditional velocity field. This is achieved by defining a probability path between a noise sample \bm{x}_{0}\sim p_{0} and a data sample \bm{x}_{1}\sim p_{1} . A simple and effective choice is OT-FM defined as \bm{x}_{t}=(1-t)\bm{x}_{0}+t\bm{x}_{1} , which has a constant conditional velocity of \bm{x}_{1}-\bm{x}_{0} . By training the model to predict this easily computable conditional velocity, it learns the marginal velocity field. This leads to the practical Flow Matching objective: \mathcal{L}_{\text{FM}}(\theta)=\mathbb{E}_{t,\bm{x}_{0},\bm{x}_{1}}\left\|\bm{v}_{\theta}(\bm{x}_{t},t)-(\bm{x}_{1}-\bm{x}_{0})\right\|_{2}^{2}. (1) 2.2 Consistency Models Consistency Models (CMs) ( Song et al. 2023 ) are trained to map any point \bm{x}_{t} on a given ODE trajectory directly to the trajectory’s endpoint in a single step. This is enforced through a self-consistency property: for any two points \bm{x}_{t} and \bm{x}_{t}^{\prime} on the same trajectory, their outputs must be identical, i.e., f_{\theta}(\bm{x}_{t},t)=f_{\theta}(\bm{x}_{t}^{\prime},t^{\prime}) . This implies that for an ideal model, f_{\theta}(\bm{x}_{t},t) should equal the trajectory’s endpoint \bm{x}_{1} for all t\in[0,1] , which imposes a boundary condition f_{\theta}(\bm{x}_{1},1)=\bm{x}_{1} . CMs can be trained in both discrete and continuous time. Discrete-time CMs enforce consistency between two adjacent points with a finite distance, f_{\theta}(\bm{x}_{t},t)\approx f_{\theta^{-}}(\bm{x}_{t+\Delta t},t+\Delta t) , an approach that is inherently prone to discretization errors. Our work focuses on the continuous-time formulation. Here, the consistency property requires the total derivative of the shortcut function to be zero, \frac{\mathrm{d}f_{\theta}(\bm{x}_{t},t)}{\mathrm{d}t}=0 . To satisfy the boundary condition, the function is parameterized as f_{\theta}(\bm{x}_{t},t)=\bm{x}_{t}+(1-t)\bm{F}_{\theta}(\bm{x}_{t},t) , which implies that the network \bm{F}_{\theta} must satisfy: \bm{F}_{\theta}(\bm{x}_{t},t)=\bm{v}+(1-t)\frac{\mathrm{d}\bm{F}_{\theta}(\bm{x}_{t},t)}{\mathrm{d}t}. (2) Here, \bm{v} represents the conditional velocity \bm{x}_{1}-\bm{x}_{0} from the underlying flow. In the distillation paradigm, this velocity is provided by a pre-trained FM teacher, which can also incorporate classifier-free guidance (CFG) ( Ho & Salimans 2022 ) . This objective, which relies on the Jacobian-vector product (JVP) to compute the derivative term, is known to be unstable to train ( Lu & Song 2024 ) . 3 Flow-Anchored Consistency Models (FACM) This section first analyzes the core instability of continuous-time Consistency Models (CMs), identifying the “missing anchor” as the root cause. We then present our solution, the Flow-Anchored Consistency Model (FACM), detailing its mixed-objective training strategy. 3.1 Deconstructing CM Instability: The Missing Anchor Our analysis reframes the challenge of training continuous-time Consistency Models. We argue that the instability is not an inherent flaw of the shortcut objective itself, but a consequence of training on it in isolation, which causes the model to lose its anchor in the flow’s underlying velocity field. 3.1.1 The Shortcut Target as an Average Velocity To understand the mechanics of the generative shortcut, we first re-examine the consistency model’s learning objective. The goal