The Velocity Deficit: Initial Energy Injection for Flow Matching
Linze Li, Zong-Wei Hong, Shen Zhang, Bo Lin, Jinglun Li, Yao Tang, Jiajun Liang · 2026
Read The Velocity Deficit: Initial Energy Injection for Flow Matching by Linze Li, Zong-Wei Hong, Shen Zhang, Bo Lin, Jinglun Li, Yao Tang, Jiajun Liang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14819.txt.
Introduction
Li and team identify a Velocity Deficit in flow matching. The mean squared error objective tends to lower velocity size. Samples thus fail to reach the data manifold, an effect termed Integration Lag. Two fixes are proposed. Magnitude-Aware Flow Matching trains with size awareness. The Scale Schedule Corrector needs no retraining. Contraction is shown to harm the trajectory start yet help denoising at its end. On ImageNet, the corrector is claimed to improve FID by about forty-five percent with five times faster generation.
Catalog record
| CREATOR | Linze Li, Zong-Wei Hong, Shen Zhang, Bo Lin, Jinglun Li, Yao Tang, Jiajun Liang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59642 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.14819
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Velocity Deficit: Initial Energy Injection for Flow Matching Linze Li, Zong-Wei Hong, Shen Zhang, Bo Lin, Jinglun Li, Yao Tang, Jiajun Liang Abstract While Flow Matching theoretically guarantees constant-velocity trajectories, we identify a critical breakdown in high-dimensional practice: the Velocity Deficit. We show that the MSE objective systematically underestimates velocity magnitude, causing generated samples to fail to reach the data manifold—a phenomenon we term Integration Lag. To rectify this, we propose Initial Energy Injection, instantiated via two complementary methods: the training-based Magnitude-Aware Flow Matching (MAFM) and the training-free Scale Schedule Corrector (SSC). Both are grounded in our discovery of a crucial asymmetry: velocity contraction causes harmful kinetic stagnation at the trajectory’s start, yet acts as a beneficial denoising mechanism at its end. Empirically, SSC yields significant efficiency gains with zero retraining and just one line of code. On ImageNet-1k ( 256 × 256 256\times 256 ), it improves FID by 44.6% (from 13.68 to 7.58) and achieves a 5 × \times speedup, enabling a 50-step generator (FID 7.58) to beat a 250-step baseline (FID 8.65). Furthermore, our methods generalize to Text-to-Image tasks and high-resolution generation, improving FID on MS-COCO by ∼ \sim 22%. Figure 1 : The Velocity Deficit Phenomenon and Correction Strategy. (a) On ImageNet-1k 256\times 256 , the learned baseline magnitude ( Blue ) of SiT decays monotonically, deviating from the constant OT target and creating a Velocity Deficit (Shaded Area), which represents the missing kinetic energy required for transport. (b) The velocity deficit leads to pronounced visual degradation in baseline samples, including Residual Artifacts , Incomplete Object , and Distorted Details . SSC effectively mitigates these failures by initial energy injection. (c) Standard flow matching models ( Blue ) fail to generate trajectories that reach the target data manifold (Black Ring), resulting in a significant Integration Lag . Our correction ( Green ) compensates for the signal starvation, drastically reducing this lag. 1 Introduction Flow Matching (FM) ( 16 ) has rapidly emerged as a powerful paradigm for training Continuous Normalizing Flows (CNFs), offering a robust alternative to diffusion models. By regressing a time-dependent vector field v(x,t) , FM constructs a probability path that transports a simple source distribution p_{0} (noise) to a complex target distribution p_{1} (data). Theoretically, Flow Matching constructs deterministic straight-line paths, implying that particles should traverse from t=0 (noise) to t=1 (data) with a constant velocity vector v_{target}=x_{1}-x_{0} . Consequently, the optimal velocity magnitude should be time-invariant: \|v_{target}\|\equiv\|x_{1}-x_{0}\| . Velocity Deficit. Despite the theoretical guarantee of straight-line paths, we identify a systematic discrepancy between the ideal transport dynamics and those learned by neural networks in practice. While prior works have focused on rectifying the curvature of trajectories (e.g., via Reflow ( 17 ) or distillation ( 25 ) ), we reveal a more fundamental dynamical bias: the Velocity Deficit. As illustrated in Figure 1 (a), we observe that in high-dimensional spaces, FM models consistently underestimate the required velocity magnitude. Instead of maintaining the constant target norm \|x_{1}-x_{0}\| , the predicted magnitude \|v_{\theta}(x,t)\| exhibits a monotonic decay, dropping from the noise norm \|x_{0}\| to the data norm \|x_{1}\| . Crucially, under the assumption of high-dimensional orthogonality ( 14 ) , both norms are strictly smaller than the target transport distance ( \sqrt{\|x_{1}\|^{2}+\|x_{0}\|^{2}} ). In section 3 , we formally analyze this phenomenon, attributing it to the properties of the Mean Squared Error (MSE) objective in high-dimensional regression. Consequence: Integration Lag. This systematic underestimation of velocity has severe consequences for generation quality. During numerical integration (e.g., Euler sampling), the deficient velocity field fails to push particles effectively across the probability gap within the unit time interval. We term this phenomenon Integration Lag. As a result, generated samples often fail to fully converge to the data manifold, remaining “upstream” in the flow. Qualitatively, this manifests as residual artifacts, incomplete objects or distorted local details, as shown in Figure 1 (b). A naive solution to mitigate this lag is to explicitly rectify the predicted velocity magnitude. However, we empirically find that a global, uniform boost is suboptimal as it tends to re-inject noise and over-smooth high-frequency details during the final stages of generation. This suggests that the impact of the velocity deficit is not uniform but evolves dynamically across the trajectory. This leads to our key observation: Asymmetric Energy Injection. While the MSE objective drives velocity magnitude decay globally, our analysis reveals that this contraction plays fundamentally opposing roles at the trajectory boundaries: • At t\to 0 (Noise end), the contraction is Harmful (Signal Starvation): The model underestimates the signal component, preventing particles from initiating transport. This leads to structurally deficient samples (high FID) as the solver fails to reach the data manifold. • At t\to 1 (Data end), the contraction is Beneficial (Detail Preservation): Here, the velocity decay acts as an implicit denoising mechanism. While boosting the scale at the end can reduce noise, it risks over-smoothing high-frequency details. Therefore, respecting the natural contraction is crucial for preserving sharp textures and ensuring realistic convergence. Proposed Solution. Based on this insight, we argue that the solution lies in Asymmetric Energy Injection rather than global magnitude forcing. In this paper, we introduce two complementary solutions: (1) Magnitude-Aware Flow Matching (MAFM) : A training-based objective that augments the standard loss with explicit magnitude supervision, forcing the model to overcome magnitude collapse during training. (2) Scale Schedule Corrector (SSC) : A training-free, ’plug-and-play’ inference intervention that applies a time-dependent scaling factor \gamma(t) to the velocity field. SSC injects kinetic energy at the beginning ( t\to 0 ) to compensate for integration lag while annealing to identity at the end ( t\to 1 ). Contributions. Our main contributions are as follows: 1. Theoretical Analysis: We formally identify and define the Velocity Deficit , characterizing it as a structural bias of MSE minimization that leads to Integration Lag in high dimensions. Crucially, we uncover a dynamical asymmetry where velocity contraction is harmful at the start but beneficial for denoising at the end. 2. Methodology: Based on the discovery of asymmetry, we propose the principle of Initial Energy Injection . We provide two instantiations: Magnitude-Aware Flow Matching (MAFM) for training and the Scale Schedule Corrector (SSC) for inference. SSC serves as a plug-and-play method that requires zero retraining and negligible overhead. 3. Efficiency & Performance: We demonstrate that SSC significantly boosts performance in efficiency-critical regimes. On ImageNet-1k 256\times 256 , it reduces the FID from 13.68 to 7.58 at NFE(Number of Function Evaluations)=50, a 44.6% improvement. This outperforms the 250-step baseline (FID 8.65), representing a 5 \times speedup . Furthermore, our methods generalize to Text-to-Image tasks and high-resolution generation, improving MS-COCO FID by \sim 22% (FID from 6.03 to 4.71). 2 Related Work 2.1 Flow Matching and Continuous Generative Models Generative modeling has evolved from discrete-time frameworks ( 27 ; 10 ) to continuous formulations grounded in Neural ODEs ( 4 ) . While ( 28 ) unified these through Stochastic Differential Equations (SDEs), Flow Matching (FM) ( 16 ) and concurrent Stochastic Interpolants ( 1 ) offer a simulation-free alternative by regressing a time-dependent vector field v_{t}(x) . This vector field drives the ODE(Ordinary Differential Equation) solver to transport a simple source distribution p_{0} to the complex data distribution p_{1} .