Flow Matching in the Low-Noise Regime: Pathologies and a Contrastive Remedy
Weili Zeng, Yichao Yan · 2025
Read Flow Matching in the Low-Noise Regime: Pathologies and a Contrastive Remedy by Weili Zeng, Yichao Yan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-20952.txt.
Introduction
Flow matching trains generative models by learning a velocity field that carries noise into data. Weili Zeng and Yichao Yan uncover a flaw in that training at very low noise levels in a 2025 paper. They call it the low-noise pathology.
As noise approaches zero, tiny input perturbations can demand huge changes in the velocity target. The learning problem's condition number diverges, slowing optimization. Worse, the encoder spends its limited sensitivity on noise directions instead of meaning, degrading the learned representations. The authors give the first theoretical analysis of this effect. They then propose a contrastive remedy that stabilizes training in the low-noise regime. The work matters for both generation quality and representation learning.
Catalog record
| CREATOR | Weili Zeng, Yichao Yan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-20952
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Flow Matching in the Low-Noise Regime: Pathologies and a Contrastive Remedy Weili Zeng, Yichao Yan Abstract Flow matching has recently emerged as a powerful alternative to diffusion models, providing a continuous-time formulation for generative modeling and representation learning. Yet, we show that this framework suffers from a fundamental instability in the low-noise regime. As noise levels approach zero, arbitrarily small perturbations in the input can induce large variations in the velocity target, causing the condition number of the learning problem to diverge. This ill-conditioning not only slows optimization but also forces the encoder to reallocate its limited Jacobian capacity toward noise directions, thereby degrading semantic representations. We provide the first theoretical analysis of this phenomenon, which we term the low-noise pathology , establishing its intrinsic link to the structure of the flow matching objective. Building on these insights, we propose Local Contrastive Flow (LCF), a hybrid training protocol that replaces direct velocity regression with contrastive feature alignment at small noise levels, while retaining standard flow matching at moderate and high noise. Empirically, LCF not only improves convergence speed but also stabilizes representation quality. Our findings highlight the critical importance of addressing low-noise pathologies to unlock the full potential of flow matching for both generation and representation learning. 1 Introduction Generative models ( Ho et al. 2020 ; Song et al. 2020 ; Lipman et al. 2022 ; Liu et al. 2022 ) have become central to modern machine learning, delivering state-of-the-art performance in tasks ranging from image ( Esser et al. 2024 ) and speech synthesis ( Liu et al. 2023 ) to molecular design ( Irwin et al. 2024 ) and scientific simulation ( Wildberger et al. 2023 ). Models such as diffusion models and flow models not only excel at producing high-fidelity samples but also offer the intriguing promise of learning representations that capture the underlying semantic structure of data ( Li et al. 2023 ; Xiang et al. 2023b ; Chen et al. 2024 ). This dual capability has fueled growing interest in leveraging generative models as universal tools for both data generation and representation learning, bridging synthesis and understanding within a unified framework. Flow models, in particular, provide a principled and efficient alternative to score-based diffusion models, enabling direct learning of continuous dynamics that map simple distributions to complex data. A key feature of these models is their training objective, which enforces consistency of the predicted velocity fields across multiple noise scales. This multi-scale supervision not only stabilizes training but also enforces semantic consistency of the data across different variations. Such a formulation naturally aligns with the objectives of representation learning ( Chen et al. 2020 ; Hadsell et al. 2006 ; He et al. 2020 ), prompting a fundamental question: Can generative models reliably learn useful representations directly from clean data ? Intuitively, one might expect that the cleaner the data, the easier it should be for a model to extract semantic information. Clean data lies close to the true data manifold, free of artificial distortions, and is often the most desirable input for downstream tasks such as classification, clustering, and segmentation. Surprisingly, however, our empirical evidence suggests a starkly different reality. We evaluated the target loss and representation quality under different noise intervals. As shown in Figure 1 , when training on samples with very low noise levels, which correspond to small time values in flow-based models, generative models often encounter significant learning difficulties. The loss curves exhibit poor convergence behavior, and the quality of the learned representations is substantially lower than that obtained at moderate noise levels. This occurs precisely in the regime where the input data are nearly identical to the original clean examples, creating an apparent paradox: why does training become more difficult as data approaches its clean form? Figure 1: Low-noise pathology in flow matching. (a) Ill-posed objective: the objective loss in low-noise regions significantly larger than at moderate or high noise levels, even compared to fully noisy inputs. (b) Degraded convergence: gradient-based optimization converges extremely slowly in the low-noise regime, so that training objective at small t dominate the overall loss landscape and become the primary bottleneck in the later stages of training. (c) Representation degradation: representation quality does not decrease monotonically with t , exhibiting an anomalous degradation under extremely low-noise regime. We train on CIFAR-10 and evaluate using the test set. This phenomenon, which we term the low-noise pathology , is the central focus of our work. In rectified flow models, data samples are interpolated between clean data and random noise through a time-dependent process defined as x_{t}=(1-t)\cdot x_{0}+t\cdot\epsilon . As t decreases toward zero, the supervision targets, such as the vector field x_{0}-\epsilon , remain large and highly variable, while the differences between inputs simultaneously shrink because the contribution of \epsilon to x_{t} vanishes. This imbalance leads to a profound mismatch between the scale of input perturbations and the magnitude of the outputs that the model is required to predict. We demonstrate that this mismatch induces a sharp increase in the condition number ( Belsley et al. 1980 ; Pesaran 2015 ) of the learning problem as the noise level decreases. In particular, we prove that the ratio between the magnitude of the output variations required by the model and the corresponding input differences scales inversely with the noise parameter t . As t\to 0 , this ratio diverges, resulting in an increasingly ill-conditioned loss landscape that severely impedes optimization. This phenomenon offers a theoretical explanation for the empirical difficulties observed in the low-noise regime. Furthermore, the instability extends beyond optimization: it undermines the quality of learned representations. Features extracted under these conditions often degenerate, losing their semantic discriminability and thus their utility for downstream tasks. To address these issues, we present the first rigorous theoretical analysis of the low-noise pathology in flow models. We trace the root of this instability to the statistical properties of the target vector field, revealing that such numerical issues emerge as an inherent consequence of the generative modeling objective itself. Building on these insights, we propose a novel training method termed Local Contrastive Flow . In contrast to conventional flow matching approaches that apply direct supervision at extremely low noise levels, our method adopts a contrastive learning paradigm. Representations obtained at moderate noise levels, where training dynamics are more stable and semantic information is better preserved, are used as anchors. The model is trained to align the representations of slightly perturbed versions of the same input with these anchors, while simultaneously encouraging greater separation between representations of different inputs. Since training at moderate noise levels preserves semantic structure without inducing numerical instability, this alignment enables the transfer of robust semantic features to representations at lower noise levels. As a result, LCF not only accelerates the training process but also improves the semantic quality of the learned representations, enhancing their effectiveness in downstream tasks. We validate our approach through comparative experiments, demonstrating that LCF significantly improves both convergence speed and the quality of learned representations in flow models. Our results highlight that understanding and resolving the low-noise pathology is critical for unlocking the full potential of generative models as tools for both data generation and representation learning. In summary, our contributions