Inverse Flow and Consistency Models

Yuchen Zhang, Jian Zhou · 2025

Read Inverse Flow and Consistency Models by Yuchen Zhang, Jian Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-11333.txt.

Introduction

Cleaning noisy data when no clean copy exists is the hard task at the heart of a 2025 paper by Yuchen Zhang and Jian Zhou. Modern image and data tools learn to clean by studying clean samples first. That fails when clean samples cannot be had, as in many science settings.

The authors build a new frame that lets those tools learn the reverse task, from noisy data alone. They give two learning methods, one tied to flow models and one tied to fast one-step models. Tests on made-up and real data beat older ways and allow more kinds of noise. The work opens a path for cleaning data in fields with no clean ground truth.

Catalog record

CREATORYuchen Zhang, Jian Zhou
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-11333

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Inverse Flow and Consistency Models Yuchen Zhang, Jian Zhou Abstract Inverse generation problems, such as denoising without ground truth observations, is a critical challenge in many scientific inquiries and real-world applications. While recent advances in generative models like diffusion models, conditional flow matching, and consistency models achieved impressive results by casting generation as denoising problems, they cannot be directly used for inverse generation without access to clean data. Here we introduce Inverse Flow (IF), a novel framework that enables using these generative models for inverse generation problems including denoising without ground truth. Inverse Flow can be flexibly applied to nearly any continuous noise distribution and allows complex dependencies. We propose two algorithms for learning Inverse Flows, Inverse Flow Matching (IFM) and Inverse Consistency Model (ICM). Notably, to derive the computationally efficient, simulation-free inverse consistency model objective, we generalized consistency training to any forward diffusion processes or conditional flows, which have applications beyond denoising. We demonstrate the effectiveness of IF on synthetic and real datasets, outperforming prior approaches while enabling noise distributions that previous methods cannot support. Finally, we showcase applications of our techniques to fluorescence microscopy and single-cell genomics data, highlighting IF’s utility in scientific problems. Overall, this work expands the applications of powerful generative models to inversion generation problems. 1 Introduction Recent advances in generative modeling such as diffusion models ( Sohl-Dickstein et al., 2015 ; Ho et al., 2020 ; Song & Ermon, 2020 ; Song et al., 2021 ; Song et al., 2022 ) , conditional flow matching models ( Lipman et al., 2023 ; Tong et al., 2024 ) , and consistency models ( Song et al., 2023 ; Song & Dhariwal, 2023 ) have achieved great success by learning a mapping from a simple prior distribution to the data distribution through an Ordinary Differential Equation (ODE) or Stochastic Differential Equation (SDE). We refer to their models as continuous-time generative models. These models typically involve defining a forward process, which transforms the data distribution to the prior distribution over time, and generation is achieved through learning a reverse process that can gradually transform the prior distribution to the data distribution (Figure 1 ). Despite that those generative models are powerful tools for modeling the data distribution, they are not suitable for the inverse generation problems when the data distribution is not observed and only data transformed by a forward process is given, which is typically true for noisy real-world data measurements. Mapping from noisy data to the latent ground truth is especially important in various scientific applications when pushing the limit of measurement capabilities. This limitation necessitates the exploration of novel methodologies that can bridge the gap between generative modeling and effective denoising in the absence of clean data. Here we propose a new approach called Inverse Flow (IF) 1 1 1 Code available at https://github.com/jzhoulab/InverseFlow , that learns a mapping from the observed noisy data distribution to the unobserved, ground truth data distribution (Figure 1 ), inverting the data requirement of generative models. An ODE or SDE is specified to reflect knowledge about the noise distribution. We further devised a pair of algorithms, Inverse Flow Matching (IFM) and Inverse Consistency Model (ICM) for learning inverse flows. Specifically, ICM involves a computationally efficient simulation-free objective that does not involve any ODE solver. A main contribution of our approach is generalizing continuous-time generative models to inverse generation problems such as denoising without ground truth. In addition, in order to develop ICM, we generalized the consistency training objective for consistency models to any forward diffusion process or conditional flow. This broadens the scope of consistency model applications and has implications beyond denoising. Figure 1: Inverse flow enables adapting the family continuous-time generative models for solving inverse generation problems. For inverse flow matching and inverse consistency model, \mathbf{x}_{0} indicates unobserved data and \mathbf{x}_{1} indicates observed data. For conditional flow matching and consistency model, \mathbf{x}_{0} indicates data and \mathbf{x}_{1} indicates variable from the prior distribution. Inverse flow algorithms modify continuous-time generative models to solve the inverse generation problem of recovering unobserved \mathbf{x}_{0} from \mathbf{x}_{1} by replacing the unobserved p(\mathbf{x}_{0}) with generated q(\mathbf{x}_{0}) within the training loop. Compared to prior approaches for denoising without ground truth, IF offers the most flexibility in noise distribution, allowing almost any continuous noise distributions including those with complex dependency and transformations. IF can be seamlessly integrated with generative modeling to generate samples from the ground truth rather than the observed noisy distribution. More generally, IF models the past states of a (stochastic) dynamical system before the observed time points using the knowledge of its dynamics, which can have applications beyond denoising. 2 Background 2.1 Continuous-time generative models Our proposed inverse flow framework is built upon continuous-time generative models such as diffusion models, conditional flow matching, and consistency models. Here we present a unified view of these methods that will help connect inverse flow with this entire family of models (Section 3 ). These generative modeling methods are connected by their equivalence to continuous normalizing flow or neural ODE ( Chen et al., 2019 ) . They can all be considered as explicitly or implicitly learning the ODE that transforms between the prior distribution p(\mathbf{x}_{1}) and the data distribution p(\mathbf{x}_{0}) \displaystyle\mathrm{d}\mathbf{x}=\mathbf{u}_{t}(\mathbf{x})\mathrm{d}t. (1) in which \mathbf{u}_{t}(\mathbf{x}) represents the vector field of the ODE. We use the convention that t=0 corresponds to the data distribution and t=1 corresponds to the prior distribution. Generation is realized by reversing this ODE, which makes this family of methods a natural candidate for extension toward denoising problems. Continuous-time generative models typically involve defining a conditional ODE or SDE that determines the p(\mathbf{x}_{t}|\mathbf{x}_{0}) that transforms the data distribution to the prior distribution. Training these models involves learning the unconditional ODE (Eq. 1 ) based on \mathbf{x}_{0} and the conditional ODE or SDE ( Lipman et al., 2023 ; Tong et al., 2024 ; Song et al., 2021 ) (Figure 1 ). The unconditional ODE can be used for generation from noise to data. 2.1.1 Conditional flow matching Conditional flow matching defines the transformation from data to prior distribution via a conditional ODE vector field \mathbf{u}_{t}(\mathbf{x}\mid\mathbf{x}_{0}) . The unconditional ODE vector field \mathbf{v}^{\theta}_{t}(\mathbf{x}) is learned by minimizing the objective ( Lipman et al., 2023 ; Tong et al., 2024 ; Albergo & Vanden-Eijnden, 2023 ) : \displaystyle\left\|\mathbf{v}^{\theta}_{t}(\mathbf{x}_{t})-\mathbf{u}_{t}\left(\mathbf{x}_{t}\mid\mathbf{x}_{0}\right)\right\|. (2) where \mathbf{x}_{0} is sampled from the data distribution, and \mathbf{x}_{t} is sampled from the conditional distribution p(\mathbf{x}_{t}\mid\mathbf{x}_{0}) given by the conditional ODE. The conditional ODE vector field \mathbf{u}_{t}(\mathbf{x}\mid\mathbf{x}_{0}) can also be stochastically approximated through sampling from both prior distribution and data distribution and using the conditional vector field \mathbf{u}_{t}(\mathbf{x}\mid\mathbf{x}_{0},\mathbf{x}_{1}) as the training target ( Lipman et al., 2023 ; Tong et al., 2024 ) : \displaystyle\left\|\mathbf{v}^{\theta}_{t}(\mathbf{x}_{t})-\mathbf{u}_{t}\left(\mathbf{x}_{t}\mid\mathbf{x}_{0},\mathbf{x}_{1}\right)\right\|. (3) This formulation has the benefit that \mathbf{u}_{t}(\mathbf{x}\mid\mathbf{x}_{0},\mathbf{x}_{1}) can be easily chosen as any interpolation between \mathbf{x}_{0} and \mathbf{x}_{1} , because this interpolation does not affect the probability density at time 0 or 1 ( Lipman et al., 2023 ; Tong et al., 2024 ; Albergo & Vanden-Eijnden, 2023 ; Albergo et al., 2023 ) . For example, a linear interpolation corresponds to \mathbf{x}_{t}=\mathbf{x}_{0}+t(\mathbf{x}_{1}-\mathbf{x}_{0}) ( Lipman et al., 2023 ; Tong et al., 2024 ; Liu et al., 2022 ) . Sampling is realized by simulating the unconditional ODE with

Read the complete text