Finite-Time Analysis of Discrete-Time Stochastic Interpolants
Yuhao Liu, Yu Chen, Rui Hu, Longbo Huang · 2025
Read Finite-Time Analysis of Discrete-Time Stochastic Interpolants by Yuhao Liu, Yu Chen, Rui Hu, Longbo Huang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-09130.txt.
Introduction
Generative models built on stochastic interpolants promise a smooth bridge from noise to data, but real computers step in discrete jumps. Yuhao Liu and co-authors supply the missing error analysis in a 2025 paper.
Earlier theory assumed the bridge's equations were solved perfectly in continuous time. The new work designs a discrete sampler for the framework and bounds its total error after finite steps, the first such result. The bound shows how the gap between start and target distributions, and the accuracy of the learned pieces, set the convergence speed. It also suggests schedules that hurry the sampler along. Simulations backed the predicted rates.
Catalog record
| CREATOR | Yuhao Liu, Yu Chen, Rui Hu, Longbo Huang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 88 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-09130
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Finite-Time Analysis of Discrete-Time Stochastic Interpolants Yuhao Liu, Yu Chen, Rui Hu, Longbo Huang Abstract The stochastic interpolant framework offers a powerful approach for constructing generative models based on ordinary differential equations (ODEs) or stochastic differential equations (SDEs) to transform arbitrary data distributions. However, prior analyses of this framework have primarily focused on the continuous-time setting, assuming a perfect solution of the underlying equations. In this work, we present the first discrete-time analysis of the stochastic interpolant framework, where we introduce an innovative discrete-time sampler and derive a finite-time upper bound on its distribution estimation error. Our result provides a novel quantification of how different factors, including the distance between source and target distributions and estimation accuracy, affect the convergence rate and also offers a new principled way to design efficient schedules for convergence acceleration. Finally, numerical experiments are conducted on the discrete-time sampler to corroborate our theoretical findings. 1 Introduction Stochastic interpolants ( Albergo and Vanden-Eijnden,, 2023 ; Albergo et al.,, 2023 ) provide a general framework for constructing continuous mappings between arbitrary distributions. This framework draws inspiration from flow-based and diffusion-based models, which generate samples by continuously transforming data points from a base distribution to a target distribution via learned ordinary differential equations (ODEs) or stochastic differential equations (SDEs). Within the stochastic interpolant framework, one obtains learnable ODEs or SDEs that transport data by defining an interpolation between data points sampled from different distributions. This framework offers significant design flexibility and has demonstrated promising results in various applications, including probabilistic forecasting ( Chen et al., 2024b, ) , image generation ( Ma et al.,, 2024 ; Albergo et al.,, 2024 ) , and sequential modeling ( Chen et al., 2024a, ) . Despite its potential in real-world applications, there remains a gap between the theoretical analyses and practical implementations of stochastic interpolants. In practical scenarios, instead of perfectly solving the underlying equations, one can only access a learned estimator for a finite number of time steps, which necessitates the use of discrete-time samplers to simulate the true continuous generation process. However, previous analyses have largely focused on continuous-time generation, assuming perfect solutions to the underlying equations. This leads to a crucial question for bridging the gap: What is the convergence rate of discrete-time stochastic interpolant, and how to enhance its performance algorithmically? Similar problems have been studied in the theories of diffusion models, and most results were derived based on Girsanov-based methods in SDE analyses, which reduce the problem to providing upper bounds on the discretization errors. Specifically, existing analyses on the discretization errors can be mainly categorized into two types. The first type partitions the error into space-discretization and time-discretization. Among them, Lee et al., (2022) and Chen et al., 2023d () assume a uniform Lipschitz constant on the score function, while Chen et al., 2023a () do not, but they all utilize the Markovian property and the Gaussian form of the diffusion process to obtain their results. The second type uses Itô’s calculus to obtain upper bounds, such as Benton et al., (2024) , who adapt existing results from stochastic localization to produce tight bounds by finding the equivalence between two methods. However, the aforementioned ideas do not apply to stochastic interpolants due to the following key difference: the stochastic interpolant framework in consideration has a distinct structure introduced by a random interpolation between two distributions instead of a linear combination of one distribution with Gaussian, destroying the Markovian property. This difference not only necessitates novel analysis for the discretization errors of score functions but also requires additional analysis to bound the discretization errors for the velocity function, which arises from the general interpolation function introduced in this context. To tackle the above challenges, in this work, we offer the first finite-time convergence bound in Kullback-Leibler (KL) error for the SDE-based generative model within the stochastic interpolant framework. Our result presents a novel analysis building on existing Girsanov-based techniques. In the analysis of discretization errors, one key highlight of our approach is modeling the evolution of discretized terms via stochastic calculus. This allows us to decompose the discretization error into components linked to derivatives of conditional expectation. Notably, we leverage the Gaussian latent variables embedded within our stochastic interpolants, enabling the explicit representation of these derivatives as conditional expectations, and hence providing a key solution to the challenges. Our contributions. The main contributions of our paper are as follows. (i) This work presents the first finite-time convergence bound for the SDE-based generative model within the stochastic interpolant framework. Specifically, we formulate the discrete-time sampler using the Euler–Maruyama scheme and derive a general error bound on the generative process, which notably does not require Lipschitz assumptions on the score functions or velocity functions. This setting aligns with recent analyses of score-based diffusion models that relax Lipschitz assumptions on the score functions, such as those by Chen et al., 2023a () and Benton et al., (2024) . (ii) We propose a novel schedule of step sizes and rigorously bound the number of steps required to achieve an \varepsilon^{2} KL-error. In the specific case where the base distribution \rho_{0} is Gaussian, where our setting reduces to the standard diffusion model, our bound achieves the same order of dependence as that by Chen et al., 2023a () . (iii) We implement the sampler with our proposed schedule and conduct a comparison against using uniform step sizes. Our results validate the theoretical findings and demonstrate the superior performance of our schedule when no additional regularity conditions are assumed. 2 Related Works Stochastic Interpolants The concept of stochastic interpolants is introduced by Albergo and Vanden-Eijnden, (2023) , establishing a framework for constructing generative models based on continuous-time normalizing flows. Building upon this foundation, Albergo et al., (2023) extend the framework by incorporating Gaussian noise into the interpolant, effectively unifying flow-based and diffusion-based methods. Both Albergo and Vanden-Eijnden, (2023) and Albergo et al., (2023) investigate the impact of using estimators instead of the true velocities in the equations. Following the stochastic interpolants framework, several works have focused on specific applications. Albergo et al., (2024) utilize the framework to develop novel data coupling methods, addressing image generation tasks such as in-painting and super-resolution. Chen et al., 2024b () and Chen et al., 2024a () adapt the conditional generation framework with stochastic interpolants to tackle future state prediction and sequential modeling problems, respectively. Convergence Analysis of Diffusion Models Numerous results have been established on the convergence rates of diffusion models under various data assumptions ( Bortoli,, 2023 ; Lee et al.,, 2022 ) . Notably, Chen et al., 2023d () employ an approximation argument to apply Girsanov’s theorem in scenarios where the Novikov condition does not hold. Based on this analysis, Chen et al., 2023d () and Chen et al., 2023a () provide error bounds assuming Lipschitz score functions. Chen et al., 2023a () also develop a KL error bound without requiring Lipschitzness assumptions, leveraging early stopping. This bound is subsequently improved by Benton et al., (2024) , achieving a \varepsilon^{2} KL error in \tilde{O}\left(\frac{d\log^{2}(1/\delta)}{\varepsilon^{2}}\right) steps, which exhibits near-linear dependence on the dimension d . In addition to convergence rate analysis, several works have focused on problems such as score approximation ( Chen et al.,