Tight Bounds for Schrödinger Potential Estimation in Unpaired Image-to-Image Translation Problems

Nikita Puchkin, Denis Suchkov, Alexey Naumov, Denis Belomestny · 2025

Read Tight Bounds for Schrödinger Potential Estimation in Unpaired Image-to-Image Translation Problems by Nikita Puchkin, Denis Suchkov, Alexey Naumov, Denis Belomestny (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-07392.txt.

Introduction

Generative models that turn one kind of data into another often rest on Schrödinger bridges, a method that finds the cheapest path between a starting spread of data and a target spread. Nikita Puchkin, Denis Suchkov, Alexey Naumov, and Denis Belomestny study the case where only samples from the two ends are available, with no paired examples. They pick a standard drifting process as the reference and estimate the potential that steers it.

The team measures error with a divergence between couplings and derives tight bounds on how well a risk-based estimate of the potential can generalize. The bounds cover a class of potentials that includes Gaussian mixtures. Thanks to the mixing behavior of the reference process, their error rates come close to fast rates, apart from small extra factors, and numerical tests back up the theory.

Catalog record

CREATORNikita Puchkin, Denis Suchkov, Alexey Naumov, Denis Belomestny
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE174 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-07392

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Tight Bounds for Schrödinger Potential Estimation in Unpaired Image-to-Image Translation Problems Nikita Puchkin, Denis Suchkov, Alexey Naumov, Denis Belomestny Abstract Modern methods of generative modelling and unpaired image-to-image translation based on Schrödinger bridges and stochastic optimal control theory aim to transform an initial density to a target one in an optimal way. In the present paper, we assume that we only have access to i.i.d. samples from initial and final distributions. This makes our setup suitable for both generative modelling and unpaired image-to-image translation. Relying on the stochastic optimal control approach, we choose an Ornstein-Uhlenbeck process as the reference one and estimate the corresponding Schrödinger potential. Introducing a risk function as the Kullback-Leibler divergence between couplings, we derive tight bounds on generalization ability of an empirical risk minimizer in a class of Schrödinger potentials including Gaussian mixtures. Thanks to the mixing properties of the Ornstein-Uhlenbeck process, we almost achieve fast rates of convergence up to some logarithmic factors in favourable scenarios. We also illustrate performance of the suggested approach with numerical experiments. 1 Introduction The Schrödinger bridge problem has emerged as a powerful framework in modern generative modelling and unpaired image-to-image translation. It formulates the task of transforming an initial distribution into a target one via a probabilistic coupling that is as close as possible—in the sense of relative entropy—to a prescribed reference dynamics. In the present paper, we assume that both initial and target distributions are absolutely continuous and denote their densities with respect to the Lebesgue measure by \rho_{0} and \rho_{T} , respectively. Let \mathsf{q}_{t}(y\,|\,x), t\in[0,T], denote the transition density of a time-homogeneous reference Markov process X^{0} (typically a diffusion), and let \pi^{0} be the joint distribution of (X_{0}^{0},X_{T}^{0}) on \mathbb{R}^{d}\times\mathbb{R}^{d} given by the initial distribution \rho_{0} and the forward dynamics of the reference process. Then, the Schrödinger bridge problem seeks a coupling \pi(x,y) between \rho_{0} and \rho_{T} that minimizes the Kullback-Leibler (KL) divergence \inf_{\pi\in\Pi(\rho_{0},\rho_{T})}{\mathsf{KL}}(\pi,\pi^{0}), (1) where \Pi(\rho_{0},\rho_{T}) denotes the set of all couplings with the prescribed marginals. This marginal formulation of the Schrödinger problem avoids dealing with full path measures and is particularly amenable to sample-based estimation. Under mild regularity conditions, the minimizer \pi^{*} of the variational problem ( 1 ) admits a specific form (see ( Leonard 2014 , Theorem 2.4) ): \pi^{*}(x,y)=\nu_{0}^{\star}(x)\,\mathsf{q}_{T}(y\,|\,x)\,\nu_{T}^{\star}(y), (2) where \nu_{0}^{\star} and \nu_{T}^{\star} are positive functions referred to as Schrödinger potentials. These scaling functions modify the reference transition structure so that the resulting coupling satisfies the marginal constraints. From this coupling, one can construct the corresponding Schrödinger bridge process X^{*} , which is a time-inhomogeneous Markov process with dynamics governed by a drift-modified version of the reference process. Usually, researchers consider a reference process of the form {\mathrm{d}}X_{t}^{0}=\sigma\,{\mathrm{d}}W_{t},\quad 0\leqslant t\leqslant T, (3) where W_{t} is a standard d -dimensional Wiener process and \sigma>0 . The motivation for such choice is that the problem ( 1 ) with the reference process ( 3 ) is equivalent to the entropic optimal transport problem \inf\limits_{\pi\in\Pi(\rho_{0},\rho_{T})}\int\limits_{\mathbb{R}^{d}}\int\limits_{\mathbb{R}^{d}}\frac{1}{2}\|x-y\|^{2}\pi(x,y)\,{\mathrm{d}}x\,{\mathrm{d}}y+\sigma^{2}{\mathsf{KL}}(\pi,\rho_{0}\otimes\rho_{T}), which is studied quite well. However, there are two drawbacks. First, the entropic optimal transport formulation deals with scalar parameter \sigma and does not take into account possible anisotropy of the data. Second, if the reference dynamics obeys ( 3 ), then the correlation between X_{0}^{0} and X_{T}^{0} decays at slow polynomial rate. In the context of image-to-image translation, this could mean that initial images have an overabundant and possibly negative influence on the final ones. As a consequence, a learner has to take larger values of \sigma or T to mitigate this effect. In this work, we take the Ornstein-Uhlenbeck (OU) process as the reference dynamics. To be more specific, we will consider the base process X_{t}^{0} solving the SDE {\mathrm{d}}X_{t}^{0}=b\left(m-X_{t}^{0}\right){\mathrm{d}}t+\Sigma^{1/2}{\mathrm{d}}W_{t},\quad 0\leqslant t\leqslant T, (4) where b>0 controls the drift rate, m\in\mathbb{R}^{d} represents the mean-reversion level, and \Sigma\in\mathbb{R}^{d\times d} is a positive definite symmetric matrix. Analytic tractability and exponential mixing properties of the OU dynamics make it especially suitable for both theoretical analysis and practical computation. The corresponding Schrödinger bridge process X^{*} evolves under the modified drift {\mathrm{d}}X_{t}^{*}=b^{*}(t,X_{t}^{*}){\mathrm{d}}t+\Sigma^{1/2}{\mathrm{d}}W_{t},\quad X_{0}^{*}\sim\rho_{0}, (5) where b^{*}(t,x)=b(m-x)+\nabla\log\nu^{\star}_{t}(x), (6) and \nu^{\star}_{t}(x) denotes the time-evolved Schrödinger potential given by \nu^{\star}_{t}(x)=\int\nu^{\star}_{T}(y)\,\mathsf{q}_{T-t}(y\,|\,x)\,{\mathrm{d}}y. This yields a controlled diffusion that transitions from \rho_{0} to \rho_{T} in a way that remains close to the reference process. We also would like to note that the controlled diffusion ( 5 ) solves the stochastic optimal control problem (see Dai Pra 1991 ). The expression ( 2 ) for the optimal coupling \pi^{*} suggests us to look for the solution of the problem ( 1 ) of the form \pi^{\varphi}(x,y)=\nu_{0}^{\varphi}(x)\,\mathsf{q}_{T}(y\,|\,x)\,e^{\varphi(y)},\quad\pi^{\varphi}\in\Pi(\rho_{0},\rho_{T}), where \varphi belongs to a closed parametric class \Phi . The best log-potential \varphi^{\circ} minimizes the Kullback-Leibler (KL) divergence between \pi^{*} and \pi^{\varphi} : \varphi^{\circ}\in\operatornamewithlimits{argmin}\limits_{\varphi\in\Phi}{\mathsf{KL}}(\pi^{*},\pi^{\varphi}), where {\mathsf{KL}}(\pi^{*},\pi^{\varphi})=\int\limits_{\mathbb{R}^{d}}\int\limits_{\mathbb{R}^{d}}\log\frac{\pi^{*}(x,y)}{\pi^{\varphi}(x,y)}\,\pi^{\varphi}(x,y)\,{\mathrm{d}}x\,{\mathrm{d}}y. For any function g:\mathbb{R}^{d}\rightarrow\mathbb{R} and any t>0 , let {\mathcal{T}}_{t}[g](x)=\int\limits_{\mathbb{R}^{d}}g(y)\,\mathsf{q}_{t}(y\,|\,x)\,{\mathrm{d}}y stand for the Ornstein-Uhlenbeck operator applied to g . Let us note that the condition \rho_{0}(x)=\int\limits_{\mathbb{R}^{d}}\pi^{\varphi}(x,y)\,{\mathrm{d}}y yields that \nu_{0}^{\varphi}(x)=\rho_{0}(x)/{\mathcal{T}}_{T}[e^{\varphi}](x) . For this reason, we can rewrite \pi^{\varphi} in the following form: \pi^{\varphi}(x,y)=\frac{\rho_{0}(x)\,\mathsf{q}_{T}(y\,|\,x)\,e^{\varphi(y)}}{{\mathcal{T}}_{T}[e^{\varphi}](x)}. (7) Similarly, the optimal coupling satisfies the equality \pi^{*}(x,y)=\frac{\rho_{0}(x)\,\mathsf{q}_{T}(y\,|\,x)\,e^{\varphi^{*}(y)}}{{\mathcal{T}}_{T}[e^{\varphi^{*}}](x)},\,\varphi^{*}=\log(\nu^{*}_{T}). (8) Hence, we can represent the KL-divergence between \pi^{*} and \pi^{\varphi} as the difference {\mathsf{KL}}(\pi^{*},\pi^{\varphi})={\mathcal{L}}(\varphi)-{\mathcal{L}}(\varphi^{*}), (9) where {\mathcal{L}}(\varphi)=\mathbb{E}_{Z\sim\rho_{0}}\log{\mathcal{T}}_{T}[e^{\varphi}](Z)-\mathbb{E}_{Y\sim\rho_{T}}\varphi(Y). (10) Our focus lies on statistical aspects of Schrödinger potential estimation. We assume that \rho_{0} and \rho_{T} are accessed through i.i.d. samples Z_{1},\dots,Z_{N} and Y_{1},\dots,Y_{n} , respectively. In what follows, we assume that N=n for simplicity. The objective {\mathcal{L}}(\varphi) has a remarkable property that it includes only marginal distributions \rho_{0} and \rho_{T} , rather than the coupling \pi^{*} . Hence, we do not have to make any presumptions about joint distribution of Z_{j} ’s and Y_{i} ’s. A natural strategy to estimate \pi^{*} and \varphi^{*} is to replace the integrals in ( 10 ) by empirical means and consider the estimates \widehat{\pi}=\pi^{\widehat{\varphi}}\quad\text{and}\quad\widehat{\varphi}\in\operatornamewithlimits{argmin}\limits_{\varphi\in\Phi}\widehat{\mathcal{L}}(\varphi), (11) where \displaystyle\widehat{\mathcal{L}}(\varphi)=\frac{1}{n}\sum\limits_{j=1}^{n}\log{\mathcal{T}}_{T}[e^{\varphi}](Z_{j})-\frac{1}{n}\sum\limits_{i=1}^{n}\varphi(Y_{i}). (12) In the present paper, we are interested in generalization ability of the empirical risk minimizer \widehat{\pi} . Contribution. The main theoretical contribution of this paper is a non-asymptotic high-probability generalization error bound for the empirical risk minimizer ( 11 ). Using concentration arguments and exploiting the ergodic properties of the OU process, we establish nearly fast convergence rates (up to logarithmic factors) for the population KL risk. These results highlight the statistical efficiency of the Schrödinger bridge approach in the finite-sample regime. Finally, we validate our theoretical findings with numerical experiments on synthetic and real data, demonstrating the robustness and flexibility of our method in practical generative modelling tasks. Related work. In ( Rigollet and Stromme 2025 ) , the authors considered the following empirical dual objective: \widehat{S}(\nu_{0},\nu_{T}):=\frac{1}{n}\sum_{j=1}^{n}\log\nu_{0}(Z_{j})+\frac{1}{n}\sum_{i=1}^{n}\log\nu_{T}(Y_{i})-\frac{\sigma^{2}}{n^{2}}\sum_{i=1}^{n}\sum_{j=1}^{n}\nu_{0}(Z_{j})\,\mathsf{q}_{T}(Y_{i}\,|\,Z_{j})\,\nu_{T}(Y_{i})+\sigma^{2}. (13) This objective arises as a variational representation of the entropic optimal transport problem, where the regularization term penalizes deviations from the empirical product measure \rho_{0}^{n}\otimes\rho_{T}^{m} , with regularization parameter \sigma^{2}>0 . Note that since \rho_{0} is fixed in our setting, the empirical KL objective ( 12 ) reduces to \widehat{\mathcal{L}}(\nu_{0},\nu_{T})=\frac{1}{n}\sum_{j=1}^{n}\log\nu_{0}(Z_{j})+\frac{1}{n}\sum_{i=1}^{n}\log\nu_{T}(Y_{i}), which corresponds to the log-likelihood of the coupling \pi(x,y)=\nu_{0}(x)\mathsf{q}_{T}(y\,|\,x)\nu_{T}(y) evaluated on the data, up to an additive constant. The dual objective \widehat{S} thus coincides with \widehat{\mathcal{L}} up to a constant when the marginal penalty term vanishes, i.e., when \sigma^{2}=0 . More generally, we may write: \widehat{S}=\widehat{\mathcal{L}}-\text{marginal penalty}+\text{constant}. This formulation highlights the interpretation of \varepsilon as a trade-off parameter controlling how strictly the

Read the complete text