Bidirectional Diffusion Bridge Models
Duc Kieu, Kien Do, Toan Nguyen, Dang Nguyen, Thin Nguyen · 2025
Read Bidirectional Diffusion Bridge Models by Duc Kieu, Kien Do, Toan Nguyen, Dang Nguyen, Thin Nguyen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-09655.txt.
Introduction
Duc Kieu, Kien Do, Toan Nguyen, Dang Nguyen, and Thin Nguyen make image translation run both ways in a 2025 paper. Diffusion bridge models turn one kind of image into another, such as a sketch into a photo. Older bridges run one way only, so each direction needs its own model and double the computing cost.
Their model, BDBM, learns both directions in a single network. It leans on a classic equation that links bridge steps across time, letting start and target trade places. When the middle steps follow a bell-shaped spread, both directions have closed-form steps that train cheaply. Tests on high-resolution translation beat leading bridge models. The work ties the method to older bridge ideas and shows the gains clearly.
Catalog record
| CREATOR | Duc Kieu, Kien Do, Toan Nguyen, Dang Nguyen, Thin Nguyen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 80 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-09655
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Bidirectional Diffusion Bridge Models Duc Kieu, Kien Do, Toan Nguyen, Dang Nguyen, Thin Nguyen Abstract Diffusion bridges have shown potential in paired image-to-image (I2I) translation tasks. However, existing methods are limited by their unidirectional nature, requiring separate models for forward and reverse translations. This not only doubles the computational cost but also restricts their practicality. In this work, we introduce the Bidirectional Diffusion Bridge Model (BDBM), a scalable approach that facilitates bidirectional translation between two coupled distributions using a single network. BDBM leverages the Chapman-Kolmogorov Equation for bridges, enabling it to model data distribution shifts across timesteps in both forward and backward directions by exploiting the interchangeability of the initial and target timesteps within this framework. Notably, when the marginal distribution given endpoints is Gaussian, BDBM’s transition kernels in both directions possess analytical forms, allowing for efficient learning with a single network. We demonstrate the connection between BDBM and existing bridge methods, such as Doob’s h h -transform and variational approaches, and highlight its advantages. Extensive experiments on high-resolution I2I translation tasks demonstrate that BDBM not only enables bidirectional translation with minimal additional cost but also outperforms state-of-the-art bridge models. Our source code is available at https://github.com/kvmduc/BDBM . 1 Introduction Diffusion models (DMs) [ 40 , 43 , 13 ] have emerged as a powerful class of generative models, surpassing GANs [ 11 ] and VAEs [ 21 ] in generating high-quality data [ 7 ] . These models learn to transform a Gaussian prior distribution into the data distribution through iterative denoising steps. However, the Gaussian prior assumption in diffusion models limits their application, particularly in image-to-image (I2I) translation [ 16 ] , where the distributions of the two domains are non-Gaussian. A straightforward solution is to incorporate an additional condition related to one domain into diffusion models for guidance [ 6 , 35 ] . This approach often overlooks the marginal distribution of each domain, which may hinder its generalization ability, especially when the two domains are diverse and significantly different. In contrast, methods that construct an ODE flow [ 25 , 29 , 1 ] or a Schrödinger bridge [ 4 , 39 , 18 ] between two domains focus mainly on matching the marginal distributions at the boundaries, neglecting the relationships between samples from the two domains. Consequently, these methods are not well-suited for paired I2I tasks. To solve the paired I2I problem, recent methods [ 31 , 53 ] leverage knowledge of the target sample y in the pair \left(x,y\right) and utilized Doob’s h -transform [ 9 ] to construct a bridge that converges to y . This involves learning either the h function [ 41 ] or the score function of the h -transformed SDE [ 53 ] , both of which depend on y . Other methods [ 24 ] extend the unconditional variational framework for diffusion models to a conditional one given y for constructing such bridges, thereby learning a backward transition distribution conditioned on y . Despite their success in capturing the correspondence between x and y , these methods share a common limitation: they can only generate data in one direction , from y to x . For the reverse from x to y , a separate bridge must be trained with x being the target, which doubles computational resources and modeling complexity. We argue that real-world applications would greatly benefit from bidirectional generative models capable of transitioning between two distributions using a single model. Therefore, we introduce a novel bridge model called B idirectional D iffusion B ridge M odel (BDBM) that enables bidirectional transitions between two coupled distributions using only a single network . Our bridge is built on a framework that highlights the symmetry between forward and backward transitions. By utilizing the Chapman-Kolmogorov Equation (CKE) for conditional Markov processes, we transform the problem of modeling the conditional distribution p\left(x_{T}=y|x_{0}=x\right) into modeling the forward transition from p\left(x_{t}|x,y\right) to p\left(x_{s}|x,y\right) - the marginal distributions at times t and s ( 0\leq t<s\leq T ) of a double conditional Markov process (DCMP) between two endpoints x,y\sim p\left(x,y\right) . Given the interchangeability of the two marginal distributions, we can model the conditional distribution p\left(x_{0}=x|x_{T}=y\right) simply by learning the backward transition from p\left(x_{s}|x,y\right) to p\left(x_{t}|x,y\right) without altering the DCMP. Notably, the forward and backward transition distributions of the DCMP are connected through Bayes’ rule and can be expressed analytically as Gaussian distributions when the DCMP is a diffusion process. This insight motivates us to reparameterize models of the forward and backward transition distributions in a way that they share a common term. Therefore, we can use a single network for modeling this term and train it with a unified objective for both directions. We evaluate our method on four popular paired I2I translation datasets [ 16 , 49 ] with image sizes up to 256 \times 256, considering both pixel and latent spaces. Experimental results demonstrate that BDBM surpasses state-of-the-art (SOTA) unidirectional diffusion bridge models in terms of visual quality (measured by FID) and perceptual similarity (measured by LPIPS) of generated samples, while requiring similar or even fewer training iterations. These promising results showcase the clear advantages of our method, which not only facilitates bidirectional translation at minimal additional cost but also improves performance. 2 Preliminaries 2.1 Markov Processes and Diffusion Processes A Markov process is a stochastic process satisfying the Markov property, i.e., the future (state) is independent of the past given the present: p\left(x_{s}|x_{t},x_{u}\right)=p\left(x_{s}|x_{t}\right) where x_{u} , x_{t} , x_{t} denote random states at times u , t , s satisfying that 0\leq u<t<s . Here, p\left(x_{s}|x_{t}\right) is the transition distribution of the Markov process. Diffusion processes are special cases of Markov processes where the transition distribution is typically a Gaussian distribution. A diffusion process can be either discrete-time [ 13 ] or continuous-time [ 44 ] . A continuous-time diffusion process can be described by the following (forward) stochastic differential equation (SDE): \displaystyle dX_{t} \displaystyle=\mu\left(t,X_{t}\right)dt+\sigma\left(t,X_{t}\right)dW_{t} (1) where W_{t} denotes the Wiener process (aka Brownian motion) at time t . Eq. 1 can be solved via simulation provided that the distribution of X_{0} is known. One can derive the forward and backward Kolmogorov equations (KFE and KBE) for this SDE as follows: \text{KFE:}\ \ \frac{\partial p\left(t,x\right)}{\partial t}=\mathcal{G}^{*}p\left(t,x\right);\ p\left(0,\cdot\right)\ \text{is given} (2) \text{KBE:}\ \ \frac{\partial p\left(T,y|t,x\right)}{\partial t}=-\mathcal{G}p\left(T,y|t,x\right);\ p\left(T,\cdot\right)\ \text{is given} (3) where \mathtt{\mathcal{G}} denotes the generator corresponding to the SDE in Eq. 1 and \mathcal{G}^{*} is the adjoint of \mathtt{\mathcal{G}} . When \sigma\left(t,x\right) is a scalar depending only on t (i.e., \sigma\left(t,x\right)\equiv\sigma\left(t\right) , for a real-valued function f , \mathcal{G}f\left(t,x\right) and \mathcal{G}^{*}f\left(t,x\right) are given by: \displaystyle\mathcal{G}f\left(t,x\right) \displaystyle={\nabla f\left(t,x\right)}^{\top}\mu\left(t,x\right)+\frac{{\sigma\left(t\right)}^{2}}{2}\Delta f\left(t,x\right) \displaystyle\mathcal{G}^{*}f\left(t,x\right) \displaystyle=-\nabla\cdot\left(f\left(t,x\right)\mu\left(t,x\right)\right)+\frac{{\sigma\left(t\right)}^{2}}{2}\Delta f\left(t,x\right) where \nabla\cdot and \Delta denote the divergence and Laplacian, respectively. 2.2 Chapman-Kolmogorov Equations A Markov process can be described via the Chapman-Kolmogorov equation (CKE) [ 17 ] as follows: p\left(x_{s}|x_{t}\right)=\int p\left(x_{s}|x_{r}\right)p\left(x_{r}|x_{t}\right)dx_{r} (4) which holds for all times t , r , s satisfying that 0\leq t<r<s\leq T . The CKE in Eq. 4 can be considered as the integral form of the KFE and KBE in Eqs. 2 , 3 . Compared to the Kolmogorov equations, the CKE is easier to work with since (i) it does not involve the partial derivatives of the transition kernel, (ii) it is