Conditional Diffusion Under Linear Constraints: Langevin Mixing and Information-Theoretic Guarantees

Ahmad Aghapour [email protected], Erhan Bayraktar [email protected], Asaf Cohen [email protected] · 2026

Read Conditional Diffusion Under Linear Constraints: Langevin Mixing and Information-Theoretic Guarantees by Ahmad Aghapour [email protected], Erhan Bayraktar [email protected], Asaf Cohen [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-05387.txt.

Introduction

Diffusion models can fill in missing parts of a signal, but only the observed part is pinned down. Ahmad Aghapour, Erhan Bayraktar, and Asaf Cohen study that gap for problems like image inpainting and super-resolution. Samplers that only enforce agreement with the measurements can still place probability in the wrong places.

The authors split the score function into observed and free directions. They bound the error from a natural shortcut by a mutual information term that does not grow with dimension. Guided by the theory, their sampler starts with a projected Langevin step and beat a strong baseline in tests.

Catalog record

CREATORAhmad Aghapour [email protected], Erhan Bayraktar [email protected], Asaf Cohen [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE109 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.05387

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Conditional Diffusion Under Linear Constraints: Langevin Mixing and Information-Theoretic Guarantees Ahmad Aghapour [email protected], Erhan Bayraktar [email protected], Asaf Cohen [email protected] Abstract We study zero-shot conditional sampling with pretrained diffusion models for linear inverse problems, including inpainting and super-resolution. In these problems, the observation determines only part of the unknown signal. The remaining degrees of freedom must be sampled according to the correct conditional data distribution. Existing projection-based samplers enforce measurement consistency by correcting the observed component during reverse diffusion. However, measurement consistency alone does not determine how probability mass should be distributed along the feasible set, and this can lead to biased conditional samples. We analyze this issue through a normal–tangent decomposition of the score function. For Gaussian noising, the observed-direction score is exactly determined by the measurement; only the tangent conditional score is unknown. We prove that the error from replacing this score by the unconditional tangent score is upper bounded by a dimension-free conditional mutual information between observed and unobserved components. This gives an information-theoretic decomposition into initialization and pathwise score-mismatch errors. Motivated by the theory, we propose a projected-Langevin initialization followed by guided reverse denoising, which outperforms a strong projection-based baseline in inpainting and super-resolution experiments. Ahmad Aghapour, Erhan Bayraktar, and Asaf Cohen † † heading: 1 2026 1- 4/26 0000 † † shortheadings: Conditional Diffusion Under Linear Constraints / Aghapour, Bayraktar, and Cohen † † firstpage: 1 keywords diffusion models, inverse problems, Langevin dynamics, information-theoretic bounds, conditional sampling 1 Introduction Diffusion models have become a standard tool for high-dimensional generative modeling. Given samples from a data distribution, a diffusion model learns the score of progressively noised versions of the data and then generates new samples by simulating a reverse-time denoising process ( Song and Ermon 2019 ; Ho et al. 2020 ; Song et al. 2020b ; Song et al. 2020a ) . In many applications, however, generation is not unconditional. In image restoration, for example, one observes a corrupted image and wants to sample clean images that are both realistic under a pretrained image prior and consistent with the observation. This paper studies such conditional sampling problems for noiseless linear observations. Let Z\in\mathbb{R}^{d} denote the clean signal and suppose that y=AZ,\qquad A\in\mathbb{R}^{m\times d}. The goal is to sample from the conditional law \operatorname{Law}(Z\mid AZ=y). When A has full row rank, the constraint AZ=y defines an affine set. Writing P_{\perp}:=A^{\top}(AA^{\top})^{-1}A,\qquad P_{\parallel}:=I-P_{\perp}, the projection P_{\perp} extracts the component of the signal determined by the measurements, while P_{\parallel} extracts the component in the null space of A . We refer to these as the normal and tangent components, respectively. Thus the observation fixes the normal component, whereas the tangent component contains the remaining degrees of freedom. In imaging problems, this formulation covers inpainting, super-resolution, deblurring, and other linear inverse problems. A central difficulty is that measurement consistency and conditional sampling are not the same task. Measurement consistency only requires producing a sample \hat{z} satisfying A\hat{z}=y . Conditional sampling requires more: among all feasible signals satisfying the measurement, samples should be distributed according to the true conditional law of the data. In the geometric language above, the normal component enforces feasibility, while the tangent component determines how probability mass is distributed along the feasible affine set. Many zero-shot inverse-problem samplers based on pretrained diffusion models enforce the measurement by repeatedly correcting or projecting the sample in the observed directions. We call such methods projection-based because they use the known linear operator A to replace, project, or analytically correct the normal component during reverse diffusion, while leaving the unobserved directions largely governed by the pretrained unconditional model. Methods such as denoising diffusion restoration models (DDRM) and the denoising diffusion null-space model (DDNM) are representative examples for linear inverse problems ( Kawar et al. 2022 ; Wang et al. 2022 ) . These methods can be very effective at maintaining measurement consistency. However, correcting the normal component does not by itself determine the correct distribution in the tangent directions. As a result, a sample may satisfy A\hat{z}=y while still being biased along the feasible manifold. The goal of this paper is to understand and reduce this tangent-space bias. We work in the zero-shot setting: the diffusion model is pretrained unconditionally, is not fine-tuned for the observation, and conditioning is imposed only at inference time. This setting is practically important because it allows a single generative prior to be reused across many inverse problems. It is also theoretically revealing, because the only available learned object is the unconditional score. The question is therefore: when can an unconditional score be used to approximate the conditional dynamics, and where does the error enter? Our starting point is a normal–tangent decomposition of the conditional score. Under Gaussian noising, the normal component of the conditional score is available in closed form from the observation. In the variance-exploding normalization, if B=P_{\perp}Z=b , then P_{\perp}s_{t}^{*,b}(x)=\frac{1}{t}P_{\perp}(b-x). Thus the normal score is not the obstacle. The only unknown part is the tangent conditional score P_{\parallel}s_{t}^{*,b}(x) . Projection-based zero-shot samplers can therefore be viewed as replacing this unknown tangent conditional score by the pretrained unconditional tangent score P_{\parallel}s_{t}(x) . This view isolates the precise source of bias: the approximation is made along the feasible directions, not in the measured directions. Motivated by this decomposition, we propose a two-stage conditional sampler. Rather than starting reverse diffusion from the highest-noise distribution, we start from an intermediate noise level. At this level, the noisy normal component can be sampled exactly under the constraint. We then run projected underdamped Langevin dynamics on the corresponding affine slice, using the projected unconditional score to mix only in the tangent directions. This produces an initialization that is already consistent with the noisy constraint and better adapted to the feasible slice. From this initialization, we perform guided reverse denoising using the exact normal correction and the pretrained unconditional score in the tangent directions. The theoretical analysis follows the same decomposition. We separate the total sampling error into two terms. The first is an initialization error at the intermediate noise level, caused by approximating the true conditional marginal on the affine slice. The second is a pathwise error accumulated during reverse denoising, caused by replacing the true conditional tangent score with the unconditional tangent score. Our main pathwise result shows that this second error is controlled by a conditional mutual information between tangent and normal components. Informally, zero-shot tangent guidance is accurate when, at the chosen noise level, the remaining statistical dependence between the unobserved tangent component and the observed normal component is small. We further combine the pathwise bound with an initialization analysis. Under a latent Gaussian-mixture model, we obtain a terminal Kullback–Leibler (KL) bound consisting of an initialization term and a mutual-information pathwise term. Under an additional separation condition on the latent normal codebook, both terms become exponentially small in the separation-to-noise ratio. These results identify regimes in which inference-time conditioning with a fixed unconditional score can be accurate, and they also explain why tangent-space ambiguity is the central obstruction. We evaluate the resulting sampler on standard linear imaging inverse problems using pretrained diffusion backbones and matched compute budgets. On inpainting and 8\times super-resolution across CelebA-HQ, LSUN Church, and ImageNet, the proposed method improves Learned Perceptual Image Patch Similarity

Read the complete text