Latent Diffusion for Missing Data

Alberte Heering Estad, Ignacio Peis, Jes Frellsen · 2026

Read Latent Diffusion for Missing Data by Alberte Heering Estad, Ignacio Peis, Jes Frellsen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28427.txt.

Introduction

Alberte Heering Estad, Ignacio Peis, and Jes Frellsen ask whether diffusion models fill missing data better in a learned latent space than directly in data space. Their two-stage design first trains a robust variational autoencoder imputer on incomplete observations, then trains diffusion in the resulting latent space. Under random missingness, latent diffusion held sample quality steady up to half the data missing, while pixel-space diffusion degraded steadily. It also imputed downstream values more accurately, suggesting latent modeling curbs artifacts from zero-filled inputs.

Catalog record

CREATORAlberte Heering Estad, Ignacio Peis, Jes Frellsen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21123
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.28427

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Latent Diffusion for Missing Data Alberte Heering Estad, Ignacio Peis, Jes Frellsen Abstract Diffusion models have emerged as powerful generative approaches for missing-data imputation, yet most existing methods operate directly in data space and degrade when training data are heavily incomplete. We investigate whether shifting diffusion to a learned latent representation improves robustness under missing-completely-at-random (MCAR) corruption. To this end, we propose a two-stage framework: a robust VAE-based imputer first learns compact semantic features from incomplete observations, and a diffusion model is then trained in the resulting latent space. Across training missing rates, we perform a controlled comparison against pixel-space diffusion models under the same incomplete-data setting. The latent diffusion model maintains high sample quality and remains stable up to 50% missingness, while pixel-space diffusion degrades progressively as missingness increases. For downstream imputation, latent diffusion also achieves consistently better performance than pixel-space diffusion. These findings indicate that latent-space modeling mitigates artifact amplification from zero-imputed inputs and provides a more robust generative prior for incomplete-data learning. Overall, our results support latent diffusion as a strong and practically useful alternative to pixel-space diffusion for missing-data problems. 1 Introduction Real-world datasets are often incomplete. Missing values arise from from varied sources including loss to follow-up in clinical studies, incomplete documentation in electronic health records, and practical constraints in data collection ( 23 ; 1 ) . The missing data mechanism is typically categorized as missing completely at random (MCAR), missing at random (MAR), or missing not at random (MNAR) ( 11 ) . Probabilistic generative models offer a principled approach to this problem, as they can learn the data distribution from incomplete observations and impute missing values by sampling from the conditional. Deep generative approaches based on VAEs ( 13 ; 15 ; 12 ) , GANs ( 24 ; 10 ) and Flows ( 16 ) have shown strong results for imputation. More recently, diffusion models have been applied to this task ( 25 ; 5 ; 14 ; 26 ; 21 ) , leveraging the connection between score-based generative modeling and conditional generation ( 20 ) . However, existing diffusion-based methods typically operate in the data space and often assume complete training data. The question of how the choice of either pixel or latent representation space affects both generation quality and imputation performance when training on incomplete data has, to the best of our knowledge, not been studied. In this work, we present a systematic comparison between diffusion models for missing data in pixel space and our proposed method, denoted LDMiss, which performs diffusion in a latent space learned by a VAE for incomplete data. Both models are trained on MNIST under MCAR missingness at varying rates. We evaluate both generative sample quality and imputation performance. Our results show that LDMiss retains higher sample quality as missingness increases and achieves superior imputation performance compared with the pixel-space DDPM. 2 Score-Based Diffusion Models Diffusion models ( 19 ; 20 ; 8 ) generate data by progressively corrupting training samples with noise and then learning the reverse denoising process. Denoising Diffusion Probabilistic Models (DDPMs; 8 ) formulate this process as a discrete-time Markov chain. In contrast, score-based diffusion models ( 20 ) define a continuous-time forward process \{\mathbf{x}_{t}\}^{T}_{t=0} with t\in[0,T] through the stochastic differential equation (SDE) \text{d}\mathbf{x}=\mathbf{f}(\mathbf{x},t)\,\text{d}t+g(t)\,\text{d}\mathbf{w} . The process starts from data {\mathbf{x}}_{0}\sim p_{0} and evolves toward a prior distribution {\mathbf{x}}_{T}\sim p_{T} that contains no information about p_{0} . The generative process is characterized by the corresponding reverse SDE: \text{d}{\mathbf{x}}=\left[{\mathbf{f}}({\mathbf{x}},t)-g(t)^{2}\nabla_{{\mathbf{x}}}\log p_{t}({\mathbf{x}})\right]\text{d}t+g(t)\text{d}{\mathbf{w}} . This reverse SDE depends only on the time-dependent gradient field \nabla_{{\mathbf{x}}}\log p_{t}({\mathbf{x}}) , known as the score, of the transformed data distribution. The score can be estimated by training a time-dependent neural network {\mathbf{s}}_{\theta} via the Denoising Score-Matching objective ( 22 ) : \displaystyle\mathcal{L}(\theta)=\mathbb{E}_{t\sim\mathcal{U}(\tau,1)}\left\{\lambda_{t}\>\mathbb{E}_{\mathbf{x}_{0}\sim p_{0}}\mathbb{E}_{\mathbf{x}_{t}\sim p_{0t}(\mathbf{x}_{t}|\mathbf{x}_{0})}\left[\>\left\|\>{\mathbf{s}}_{\theta}(\mathbf{x}_{t},t)-\nabla_{\mathbf{x}_{t}}\log p_{0t}(\mathbf{x}_{t}\>|\>\mathbf{x}_{0})\>\right\|_{2}^{2}\>\right]\right\} (1) Once {\mathbf{s}}_{\theta} is obtained, the reverse SDE can be simulated using numerical methods such as Euler-Maruyama ( 9 ) to sample new data. 20 show that the DDPM perturbation kernels converge to the Variance-Preserving (VP) SDE: \text{d}\mathbf{x}=-\frac{1}{2}\beta(t)\mathbf{x}\,\text{d}t+\sqrt{\beta(t)}\,\text{d}\mathbf{w} , with noise schedule \beta(t)=\beta_{min}+t(\beta_{max}-\beta_{min}) , when time is continuous. In this study, we use the VP SDE and its corresponding reverse SDE to model the forward and reverse processes, respectively. The linearity of the drift and diffusion coefficients causes the transition kernel p_{0t}({\mathbf{x}}_{t}|{\mathbf{x}}_{0}) to become Gaussian, resulting in a standard Gaussian prior {\mathbf{x}}_{T}\sim\mathcal{N}(0,{\bm{I}}) . By reparameterization of {\mathbf{x}}_{t}\sim\mathcal{N}(\mu,\sigma^{2}\mathbf{I}) , we obtain the simplified objective: \displaystyle\mathcal{L}(\theta)=\mathbb{E}_{t\sim\mathcal{U}(\tau,1),\mathbf{x}_{0}\sim p_{0},\epsilon\sim\mathcal{N}(0,{\bm{I}})}\left[\lambda_{t}\left\|\mathbf{s}_{\theta}(\mathbf{x}_{t},t)+\frac{\epsilon}{\sigma_{t}}\right\|^{2}_{2}\right] (2) 3 Latent Diffusion Models Latent diffusion models (LDMs, 17 ) compress the original images to a latent space of lower dimension, in which the diffusion process is then carried out. This is more computationally efficient and allows the model to train on the most important semantic bits of the data. An LDM consists of an encoder \mathcal{E} , which encodes the data {\mathbf{x}} into a latent representation {\mathbf{z}}=\mathcal{E}({\mathbf{x}}) , and a decoder \mathcal{D} , that uses the latent to reconstruct the data \hat{\mathbf{x}}=\mathcal{D}({\mathbf{z}})=\mathcal{D}(\mathcal{E}({\mathbf{x}})) . In this study, we use a \beta -VAE ( 7 ) with p({\mathbf{z}})=\mathcal{N}(0,\mathbf{I}) and q_{\mathcal{E}}({\mathbf{z}}|{\mathbf{x}})=\mathcal{N}({\mathbf{z}};\mu_{\mathcal{E}},\sigma^{2}_{\mathcal{E}}) , trained with the Evidence Lower Bound (ELBO), with KL regularization weighted by \beta=10^{-6} to ensure high-fidelity reconstructions. Subsequently, the diffusion model is trained on latent representations {\mathbf{z}}=\mathcal{E}({\mathbf{x}}) using the objective in Equation 2 , with {\mathbf{z}} replacing {\mathbf{x}} . 4 Missing Data Framework Given dataset {\bm{X}}=({\mathbf{x}}_{1},\dots,{\mathbf{x}}_{n})^{T} with p features, we define i\in\{1,\dots,n\} as the index of the data point {\mathbf{x}}_{i} , and j\in\{1,\dots,p\} the index of the feature {\mathbf{x}}_{ij} . In the case of MNIST, {\mathbf{x}}_{i} is a flattened image, and {\mathbf{x}}_{ij} is a pixel in image {\mathbf{x}}_{i} . When working with missing data, we split each data point into missing and observed features {\mathbf{x}}_{i}=\{{\mathbf{x}}^{\text{obs}}_{i},{\mathbf{x}}^{\text{miss}}_{i}\} . The missing features of each data point {\mathbf{x}}_{i} are defined according to a binary mask vector {\mathbf{m}}_{i}\in\{0,1\}^{p} , such that {\mathbf{m}}_{ij}=1 , if {\mathbf{x}}_{ij} is observed and {\mathbf{m}}_{ij}=0 , if it is missing. In this study, we assume that the data is missing-completely-at-random . 4.1 Training with Missing Data For the diffusion modelling in pixel space, we employ two recent alternatives. First, we adopt the MissDiff approach ( 14 ) : after zero-imputing the data, the loss is only computed on observed dimensions by factoring out the missing dimensions and normalizing by the number of observed dimensions: \displaystyle\mathcal{L}(\theta)=\mathbb{E}_{t\sim\mathcal{U}(\tau,1),{\mathbf{x}}_{0}\sim p_{0},\epsilon\sim\mathcal{N}(0,{\bm{I}}),{\mathbf{m}}}\left[\lambda_{t}\,\frac{||{\mathbf{m}}\odot({\mathbf{s}}_{\theta}({\mathbf{x}}_{t},t)-\nabla_{{\mathbf{x}}_{t}}\log p_{0t}({\mathbf{x}}_{t}|{\mathbf{x}}_{0}))||^{2}}{\sum_{j}{\mathbf{m}}_{j}}\right] (3) Second, we use DiffPuter ( 25 ) , an EM-based iterative algorithm that imputes the missing values in the E-step and retrains the diffusion model in the M-step. For our LDMiss, we follow 12 and zero-impute missing entries. The autoencoder is then trained using a \beta -VAE ELBO, where the reconstruction term is evaluated only on the observed data and the KL divergence term is weighted by \beta_{KL} . The diffusion process in latent space has the convenient property that missing dimensions factor out under the conditional independence assumption of our diagonal Gaussian encoder (derivation in appendix B ). We therefore simply use the latent version of the objective given in Equation ( 2 ) during latent diffusion. 5 Self-Guided Missing Data Imputation 20 perform imputation by sampling noisy observations from the known forward process p_{t}({\mathbf{x}}^{\text{miss}}_{t}|{\mathbf{x}}^{\text{obs}}_{0})\approx p_{t}({\mathbf{x}}^{\text{miss}}_{t}|\hat{{\mathbf{x}}}^{\text{obs}}_{t}) , where \hat{{\mathbf{x}}}^{\text{obs}}_{t} is a random sample from p_{t}({\mathbf{x}}^{\text{obs}}_{t}|{\mathbf{x}}^{\text{obs}}_{0}) . At each iteration, they replace the observed dimensions with their noisy counterparts and

Read the complete text