Identifiable Deep Latent Variable Models for MNAR Data
Huiming Xie [email protected], Fei Xue [email protected], Xiao Wang [email protected] · 2026
Read Identifiable Deep Latent Variable Models for MNAR Data by Huiming Xie [email protected], Fei Xue [email protected], Xiao Wang [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-24771.txt.
Introduction
Xie and co-authors build identifiable deep latent variable models for data that is missing not at random. Most imputation methods assume missingness is random, an assumption real data often breaks. Deep learning methods for the harder case often ignore whether the model is identifiable at all. Under a conditional no-self-censoring assumption given the latent variables, the authors prove the data distribution is identifiable. An importance-weighted autoencoder estimates the parameters, and they show the method recovers the true joint distribution under stated conditions.
Catalog record
| CREATOR | Huiming Xie [email protected], Fei Xue [email protected], Xiao Wang [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 106943 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.24771
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Identifiable Deep Latent Variable Models for MNAR Data Huiming Xie [email protected], Fei Xue [email protected], Xiao Wang [email protected] Abstract Missing data is a ubiquitous challenge in data analysis, often leading to biased and inaccurate results. Traditional imputation methods usually assume that the missingness mechanism is missing-at-random (MAR), where the missingness is independent of the missing values themselves. This assumption is frequently violated in real-world scenarios, prompted by recent advances in imputation methods using deep learning to address this challenge. However, these methods neglect the crucial issue of nonparametric identifiability in missing-not-at-random (MNAR) data, which can lead to biased and unreliable results. This paper seeks to bridge this gap by proposing a novel framework based on deep latent variable models for MNAR data. Building on the assumption of conditional no self-censoring given latent variables, we establish the identifiability of the data distribution. This crucial theoretical result guarantees the feasibility of our approach. To effectively estimate unknown parameters, we develop an efficient algorithm utilizing importance-weighted autoencoders. We demonstrate, both theoretically and empirically, that our estimation process accurately recovers the ground-truth joint distribution under specific regularity conditions. Extensive simulation studies and real-world data experiments showcase the advantages of our proposed method compared to various classical and state-of-the-art approaches to missing data imputation. † † shortheadings: Identifiable Deep Latent Variable Models for MNAR Data / Xie, Xue, Wang † † firstpage: 1 keywords Autoencoders, generative models, imputation, missing-not-at-random, variational inference 1 Introduction The issue of missing data poses a pervasive challenge across diverse applications, often necessitating data imputation due to the prevalence of models designed exclusively for complete data. Methods for addressing missing data have been studied extensively in ignorable missing situations where missingness depends only on the fully observed variables of the data, known as missing-at-random (MAR), or is independent of any data variable, known as missing-completely-at-random (MCAR) ( 40 ) . On the basis of such ignorability assumptions, many interesting imputation methods have been developed to make use of most models designed for complete data. For example, missForest ( 46 ) based on random forests is one of the popular methods for single imputation, while MICE ( 49 ) , short for multivariate imputation by chained equations, is a typical method for multiple imputation ( 26 ) . Supported by increased computing power, recent advances have witnessed the development of sophisticated imputation methods, particularly deep generative models, based on these ignorability assumptions ( 54 ; 28 ; 20 ; 35 ) . While convenient for modeling, these ignorability assumptions often do not align with the reality of real-world applications, spanning domains such as surveys, recommendation systems, and the medical field. For instance, in surveys, a question associated with social stigma could result in nonresponse ( 34 ; 32 ) . Certain medical records could be incomplete either because the information is unnecessary or because acquiring it is challenging due to the patients’ health conditions ( 45 ; 16 ) . In situations where absence of data is potentially influenced by characteristics of missing variables, known as missing-not-at-random (MNAR), modeling becomes significantly more complex ( 41 ) . There has been a relatively limited body of work addressing MNAR settings within the context of scalable missing value imputation. The scenario is explored more often in the application of recommender systems using probabilistic models ( 13 ; 25 ; 23 ) . Other perspectives include causal approaches with an explicit model of exposure for MNAR ( 22 ; 53 ; 52 ) , and inverse probability weighting methods ( 30 ; 44 ; 51 ) . More recently, deep generative models, especially deep latent variable models (DLVMs) have been studied under MNAR assumptions. For example, not-MIWAE ( 15 ) , short for the not-missing-at-random importance-weighted autoencoder, is a powerful model that incorporates prior knowledge of the missingness mechanism into density estimation. Nonetheless, these models often overlook the critical issue of nonparametric identifiability in MNAR data, as discussed in the seminal work by 41 . Some initial efforts in DLVMs to address identification issues, such as the deep generative imputation model (GINA) ( 29 ) , require the presence of auxiliary variables, which may not always be available. Consequently, these models tend to learn multiple non-unique complete data distributions that match the observed data ( 41 ) . Overlooking this fundamental aspect of MNAR data in modeling can introduce bias and inconsistency, potentially impairing inference and downstream tasks. On the other hand, numerous theoretical studies have delved into the identification of MNAR data using nonparametric or semiparametric inference techniques. They often impose constraints on the missingness mechanism to uniquely identify a functional or parameter of interest. Examples include the group permutation missing process ( 41 ) , sequential identification ( 43 ) , discrete choice models ( 48 ) , nearest identified pattern restriction ( 24 ) , conditions in graphical models ( 12 ; 31 ; 37 ; 38 ) , the no self-censoring model ( 32 ; 45 ; 42 ) , and the self-censoring model with completeness assumptions ( 21 ) . However, these methods generally impose a specific parametric model on the ground-truth distributions, which might be misspecified. In this paper, we propose an identifiable missing-not-at-random importance-weighted autoencoder (IM-IWAE) method to estimate the true distribution of all the variables and impute missing values for MNAR data. The proposed method is built upon a new conditional no self-censoring assumption given latent variables for missingness mechanisms, which assumes that the missing indicator of a random variable is conditionally independent of this variable and other missing indicators given all other variables and latent factors. Our contributions are outlined as follows: • We establish the nonparametric identifiability of the true data distribution under our proposed conditional no self-censoring assumption for MNAR data. Beyond providing identifiability, this assumption clarifies how no self-censoring can be formulated within latent variable models, offering a foundation for subsequent methodological developments. • We propose IM-IWAE, a working parametric model based on deep neural networks, which can asymptotically approximate the full-data distribution without requiring parametric assumptions on the true data distribution. The model can be used to impute missing values and generate synthetic data from the underlying distribution, where the parameters are estimated through an algorithm based on importance weighted variational inference. To our knowledge, this is the first approach that jointly addresses nonparametric identifiability of MNAR data and practical modeling through deep latent variable methods. • Through extensive numerical studies, we demonstrate the ability of our method to provide identifiable estimates and valid imputations and generations under correct model assumptions, as well as its robustness to practical violations of the no self-censoring assumption in MNAR data. This empirical evaluation, conducted across simulations and real-world datasets, shows advantages over classical imputation methods and existing deep learning imputation methods in handling MNAR data. Reproducible Python code is available at https://github.com/hxstat/IM-IWAE . The remainder of the paper is organized as follows. Section 2 introduces the ground-truth model for the full-data distribution. Section 3 provides identification assumptions on the missingness mechanism in the ground-truth model. In Section 4 , we propose a deep latent variable approach for learning the ground-truth data distribution in the presence of MNAR data. In Section 5 , we establish the theoretical