Conformal Inference for Missing Data under Multiple Robust Learning
Wenlu Tang, Hongni Wang, Xingcai Zhou, Bei Jiang, Linglong Kong, and Economics, Nanjing Audit University · 2025
Read Conformal Inference for Missing Data under Multiple Robust Learning by Wenlu Tang, Hongni Wang, Xingcai Zhou, Bei Jiang, Linglong Kong, and Economics, Nanjing Audit University (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-18149.txt.
Introduction
Wenlu Tang and four co-authors build prediction intervals that stay honest when some data are missing. Conformal methods give coverage promises, but missing-at-random gaps break the usual calibration. Their procedure recalibrates complete-case scores with likelihood-based weights so the score distribution matches the full sample implied by the missingness pattern.
A double calibration step keeps the method robust even when some working models are wrong. Theory covers both average and conditional coverage, plus a claim of shorter intervals than rivals. Numerical tests back the method. Statisticians get uncertainty bands that survive realistic holes in the data.
Catalog record
| CREATOR | Wenlu Tang, Hongni Wang, Xingcai Zhou, Bei Jiang, Linglong Kong, and Economics, Nanjing Audit University |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-18149
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Conformal Inference for Missing Data under Multiple Robust Learning Wenlu Tang, Hongni Wang, Xingcai Zhou, Bei Jiang, Linglong Kong, and Economics, Nanjing Audit University Abstract We develope a novel approach to tackle the common but challenging problem of conformal inference for missing data in machine learning, focusing on ’Missing at Random’ (MAR) data. Our method, inspired by the innovative Multiple Robust (MR) framework, introduces a general approach to construct prediction intervals, which employs various candidate imputation and propensity score models. We use a novel double calibration technique, to reweight conformity scores using multiple robust quantile regression. Our approach ensures consistent estimations as long as at least one model for imputation or the propensity score is accurate. We demonstrate the asymptotic behavior of our estimators through empirical process theory and provide reliable coverage for our prediction intervals, both marginally and conditionally. We show the effectiveness of the proposed method by several numerical experiments in the presence of missing data. 1 Introduction In many statistical applications, quantifying predictive uncertainty is crucial. Prediction intervals indicate a range in which a future outcome is expected to lie with specified probability, e.g. for pairwise data (X_{i},Y_{i})_{i=1}^{n} , the objective of prediction interval is to create a prediction set C_{n}(X_{n+1}) that includes Y_{n+1} with a probability of at least 1-\alpha , and here \alpha is called miscoverage rate. These intervals are more than statistical measures; they are crucial in diverse fields such as finance and public health. However, the integrity of these predictive intervals is frequently challenged by a common but significant issue in data analysis: the presence of missing values in datasets Little and Rubin 2002 . Missing data is a pervasive problem, spanning various disciplines. In statistical analysis, missing data introduces biases and uncertainties that can lead to skewed inferences. Broadly classified into Missing Completely at Random (MCAR), Missing at Random (MAR), and Missing Not at Random (MNAR), each type has unique challenges and tailored strategies. In the missing at random (MAR) setting, for pairwise data (X_{i},Y_{i})_{i=1}^{n} the response Y is observed with indicator R=1 and unobserved i.e. missing with R=0 , and {\mathbb{P}}(R=1\mid Y,X)={\mathbb{P}}(R=1\mid X) . This missing-data mechanism induces selection bias, and naïve prediction intervals that ignore missingness may be invalid. Two classical approaches to handle missingness are inverse probability weighting (IPW) and imputation. IPW reweights each observed outcome by the inverse of an estimated propensity score \pi(X)=P(R=1\mid X) ( Rosenbaum and Rubin 1983 ; Tu et al. 2019 ) , whereas imputation predicts missing Y from observed covariates, e.g. using regression or multiple imputation ( Rubin 1996 ; Rubin 2018 ) . Both methods can yield consistent point estimates of quantities like {\mathbb{E}}[Y\mid X] when models are correctly specified, but they are sensitive to model misspecification. However, both methods are sensitive to model misspecification, which can result in biased estimators ( Little and Rubin 2019 ) . To address this, prior studies have suggested a double robust approach, ensuring consistency as long as either the propensity score model or the outcome regression model is correctly specified ( Robins and Rotnitzky 1995 ; Cao et al. 2009 ; Tan 2010 ) . In particular, double-robust methods ensure consistency if either the propensity model or the outcome model is correct, but they still fail if both are wrong. Correctly specifying these models is challenging. Constructing prediction intervals based on potentially fragile imputations requires additional robustness. The prediction intervals derived from these potentially flawed estimations demands enhanced robustness. Consequently, the concept of multiple robust learning has emerged for handling missing data. 1.1 Conformal Inference Interval estimation can quantify the uncertainty of the point estimation. Methods based on conformal predictions are developed for distribution-free interval estimation in recent years. Given pairwise observations (X_{i},Y_{i})_{i=1}^{n} and mis-coverage rate \alpha , the goal of the conformal prediction is to construct an interval C(x) such that for newly coming data (X_{n+1},Y_{n+1}) , {\mathbb{P}}\{Y_{n+1}\in C(X_{n+1})\}\geq 1-\alpha . Since the pioneering work by Vovk et al. 2005 , there have been numerous conformal prediction studies and extensions in both computation and theory, see Romano et al. 2019 , Tibshirani et al. 2019 and Zaffran et al. 2022 . The conformal inference method can be applied to various scenarios, including time series Zaffran et al. 2022 , survival data Candès et al. 2023 , causal inference Lei and Candès 2021 and distribution shifts Gibbs and Candes 2021 , Marginal validity, a conventional coverage guarantee that can be achieved under the i.i.d assumption, is demonstrated in Lei et al. 2013 and Lei and Wasserman 2014 . However, as demonstrated in Lei et al. 2018 and Vovk 2012 , conditional validity with a finite-length prediction interval is impossible without regularity and consistency assumptions on the model and estimator. Since methods for missing data typically rely on correctly specified models, thus the conditional validity is hard to be achieved in missing data prediction intervals. Therefore there are limited literature on conformal inference of missing data. Zaffran et al. 2023 introduced a comprehensive framework for conformalized quantile regression, incorporating missing data augmentation. This novel framework demonstrates that the impute-then-predict strategy is marginally valid and explores conditional validity within a masked framework. However, their research primarily addresses challenges of missing covariate values. It’s also important to note that the accuracy of the conformal interval is influenced by the choice of imputation model. Therefore, we proposed a conformal interval that is adaptive to missing response and not sensitive to the imputation models. 1.2 Multiple Robust Estimation Suppose the observations are pairwise samples \{R_{i}Y_{i},X_{i},R_{i}\}_{i=1}^{n} , where Y is the response variable, X\in{\mathbb{R}}^{p} is the vector of covariates, and R is the indicator vector of missingness. We denote that R=1 if Y is observed and R=0 if Y is missing. In this paper, we consider the typical missing at random (MAR) mechanism Little and Rubin 2002 ; that is, {\mathbb{P}}(R=1\mid Y,{X})={\mathbb{P}}(R=1\mid{X}), and this conditional probability is called propensity score function, denoted by \pi(X) . Let m=\sum_{i=1}^{n}R_{i} be the number of fully observed samples. Without loss of generality, assume that index of completely observed samples R_{i}=1 are i=1,\ldots,m . Consider regression tasks with missing response, the parameter of interest is \mu_{0}(x)={\mathbb{E}}(Y|X=x) in mean regression and \mu_{\tau}(x)=Q_{\tau}(Y\mid X=x) , the multiple robust learning introduce a general framework to derive a multiple robust estimator for parameter \mu(x) . Previous studies that proposed multiple robust estimation for mean Han and Wang 2013 and quantile Han et al. 2019 regression problems can be summarized in a more general framework for both mean and quantile estimations by incorporating multiple propensity and error imputation models. 1.3 Related Works Multiple robust (MR) approaches diminish the sensitivity to model mis-specification by leveraging multiple propensity score and imputation models simultaneously. The incorporation of multiple models enhances double robustness and yields consistent estimation if any single working model is correct Han and Wang 2013 . Their multiple robust approach involves both imputation and inverse probability weighting(IPW) method Han 2014b . The multiple robust framework integrates imputation with IPW techniques to enhance consistency and robustness estimation, even when there are model mis-specifications. By leveraging the information from multiple models, the estimation derived from calibrated empirical likelihood is semiparametric efficient if only one model is correctly specified Han 2016 . Such multiple robust