Estimation with missing not at random binary outcomes via exponential tilts
Subha Maity · 2025
Read Estimation with missing not at random binary outcomes via exponential tilts by Subha Maity (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-06046.txt.
Introduction
When survey answers go missing for reasons tied to the answers themselves, statisticians call the data missing not at random, and honest estimation usually demands extra instruments that may not exist. Subha Maity proposes an exponential tilt approach that needs no such helpers. A tilt parameter captures how response odds shift with the unobserved outcome, and she gives a condition under which it can be identified from the data alone.
From the estimated tilt she builds importance-weighted and doubly robust estimators for any mean of interest. Synthetic tests validate the method. On a real image dataset, the framework performs transfer learning into a domain whose labels are missing, matching a gold-standard benchmark. The paper appears in 2025.
Catalog record
| CREATOR | Subha Maity |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 79 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-06046
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Estimation with missing not at random binary outcomes via exponential tilts Subha Maity Abstract We study the problem of missing not at random (MNAR) datasets with binary outcomes. We propose an exponential tilt based approach that bypasses any knowledge on ‘nonresponse instruments’ or ‘shadow variables’ that are usually required for statistical estimation. We establish a sufficient condition for identifiability of tilt parameters and propose an algorithm to estimate them. Based on these tilt parameter estimates, we propose importance weighted and doubly robust estimators for any mean functions of interest, and validate their performances in a synthetic dataset. In an experiment with the Waterbirds dataset, we utilize our tilt framework to perform unsupervised transfer learning, when the responses are missing from a target domain of interest, and achieve a prediction performance that is comparable to a gold standard. 1 Introduction Over the years, methods for handling missing data have attracted a lot of attention. The missing at random (MAR) assumption, which posits that the missingness mechanism depends solely on observed information, is adequate for completely determining the data distribution and has been rigorously investigated by Rubin (1976) ; Cheng (1994) ; Kenward and Molenberghs (1998) ; Efromovich (2011) . In this paper, we’re primarily concerned with the missing not at random (MNAR) assumption, wherein missingness is allowed to depend on the missing values. Compared to MAR, the MNAR setting is notably more complex, and as argued by Miao et al. (2016) and Wang et al. (2014) , even fully parametric models might not be identified based on the observed dataset’s distribution. The identification under MNAR is sometimes possible with additional tools like nonresponse instruments ( Wang et al., 2014 ; Wang et al., 2021 ) or shadow variables ( Miao and Tchetgen Tchetgen, 2016 ) coupled with some other assumptions. For example, Wang et al. (2014) assumes certain likelihood ratios to be monotone and Miao and Tchetgen Tchetgen (2016) considers certain completeness assumptions. But, till now, most works require knowledge of such non-response instruments or shadow variables to operationalize statistical estimation. In this paper, we aim to relax this requirement for binary outcomes using an exponential tilt framework. To provide more context, let us introduce some notation. Suppose a full data-point consists of (X,Y,R)\sim P where X\in{\mathbb{R}}^{d} is a covariate, Y\in\{0,1\} is a binary response and finally, R\in\{0,1\} indicates the missingness of Y , i.e. Y is not observed whenever R=0 . While the joint distribution of (X,Y)\mid R=1 is fully identified from the distribution of the observed dataset, unfortunately, we cannot identify the joint distribution of (X,Y)\mid R=0 from the observed data distribution under a general MNAR framework. This joint distribution, however, would have been fully identified if we knew the following importance weights: \textstyle\omega(x,y)=\frac{dP(x\mid Y=y,R=0)P(Y=y\mid R=0)}{dP(x\mid Y=y,R=1)P(Y=y\mid R=1)}\,. (1.1) As they are typically unknown, our framework seeks to estimate them within the following parametric family defined in terms of a sufficient statistic t=T(x) : \textstyle\omega(x,y;\theta)={\sf exp}(\alpha_{y}+{\beta_{y}}^{\top}t)\,. (1.2) where \theta=(\alpha_{0},\alpha_{1},\beta_{0},\beta_{1}) are the collection of parameters. As demonstrated in Lemma C.1 , such a parametric specification allows the missingness propensity score P(R=1\mid X,Y) to depend on the outcome Y whenever \alpha_{1}\neq\alpha_{0} or \beta_{1}\neq\beta_{0} . Following the nomenclature in Maity et al. (2023) , we refer to this parametric specification in ( 1.2 ) as the “exponential tilt model” and \theta as the “tilt parameters”. The term “exponential tilt” has previously been used by Kim and Yu (2011) , who considers the following model for the missingness mechanism \textstyle P(R=1\mid X,Y)=[1+{\sf exp}(g(X)+\gamma Y)]^{-1} (1.3) or, equivalently stated as \omega(X,Y)={\sf exp}\{g(X)+\gamma Y\}\cdot P(R=1)\cdot\{P(R=0)\}^{-1} ; the \gamma is termed as the tilt parameter, and g(x) is an unknown function of x . To facilitate statistical inference, they assume that either they know \gamma or an estimate is available from a different survey dataset. In fact Wang et al. (2014) ; Miao et al. (2016) argues that such a model is not identifiable from the distribution of the observed dataset if \gamma is unknown. To make it identifiable Wang et al. (2014) introduces an instrumental variable approach: the full covariate X can be split as X=(U,Z) and the unknown function g is only a function of U , i.e. g(X)=g(U) . The covariate Z , termed as non-response instrument, doesn’t affect the missingness mechanism but affects the outcome. Such a model has two notable limitations: (1) it doesn’t allow interaction terms between Y and X within the missingness propensity score, and (2) the covariate U , which satisfies P(R=1\mid X,Y)=P(R=1\mid U,Y) and thus we refer to as “missingness controlling variable” (MCV), has to be known beforehand. While the shadow variable framework in Miao and Tchetgen Tchetgen (2016) , described as Z\perp R\mid(Y,U) , where Z is called the shadow variable, can allow for an arbitrary interaction between U and Y within the missingness mechanism, the U needs to be known beforehand. In both the frameworks, one needs to make an assumption, g(X)=g(U) or Z\perp R\mid(Y,U) , that is not verifiable from the observed dataset. Our model mitigates both of these problems, as 1. the tilt parameters themselves can arbitrarily depend on Y , which allows interactions between X and Y , and 2. it doesn’t require any knowledge of instruments or shadow variables as a pre-requirement; rather, it estimates the importance weights in ( 1.1 ) as exponential tilts, thus allowing for a greater flexibility. Another advantage of our model is discussed in Section 1.1 , where we draw a connection with the distribution shift literature and argue that such an interaction between X and Y can allow for a broad class of shifts between the distributions (X,Y)\mid R=0 and (X,Y)\mid R=1 . Our contribution: Regarding the estimation of tilt parameters \theta , they are not identifiable in general. To make them identifiable, we propose a sufficient condition in Assumption 2.1 , which is, in principle, verifiable from the observed dataset. Given the identifiability, in Section 3 we develop a constrained optimization framework ( 3.2 ) to estimate the \theta . Our optimization relies on matching certain observable marginal distributions with Kullback-Leibler divergence. In the same section, we use the tilt parameter estimates to construct importance weighted estimators for both of the following mean functions {\mathbb{E}}[\tau(X,Y)] and {\mathbb{E}}[\tau(X,Y)\mid R=0] . While the importance weighted estimates are easy to comprehend, they can be unstable, as suggested by Li et al. (2023) and also seen in our simulation experiments (see Figures 1 and 2 ). As an alternative, we also introduce doubly robust estimators and verify their double robustness property under certain misspecifications in our tilt model (see our discussion following Theorem 3.4 ). Then, we validate the performances of these two estimators in a synthetic experiment in Section 4 . In Section 5 we utilize the exponential tilt framework to perform an unsupervised transfer learning task and mitigate certain spurious correlations in the Waterbirds dataset ( Sagawa et al., 2020 ) . As a byproduct, the exponential tilt model ( 1.2 ) estimates a proxy for the missingness controlling variable (MCV). The model implies that the missingness mechanism \textstyle P(R=1\mid X=x,Y=y)=\textstyle\frac{P(R=1)}{P(R=1)+\omega(x,y;\theta)P(R=0)}\,, as established in Lemma 3.1 , depends on X only through the U=(\beta_{0}^{\top}T(X),\beta_{1}^{\top}T(X)) . Thus, U can be treated as MCV. One can draw its