Bounding interventional queries from generalized incomplete contingency tables
Ivano Lodato, Aditya V. Iyer, Isaac Z. To · 2025
Read Bounding interventional queries from generalized incomplete contingency tables by Ivano Lodato, Aditya V. Iyer, Isaac Z. To (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-05755.txt.
Introduction
Ivano Lodato, Aditya Iyer, and Isaac To tackle causal questions when a data table has a whole row of gaps. In such tables some chances are undefined because the missing entries arose from random sampling zeros. The usual fixes, dropping rows or filling in guesses, can quietly bias estimates of treatment effects.
Instead, the authors treat the unknown chances as free dials. They write the causal query as a formula in those dials, then push the formula to its extremes under basic probability rules. The result is a sharp range that must contain the true value, under weak assumptions about how much data is missing. The method works whatever caused the gaps, giving rigorous bounds for causal inference with holes.
Catalog record
| CREATOR | Ivano Lodato, Aditya V. Iyer, Isaac Z. To |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-05755
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Bounding interventional queries from generalized incomplete contingency tables Ivano Lodato, Aditya V. Iyer, Isaac Z. To Abstract We introduce a method for evaluating interventional queries and Average Treatment Effects (ATEs) in the presence of generalized incomplete contingency tables (GICTs), contingency tables containing a full row of random (sampling) zeros, rendering some conditional probabilities undefined. Rather than discarding such entries or imputing missing values, we model the unknown probabilities as free parameters and derive symbolic expressions for the queries that incorporate them. By extremizing these expressions over all values consistent with basic probability constraints and the support of all variables, we obtain sharp bounds for the query of interest under weak assumptions of small missing frequencies. These bounds provide a formal quantification of the uncertainty induced by the generalized incompleteness of the contingency table and ensure that the true value of the query will always lie within them. The framework applies independently of the missingness mechanism and offers a conservative yet rigorous approach to causal inference under random data gaps. 1 Introduction The problem of missing data is ubiquitous in real-world data analysis. It can arise due to imperfect experiments (e.g. noncompliance), ethical constraints (e.g. experimental treatments for elderly individuals), design limitations (e.g. difficulty in meeting inclusion criteria in a region), or even physical impossibilities (e.g., the absence of data on three-legged humans). The problem of missingness in datasets has been widely studied in the literature: a variety of statistical methods exist to impute the missing variable(s) values (for reference, see [ 1 , 2 ] ) under (often restrictive) hypotheses on the mechanism of missingness, in our opinion best explained and exemplified in [ 3 ] (Pearl) (see entries m_{1,2} in Table 1 for example). In general, however, even if a dataset does not contain any missing values, it is still possible that the contingency table contains zeroes. Those are typically divided into two categories: structural/fixed zeros and random/sampling zeros. The first type groups variables that are logically or physically constrained to be zero (e.g. no data exist on a person before their birth or on three-legged man); structural zeros can be cut out from the contingency table as they have no degrees of freedom associated [ 4 ] (for an exhaustive description, see also [ 5 ] ). Random zeros, instead, are due to small sample sizes or, conversely, to rare events. The expected missing counts are small, at least compared to the observed counts, which breaks down asymptotic (large frequencies) approximations. Nevertheless, under simplifying assumptions on the mechanism of missingness, missing frequencies can be computed using maximum likelihood estimation (see for instance [ 6 , 7 , 8 ] and for a recent general exposition [ 9 ] ) In this paper, we will take a much more conservative approach and avoid using specific models for the sampling distributions, as well as completely bypass the estimation of the missing values. Instead, we will first assume that random zeros can be modeled as actual zeros, as long as the probability associated with the missing frequency is well-defined (similar to the perspective taken in [ 10 ] , though with different goals). Secondly, we will propose a way to handle contingency tables containing an entire row of random zeros, leading to ill-defined probabilities. We call this a generalized incomplete contingency table (GICT), the object central to our analysis. 2 Generalized incomplete contingency tables To illustrate the problem at hand clearly, let us consider the dataset shown in Table 1 which tracks Age, Gender, and Obesity status for 10 patients. Now, depending on the query of interest, the dataset and, more importantly, the corresponding contingency table may contain missing entries. Let us consider first a simple example: for the query P({\rm Age}\in[14,15]|{\rm Gender}\in[0,1]) , the dataset and the contingency table do not suffer from any type of missingness. For a different query, e.g. P({\rm Obesity}=1|{\rm Gender}=1,{\rm Age}=14) , the contingency table is incomplete and contains a random zero Z_{0} . Since the complementary probability P({\rm Obesity}=0|{\rm Age}=14,{\rm Gender}=1)=1 is well defined, we can very conservatively assign the actual value zero to the random zero Z_{0} . Finally, consider the query P({\rm Obesity}=[0,1]|{\rm Gender}=1,{\rm Age}=16) : the contingency table is now ‘‘generalized incomplete”, with a full row of zero values 1 1 1 We exclude the column “missing” from the contingency table, since it is relevant to the discussion on dataset missingness but not in this discussion on random zeros in the contingency table. . This time, we cannot naively impute the value 0 to Z_{1,2} , since it leads to inconsistencies, violations of basic probabilistic constraints, and introduces numerical errors into downstream analysis. In fact: \displaystyle P({\rm Obesity}=0,1|{\rm Gender}=1,{\rm Age}=16)=\frac{P({\rm Obesity}=0,1,{\rm Gender}=1,{\rm Age}=16)}{P({\rm Gender}=1,{\rm Age}=16)}=\frac{Z_{1,2}}{Z_{1}+Z_{2}} \displaystyle\qquad\quad\sum_{o=0,1}P({\rm Obesity}=o|{\rm Gender}=1,{\rm Age}=16)=\frac{Z_{1}}{Z_{1}+Z_{2}}+\frac{Z_{2}}{Z_{1}+Z_{2}}=\frac{0}{0}\;\;(\neq 1) N Age Gender Obesity 1 16 0 1 2 16 0 0 3 15 0 m_{1} 4 15 0 1 5 15 0 1 6 15 1 m_{2} 7 14 0 1 8 14 0 0 9 14 0 1 10 14 1 0 Table 1: A dataset with 10 entries with Gender [0,1] , Age [14,15,16] and Obesity [0,1] . With m_{1,2} we indicated the missing data Obesity Age Gender 0 1 missing 14 0 1 2 0 1 1 Z_{0} 0 15 0 1 2 m_{1} 1 1 0 m_{2} 16 0 1 1 0 1 Z_{1} Z_{2} 0 Table 2: Contingency table obtained from dataset in Table 1 . Z_{1,2,3} are the random/sampling zeros There are ways to circumvent the problem of having generalized random zeros in a contingency table: the easiest is to exclude the fully missing rows from the contingency table and restrict the analysis to the subset of feature values that are empirically represented. While straightforward, this strategy is not always advantageous: in many cases, the very combinations that are missing—such as the application of aggressive treatments to elderly patients—are precisely those of greatest scientific or clinical interest. However, collecting data on such combinations may be impractical, unethical, or infeasible. Obesity Age Gender 0 1 A1 0 1 2 1 1 0 A2 0 2 3 1 1 0 Table 3: Contingency table obtained from dataset in Table 1 after collapsing the contingency table by grouping the Age values in {\rm A1}=\{14\},{\rm A2}=\{15,16\} . Here explicitly Z_{0,1,2}=0 Another possible way to handle generalized random zeros is to “hide” the missing entries by collapsing the contingency table. For instance, one could group the Age values as [{\rm A1},{\rm A2}]=[\{14\},\{15,16\}] so that the contingency table now has no fully-zero rows (or columns) - see table 3 . It is worth noting that a general contingency table can, in principle, possess a multitude of generalized random zeros. For instance, we could add to our table 2 a series of generalized random zeros, simply by considering values of Age outside the variable support defined by the observed data, e.g. {\rm Age}<14 or {\rm Age}>16 . Those zeroes will be referred to as spurious generalized random zeros , because such extra additions are unwarranted and illogical, as they would forcefully add unobserved zeros to the contingency table. This is the reason why we restrict generalized random zeroes to zero entries in the ICT within the support of the categorical variable