Decomposing Epistemic Uncertainty for Causal Decision Making
Md Musfiqur Rahman ,1 Ziwei Jiang ∗,2 Hilaf Hasson 3 Murat Kocaoglu 2 1 Electrical and Computer Engineering, Purdue University 2 Computer Science, Johns Hopkins University 3 Intuit AI Research [email protected], [email protected], [email protected], [email protected] · 2026
Read Decomposing Epistemic Uncertainty for Causal Decision Making by Md Musfiqur Rahman ,1 Ziwei Jiang ∗,2 Hilaf Hasson 3 Murat Kocaoglu 2 1 Electrical and Computer Engineering, Purdue University 2 Computer Science, Johns Hopkins University 3 Intuit AI Research [email protected], [email protected], [email protected], [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22736.txt.
Introduction
Md Musfiqur Rahman and co-authors from Purdue, Johns Hopkins, and Intuit study a hard problem in causal inference. Working with data from past cases, not new trials, they ask how sure we can be about the best action to take. Hidden factors can blur cause and effect, even when data are endless.
The authors split total doubt into parts, so each part can be judged on its own. Recent work used neural networks to set bounds on causal effects, but that task is often too hard to solve exactly. Clearer bounds help decision makers see what the data can prove, and what it cannot.
Catalog record
| CREATOR | Md Musfiqur Rahman ,1 Ziwei Jiang ∗,2 Hilaf Hasson 3 Murat Kocaoglu 2 1 Electrical and Computer Engineering, Purdue University 2 Computer Science, Johns Hopkins University 3 Intuit AI Research [email protected], [email protected], [email protected], [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 85 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-22736
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Decomposing Epistemic Uncertainty for Causal Decision Making Md Musfiqur Rahman ,1 Ziwei Jiang ∗,2 Hilaf Hasson 3 Murat Kocaoglu 2 1 Electrical and Computer Engineering, Purdue University 2 Computer Science, Johns Hopkins University 3 Intuit AI Research [email protected], [email protected], [email protected], [email protected] Abstract Causal inference from observational data provides strong evidence for the best action in decision-making without performing expensive randomized trials. The effect of an action is usually not identifiable under unobserved confounding, even with an infinite amount of data. Recent work uses neural networks to obtain practical bounds to such causal effects, which is often an intractable problem. However, these approaches may overfit to the dataset and be overconfident in their causal effect estimates. Moreover, there is currently no systematic approach to disentangle how much of the width of causal effect bounds is due to fundamental non-identifiability versus how much is due to finite-sample limitations. We propose a novel framework to address this problem by considering a confidence set around the empirical observational distribution and obtaining the intersection of causal effect bounds for all distributions in this confidence set. This allows us to distinguish the part of the interval that can be reduced by collecting more samples, which we call sample uncertainty, from the part that can only be reduced by observing more variables, such as latent confounders or instrumental variables, but not with more data, which we call nonID uncertainty. The upper and lower bounds to this intersection are obtained by solving min-max and max-min problems with neural causal models by searching over all distributions that the dataset might have been sampled from, and all SCMs that entail the corresponding distribution. We demonstrate via extensive experiments on synthetic and real-world datasets that our algorithm can determine when collecting more samples will not help determine the best action. This can guide practitioners to collect more variables or lean towards a randomized study for best action identification. 1 Introduction Causal decision-making aims to identify the best action relative to an objective function. For example, which drug maximizes the life expectancy of an average patient? Which candidate government policy should be enacted to reduce unemployment more? Since actions affect the system relative to its observational state, answering such questions requires causal models. Pearl’s structural causal modeling (SCM) framework provides us with a systematic set of complete algorithmic principles to identify the effect of actions from observational data through the do-operator and do-calculus, under well-defined assumptions ( 40 ; 49 ; 23 ; 46 ) , e.g., interventional distribution p(y|{do(}x))=\theta(p(\mathbf{v})) for some function \theta and observational distribution p(\mathbf{v}) . When the interventional distribution or the causal effect cannot be determined uniquely, the framework can be used to obtain bounds on causal effects ( 54 ; 22 ; 35 ; 22 ) . Figure 1 : Left: The case of infinite observational data. An identifiable causal effect can be estimated pointwise as in (a). Otherwise, we obtain bounds as in (b). Right: Given finite samples, we cannot pointwise estimate since the true distribution lies in a continuum of a confidence set. We can only obtain an interval as in (c). When the effect is not identifiable, we obtain a larger bound as in (d). Our goal is to analyze which part of this interval is due to non-identifiability and cannot be reduced by collecting more samples. Identifying causal effects allows us to make decisions about different actions. For example, we wish to know if enforcing a policy X=x is beneficial at the population level: P(y|do(x))>P(y) with the causal effect of X=x on Y=y ( 31 ; 13 ) . Similarly, we can choose the best action that maximizes reward by comparing P(y|do(x_{1})) and P(y|do(x_{0})) . However, a causal effect is not always identifiable; that is, when an observational distribution is compatible with SCMs that induce different values of the causal effect. In practice, usually we do not have access to the observational distribution, but the data sampled from it. So the set of possible observational distributions that correspond to the data introduces additional uncertainty for the causal effect estimation. Fortunately, point estimation of causal effect is not always necessary for causal decision-making ( 14 ) . If the utility of two actions are sufficiently different, partial identification of the causal effects, i.e., deriving upper and lower bounds to them, might be sufficient to determine the better action; for example, if the lower bound to the utility of Action 1 is greater than the upper bound to the utility of all other actions, we can still decide Action 1 is more desirable than the others. Also note that if the bounds are tight, then the slightest overlap of two causal effect bounds should lead any causal decision-making algorithm to say “I do not know, yet" since either action may be optimal. Especially for safety-critical applications, knowing when we do not know is crucial. It is then clear that obtaining tight causal effect bounds from observational data, and doing this efficiently in practice, is necessary for effective causal decision-making. Surprisingly, a practical problem that is mostly ignored by the SCM literature is the effect of having finite data and its role in the partial identification problem. To address the finite sample problem, we propose a novel formulation for obtaining causal effect bounds that are valid with a given confidence level obtained from the dataset. We then demonstrate how these bounds can be utilized for causal decision-making. Our key observation is that, having access to only finitely many samples renders any causal effect non-identifiable , i.e., it cannot be uniquely computed. This extends the concept of partial identifiability to causal effects that would be identifiable had we given access to infinitely many samples. In Figure 1 (Top), even though the interventional distribution {p}(y|{do(}x)) should be computed uniquely (top-left), but estimators fail to predict the correct estimate due to low sample size. We construct a bound (top-right) with distributions consistent with the empirical dataset to facilitate our decision-making. Next, we extend our uncertainty-aware causal effect bounds to causal queries that are not identifiable even with infinite data. Interestingly, our formulation enables a very natural decomposition of the causal effect bounds into two categories: A range of causal effect values that are guaranteed not to shrink even if we increase the number of samples in our dataset, called the nonID region, and the rest that may be reduced by collecting more samples. In a causal decision-making scenario, this nonID region crucially helps us to decide the next move: collect more samples or observe more variables. In Figure 1 (bottom), {p}(y|{do(}x)) is non-identifiable (bottom-left). The interval becomes wider due to finite samples (bottom-right). We decompose this wider bound into informative regions to suggest the next move. Finally, to approximate these bounds, which are in general computationally challenging, we resort to using neural/deep causal models ( 3 ; 33 ; 43 ; 51 ) . We show that the nonID causal effect region can be obtained by solving min-max and max-min problems. Outer optimization searches over observational distributions within a confidence set, and the inner optimization for a fixed distribution searches over all (neural) SCMs to maximize/minimize causal effect. Below are our contributions: • To the best of our knowledge,