Cross-World Assumption and Refining Prediction Intervals for Individual Treatment Effects
Juraj Bodik [email protected], Yaxuan Huang [email protected], Bin Yu [email protected] · 2025
Read Cross-World Assumption and Refining Prediction Intervals for Individual Treatment Effects by Juraj Bodik [email protected], Yaxuan Huang [email protected], Bin Yu [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-12581.txt.
Introduction
Juraj Bodik, Yaxuan Huang, and Bin Yu tackle a hard question in cause-and-effect study: how sure can we be about a treatment's effect on one person, in a 2025 paper. Averages over groups hide the spread across people, yet no one can be both treated and untreated, so the single-person effect can never be seen directly. Their work asks how much a stated link between the two unseen outcomes can help.
Given a bound on that link, drawn from expert knowledge, their ranges for the single-person effect hold up in theory and shrink to a third of rival widths. The authors argue this makes personal effect ranges both honest and useful for high-stakes choices.
Catalog record
| CREATOR | Juraj Bodik [email protected], Yaxuan Huang [email protected], Bin Yu [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 90 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-12581
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Cross-World Assumption and Refining Prediction Intervals for Individual Treatment Effects Juraj Bodik [email protected], Yaxuan Huang [email protected], Bin Yu [email protected] Abstract While average treatment effects (ATE) and conditional average treatment effects (CATE) provide valuable population- and subgroup-level summaries, they fail to capture uncertainty at the individual level. For high-stakes decision-making, individual treatment effect (ITE) estimates must be accompanied by valid prediction intervals that reflect heterogeneity and unit-specific uncertainty. However, the fundamental unidentifiability of ITEs limits the ability to derive precise and reliable individual-level uncertainty estimates. To address this challenge, we investigate the role of a cross-world correlation parameter, ρ ( x ) = cor ( Y ( 1 ) , Y ( 0 ) ∣ X = x ) \rho(x)=\text{cor}\big(Y(1),Y(0)\mid X=x\big) , which describes the dependence between potential outcomes, given covariates, in the Neyman-Rubin super-population model with i.i.d. units. Although ρ \rho is fundamentally unidentifiable, we argue that in most real-world applications, it is possible to impose reasonable and interpretable bounds informed by domain-expert knowledge. Given ρ \rho , we design prediction intervals for ITE, achieving more stable and accurate coverage with substantially shorter widths; often less than 1/3 of those from competing methods. The resulting intervals satisfy coverage guarantees P ( Y ( 1 ) − Y ( 0 ) ∈ C I T E ( X ) ) ≥ 1 − α P\big(Y(1)-Y(0)\in C_{ITE}(X)\big)\geq 1-\alpha and are asymptotically optimal under Gaussian assumptions. We provide strong theoretical and empirical arguments that cross-world assumptions can make individual uncertainty quantification both practically informative and statistically valid. Keywords: Causal Inference, Individual Treatment Effect, Cross-World Assumptions, Uncertainty Quantification, Conformal Inference 1 Introduction The average treatment effect (ATE) is a common standard for evaluating causal effects, offering a population-level summary of the impact of an intervention ( Imbens and Rubin 2015 ) . In many decision-making settings, relying solely on the ATE is insufficient, as it fails to capture the heterogeneity in individual responses to treatment. In personalized medicine, policy evaluation, and economics, understanding individual treatment effects (ITE) is crucial for tailoring interventions to a specific individual ( Athey and Imbens 2016b ; Robins et al. 2000 ) . Nevertheless, estimating ITE comes with significant challenges, particularly in constructing reliable prediction intervals that quantify uncertainty. A fundamental challenge in estimating ITE is its inherent non-identifiability. Since we can never observe both potential outcomes Y(0),Y(1) for the same individual, the true ITE remains unknown. This limitation is deeply connected to Pearl’s third ladder of causation ( Pearl and Mackenzie 2019 ) , which deals with counterfactual reasoning. While association (first ladder) and intervention (second ladder) can be addressed through statistical and experimental methods, counterfactual inference requires untestable assumptions about the unobserved hypothetical “What if” world. A natural way to mitigate the challenges of estimating ITE is to consider the Conditional Average Treatment Effect (CATE). Unlike ITE, which remains fundamentally unobservable, CATE can be consistently estimated using statistical and machine learning methods under standard causal assumptions ( Hahn 1998 ; Wager 2024 ) . While CATE provides valuable insights into treatment heterogeneity, it does not offer direct uncertainty quantification for individual effects—only for group-level averages. In many applications, such as personalized medicine or policy evaluation, decision-makers require prediction intervals rather than just point estimates with confidence intervals, ensuring reliable risk assessment for each individual. Several recent works have proposed methods for constructing prediction intervals for ITEs ( Lei and Candès 2021 ; Kivaranovic et al. 2020 ; Alaa et al. 2023 ; Jonkers et al. 2024 ) . However, these approaches either result in extremely wide intervals with limited practical utility, or lack coverage guarantees due to the fundamental unidentifiability of ITEs. We aim to bridge this gap—producing narrow prediction intervals for individual treatment effects while maintaining rigorous coverage guarantees. To achieve this, we rely on a new assumption, which can be specified or bounded using expert domain knowledge. Definition 0 (Cross-world assumption) . In the Neyman–Rubin super-population model with i.i.d. units, the dependence structure (conditional correlation) between the potential outcomes Y(1),Y(0) , conditioned on the observed covariates X , is defined as: \rho(x)=\operatorname{cor}\big(Y(1),Y(0)\mid X=x\big). (1) We refer to an assumption about \rho as a cross-world assumption. While the term “cross-world assumption” is newly introduced in this work, related ideas have appeared in prior literature (see related literature in Section 2.2 ), albeit without being explicitly named. These assumptions are typically embedded within additive structural equation models, in which the dependence between potential outcomes is captured by the correlation \rho between the exogenous noise terms \varepsilon_{0} and \varepsilon_{1} in the model: Y_{i}(0)=\mu_{0}(X_{i})+\varepsilon_{0},\quad Y_{i}(1)=\mu_{1}(X_{i})+\varepsilon_{1},\,\,\,\,\,\,\text{ where }\operatorname{cor}(\varepsilon_{1},\varepsilon_{0})=\rho(X_{i}). Although \rho is unidentifiable, we argue that incorporating expert domain knowledge to postulate at least plausible bounds on \rho is both reasonable and aligned with how humans make judgments in practice. Observing one potential outcome is typically highly informative about the unobserved counterfactual, often conveying information beyond what is captured by measured covariates ( Chernozhukov et al. 2023 ; Wu et al. 2025 ) . Despite it being untestable, humans make use of counterfactual statements all the time, which is necessary for intelligent behavior ( Lewis 2020 ) . Consider the following situation: a scholarship program for low-income students, where the treatment—receiving the scholarship—is randomly assigned via a coin toss, and standard causal assumptions hold. The potential outcome Y_{i}(1) represents the future income of student i if awarded the scholarship, and Y_{i}(0) if not. While a finite set of covariates X_{i} is available, the observed outcome alone may still reveal a great deal about the missing potential outcome. Students with high intrinsic ability or motivation are likely to perform well regardless of treatment, and a high Y_{i}(0) implies a high Y_{i}(1) , and vice versa, as shared latent traits influence both outcomes. This dependence remains even after conditioning on X_{i} , since important variables like motivation or cognitive ability, which strongly affect future income, are typically unmeasured in most studies. These traits necessarily lead to Y_{i}(1) and Y_{i}(0) being positively correlated (after conditioning on finite number of covariates X_{i} ). While discussion about the effects of hidden covariates and counterfactuals is fundamentally philosophical and tied to the untestable nature of potential outcomes, we argue that in many practical settings, assuming a positive cross-world correlation is both plausible and necessary for informative individual-level inference. We believe that postulating \rho(x)>0 or even \rho(x)>0.5 may be a very reasonable assumption in the scholarship case. In Section 2 we delve deeper into the discussion about the cross-world assumption. Nevertheless, our main goal is to construct the smallest possible prediction intervals C_{ITE} for individual treatment effect satisfying for given \alpha\in(0,1) : \mathbb{P}\big(Y(1)-Y(0)\in C_{ITE}(X)\big)\geq 1-\alpha, (2) or more ambitiously, \mathbb{P}\big(Y(1)-Y(0)\in C_{ITE}(X)\mid X=x\big)\geq 1-\alpha. (3) Our contributions represent, to our knowledge, the first to establish rigorous finite-sample and asymptotic guarantees for individual-level prediction intervals under cross-world assumption. Specifically, they are three-folds: • We propose a novel class of prediction intervals, denoted CW(\rho) (Cross-World Intervals), which incorporate cross-world assumption on \rho . • When \rho is known, we prove that CW(\rho) intervals are, under some assumptions, asymptotically optimal in a sense that they are the smallest intervals that satisfy ( 3 ). Even when \rho is only bounded, or sample