Doubly robust identification of treatment effects from multiple environments
Piersilvio De Bartolomeis 1, Julia Kostin 1, Javier Abad 1, Yixin Wang 2, Fanny Yang 1 · 2025
Read Doubly robust identification of treatment effects from multiple environments by Piersilvio De Bartolomeis 1, Julia Kostin 1, Javier Abad 1, Yixin Wang 2, Fanny Yang 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-14459.txt.
Introduction
Estimating a treatment's true effect from everyday data is hard when hidden factors steer both treatment and outcome. Piersilvio De Bartolomeis and co-authors propose an algorithm in 2025, called RAMEN, that pools several data sources with different quirks. It needs neither the true causal diagram nor a guess at it.
The method is doubly robust in a new sense. It finds the effect whenever the causes of either the treatment or the outcome are measured. That side must also behave the same across sources. Tests on synthetic and real data beat existing methods. The authors aim at medicine and social science, where experiments are often impractical or unethical and pooled records are the only option.
Catalog record
| CREATOR | Piersilvio De Bartolomeis 1, Julia Kostin 1, Javier Abad 1, Yixin Wang 2, Fanny Yang 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 90 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-14459
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Doubly robust identification of treatment effects from multiple environments Piersilvio De Bartolomeis 1, Julia Kostin 1, Javier Abad 1, Yixin Wang 2, Fanny Yang 1 Abstract Practical and ethical constraints often require the use of observational data for causal inference, particularly in medicine and social sciences. Yet, observational datasets are prone to confounding, potentially compromising the validity of causal conclusions. While it is possible to correct for biases if the underlying causal graph is known, this is rarely a feasible ask in practical scenarios. A common strategy is to adjust for all available covariates, yet this approach can yield biased treatment effect estimates, especially when post-treatment or unobserved variables are present. We propose Ramen , an algorithm that produces unbiased treatment effect estimates by leveraging the heterogeneity of multiple data sources without the need to know or learn the underlying causal graph. Notably, Ramen achieves doubly robust identification : it can identify the treatment effect whenever the causal parents of the treatment or those of the outcome are observed, and the node whose parents are observed satisfies an invariance assumption. Empirical evaluations on synthetic and real-world datasets show that our approach outperforms existing methods 1 1 1 See our GitHub repository: https://github.com/jaabmar/RAMEN/ . 1 Introduction Treatment effects are key quantities of interest in applied domains such as medicine and social sciences, as they determine the impact of interventions like novel treatments or policies on outcomes of interest. To achieve this goal, researchers often rely on randomized trials since randomizing the treatment assignment guarantees unbiased treatment effect estimates under mild assumptions. However, methods relying on randomized data face several issues, such as small sample sizes, sample populations that do not reflect those seen in the real world, and ethical or financial constraints. As a result, there is growing interest in using observational data to estimate treatment effects. X_{2} Y T X_{1} U (a) \{X_{1},X_{2}\} is a valid adjustment set X_{2} Y T X_{1} U (b) \{X_{1},X_{2}\} is not a valid adjustment set Figure 1 : Two causal graphs illustrating when the set of all covariates is or is not a valid adjustment set: (a) \{X_{1},X_{2}\} blocks all backdoor paths between T and Y , making it a valid adjustment set; (b) X_{1} opens a noncausal path between T and Y , introducing bias in the treatment effect estimate if adjusted for. Unobserved variables are dashed and colored in white, bad controls are colored in red, and good controls —covariates that can be included in the adjustment set—are colored in green. A fundamental challenge in using observational data is the selection of a valid adjustment set , i.e. a set of covariates that can be used to identify and estimate the treatment effect. Although criteria for identifying valid adjustment sets are well-established, they rely on the knowledge of the underlying causal graph. When the graph is not known, practitioners often adjust for all available covariates [ 5 ] . Yet, this approach runs the risk of including bad controls —covariates that, when conditioned on, invalidate the adjustment set and thereby bias the treatment effect estimate. For instance, consider the causal graphs illustrated in Figure 1 , where \{X_{1},X_{2}\} are the observed covariates. In Figure 1(a) , both X_{1} and X_{2} are parents of T , and adjusting for \{X_{1},X_{2}\} blocks all backdoor paths between T and Y , making it a valid adjustment set. In contrast, in Figure 1(b) , X_{1} is a child of T , and conditioning on it opens a noncausal path between T and Y , introducing bias in the treatment effect estimate. In the latter case, X_{1} is referred to as a bad control . Bad controls pose a significant challenge when the causal ordering of the observed covariates is not clear [ 45 , 53 ] . A prominent example for a bad control is the birth-weight paradox [ 84 ] from which it was concluded that when estimating the effect of maternal smoking ( T ) on infant mortality ( Y ), the birth weight would be a bad control like X_{1} in Figure 1(b) , as it is a child node of T and likely leads to collider bias. Further, Acharya et al. [1] found that up to two-thirds of empirical studies in political science that make causal claims inadvertently include bad controls in their analysis, leading to biased treatment effect estimates. Several works have tried to tackle the problem of bad controls using expert-driven structural knowledge, e.g. by leveraging anchor variables [ 10 , 71 ] , but such domain expertise is often unavailable in practice. Shi et al. [75] propose an alternative approach that leverages access to multiple heterogeneous data sources—e.g. observational studies from different countries—to identify and estimate the treatment effect in the presence of bad controls. Yet, their approach can fail to identify the treatment effect when some variables in the causal graph are unobserved and their distribution shifts across environments, e.g. for the graph in Figure 1(b) . In this work, we propose R obust A TE identification from M ultiple EN vironments ( Ramen ), an algorithm that identifies and estimates the average treatment effect in the presence of bad controls without the need to know or learn the complete causal graph. Notably, Ramen leverages the heterogeneity of multiple data sources to achieve doubly robust identification : it can identify the average treatment effect whenever the causal parents of the treatment or those of the outcome are fully observed, and the node whose parents are observed satisfies an invariance assumption. In particular, our methodology relaxes the full observability requirements of Shi et al. [75] , requiring only partial observability of the causal graph. Our key contributions are outlined below. • We propose the first algorithm, to our knowledge, that leverages multiple heterogeneous data sources to identify and estimate the average treatment effect in the presence of both bad controls and unobserved variables. Our algorithm is based on a novel double robustness property that offers two strategies to identify the treatment effect: either observe the causal parents of the treatment or those of the outcome. • We demonstrate that our algorithms significantly outperform existing approaches for treatment effect estimation in the presence of bad controls on synthetic, semi-synthetic and real-world datasets. We further evaluate our method on a real-world example, showing that our results align with established epidemiological knowledge. 2 Related work Various criteria and methods have been proposed for covariate selection, often in the form of sufficient conditions for a given causal graph, such as the backdoor criterion and its variations [ 55 , 76 , 79 , 47 , 58 ] . However, since the causal graph is rarely known in real-world applications, the most common heuristic approach assumes that all observed covariates are pre-treatment and includes all of them [ 5 , p. 414] . Yet, including all covariates has several drawbacks: certain pre-treatment covariates can introduce M-bias [ 19 , 25 , 11 , 71 ] , and even when bias is not an issue, selecting a smaller subset of covariates can lead to more efficient estimates [ 29 , 83 , 15 , 69 , 85 , 33 , 27 ] . The problems