Testing Identifiability and Transportability with Observational and Experimental Data
Konstantina Lelova, Gregory F. Cooper, Sofia Triantafillou · 2025
Read Testing Identifiability and Transportability with Observational and Experimental Data by Konstantina Lelova, Gregory F. Cooper, Sofia Triantafillou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-12801.txt.
Introduction
Konstantina Lelova, Gregory Cooper, and Sofia Triantafillou move causal findings from one population to another without knowing the full cause graph, in work from twenty twenty-five. Clinicians often must apply trial results from one group to patients in another. Standard tests need a cause map that is rarely known in practice.
Their Bayesian method blends survey data from the target group with trial data from a source group. It hunts for a set of factors that, once held fixed, lets effects carry over fairly. The team proves such a set, if one exists, sits inside a known boundary set. A greedy search picks the set that best fits both data sources. Tests on fake and mixed data found bias well.
Catalog record
| CREATOR | Konstantina Lelova, Gregory F. Cooper, Sofia Triantafillou |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-12801
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Testing Identifiability and Transportability with Observational and Experimental Data Konstantina Lelova, Gregory F. Cooper, Sofia Triantafillou Abstract Transporting causal information learned from experiments in one population to another is a critical challenge in clinical research and decision-making. Causal transportability uses causal graphs to model differences between the source and target populations and identifies conditions under which causal effects learned from experiments can be reused in a different population. Similarly, causal identifiability identifies conditions under which causal effects can be estimated from observational data. However, these approaches rely on knowing the causal graph, which is often unavailable in real-world settings. In this work, we propose a Bayesian method for assessing whether 𝐙 \mathbf{Z} -specific (conditional) causal effects are both identifiable and transportable, without knowing the causal graph. Our method combines experimental data from the source population with observational data from the target population to compute the probability that a causal effect is both identifiable from observational data and transportable. When this holds, we leverage both observational data from the target domain and experimental data from the source domain to obtain an unbiased, efficient estimator of the causal effect in the target population. Using simulations, we demonstrate that our method correctly identifies transportable causal effects and improves causal effect estimation. Keywords transportability \cdot identifiability \cdot observational data \cdot experimental data \cdot causal effect estimation 1 Introduction Estimating causal effects is a fundamental problem in understanding and predicting the impact of interventions. Experimental data, where treatments are randomized, are necessary for unbiased estimation of causal effects. However, experiments are costly and difficult to implement, so experimental data are typically scarce. In addition, the results from an experimental study done in one population cannot always be transported to a different population. In the clinical domain, clinicians often assume that the causal effect is transportable across domains, and use the causal effects estimated in a source domain to predict post-intervention outcomes in a target domain. However, without knowing the causal graph, we cannot know if the effects are indeed transportable. Observational data are much more plentiful. However, they are not necessarily valid for causal effect estimation, due to the presence of unmeasured variables that may confound treatments and outcomes. Both observational and experimental data are becoming increasingly available: Recent findings report that 80.5% of hospitals have at least a basic EHR system ( Adler-Milstein et al. 2017 ) . In addition, summary-level and individual participant-level data from clinical trials are increasingly being shared with the scientific community ( Sim 2022 ) . In this work, we propose a method for combining experimental data from a source population with observational data from the target population to test whether a causal effect is both identifiable from observational data and transportable. This allows us to use unbiased, low-variance estimators based on both data, when possible. X Z Y W X Z Y W X Z Y W S_{Z} S_{X} S_{W} (a) \mathcal{G} in source domain \Pi (b) \mathcal{G}^{*} in target domain \Pi^{*} (c) Selection diagram \mathcal{D} Figure 1: Example of a selection diagram: S_{Z} and S_{W} variables indicate the difference in the distribution of Z and W respectively between \Pi and \Pi^{*} in \mathcal{D} . S_{X} indicates the absence of the arrow from W to X in the target population. Variable \mathbf{S} denotes the set of selection variables, i.e., \mathbf{S}=\{S_{X},S_{Z},S_{W}\} . \mathbf{S}=\mathbf{s} indicates the distribution of the source domain, while \mathbf{S}=\mathbf{s}^{*} indicates the distribution of the target domain. (Z,W) is an s-admissible set and is also backdoor set in \mathcal{G}^{*} . P(Y|do(X),Z,W,S=s) is transportable from \Pi to \Pi^{*} , since Z,W is s-admissible. The method is motivated by the following scenario: We are interested in estimating the post-intervention outcomes of a treatment X on an outcome Y for a target population \Pi^{*} , where observational data measuring X,Y and a set of pre-treatment covariates \mathbf{O} are available. In addition, we have experimental data from a Randomized Control Trial (RCT) performed on a different population, measuring the same set of covariates. The two populations have differences that can be encoded using a selection diagram ( Pearl and Bareinboim 2011 ) . We use P(X,Y,\mathbf{O},\mathbf{s}) and P(X,Y,\mathbf{O},\mathbf{s}^{*}) to denote the observational distributions in the source and target domain, respectively. If a \mathbf{Z} -specific effect is transportable across populations, then: P(Y|do(X),\mathbf{Z},\mathbf{s})=P(Y|do(X),\mathbf{Z},\mathbf{s}^{*}) (1) If, in addition, the effect can be identified from observational data (i.e., conditional ignorability holds): P(Y|do(X),\mathbf{Z},\mathbf{s})=P(Y|X,\mathbf{Z},\mathbf{s}^{*}) (2) Eq. 2 includes quantities from the source experimental and the target observational distribution, for which data are available. We propose to combine the two data sets to identify subsets \mathbf{Z} of the observed covariates for which Eq. 2 holds. In this case, both the source experimental and the target observational data can be used to give an unbiased prediction for Y|do(X),\mathbf{s}^{*} . Our work makes the following contributions to causal discovery from multiple environments: • We provide a method for computing the probability that a causal effect is transportable and identifiable from observational data, without requiring knowledge of the causal graph. To the best of our knowledge, our method is the first to compute such probabilities. • We introduce a method for exploring the space of possible subsets of observed variables to identify the optimal set of conditioning variables, \mathbf{Z} , for estimating the post-treatment outcome Y|do(X),\mathbf{s}^{*} in the target domain. Hence, we recast the problem of transportability as a feature selection problem, in contrast to existing approaches which focus on pre-specified effects, typically given all observed covariates. The remainder of the paper is organized as follows: Section 2 reviews transportability and identifiability when the causal graph is known. Section 3 presents motivating examples that illustrate how our method can make useful inferences. Section 4 details the proposed method. Section 5 reviews relevant literature. Finally, Section 6 demonstrates, using simulated data, that our method correctly identifies sets that satisfy Eq. 2 and improves causal effect estimation. 2 Preliminaries We adopt the framework of structural causal models (SCMs) ( Pearl 2000 ) , and assume the reader is familiar with related terminology. An SCM M is a tuple M=\langle\mathbf{U},\mathbf{V},\mathbf{F},P(\mathbf{U})\rangle , where: \mathbf{U} is the set of exogenous variables, \mathbf{V}=\{V_{1},V_{2},\dots,V_{n}\} is the set of endogenous variables, \mathbf{F}=\{f_{1},\dots,f_{n}\} is a set of functions, where each f_{i} maps variables in \mathbf{U}\cup\mathbf{V} to V_{i} and P(\mathbf{U}) is a probability function defined over the domain of \mathbf{U} . An intervention do(X=x) on a causal model M creates a new model M_{x}=\langle\mathbf{U},\mathbf{V},\mathbf{F}_{x},P(\mathbf{U})\rangle , where F_{x} is obtained by replacing the function f_{X}\in\mathbf{F} for every X\in\mathbf{X} with a new function that outputs a constant value x . We use \mathcal{G} to denote a causal Directed Acyclic Graph (DAG) associated with M and say \mathcal{G} induces a probability distribution P if P factorizes according to \mathcal{G} . The graphical criterion of d -separation can be used on \mathcal{G} to determine the conditional (in) dependencies in distribution P . We say that \mathcal{G} and P are faithful to each other if a conditional independence in P implies a d -separation in \mathcal{G} . In \mathcal{G} , do(X=x) is modeled by removing all incoming edges into X . The post-intervention DAG is denoted \mathcal{G}_{\overline{X}} , and the post-intervention distribution is denoted P(do(X),\mathbf{Y},\mathbf{V\cup U}) . We call the post-intervention distribution P(Y\mid do(X),\mathbf{Z}) , a