Marginal Causal Flows for Validation and Inference
Daniel de Vassimon Manela, Laura Battaglia, Robin J. Evans · 2024
Read Marginal Causal Flows for Validation and Inference by Daniel de Vassimon Manela, Laura Battaglia, Robin J. Evans (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-01295.txt.
Description
Abstract Investigating the marginal causal effect of an intervention on an outcome from complex data remains challenging due to the inflexibility of employed models and the lack of complexity in causal benchmark datasets, which often fail to reproduce intricate real-world data patterns.
Catalog record
| CREATOR | Daniel de Vassimon Manela, Laura Battaglia, Robin J. Evans |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 76 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2411-01295
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Marginal Causal Flows for Validation and Inference Daniel de Vassimon Manela, Laura Battaglia, Robin J. Evans Abstract Investigating the marginal causal effect of an intervention on an outcome from complex data remains challenging due to the inflexibility of employed models and the lack of complexity in causal benchmark datasets, which often fail to reproduce intricate real-world data patterns. In this paper we introduce Frugal Flows, a novel likelihood-based machine learning model that uses normalising flows to flexibly learn the data-generating process, while also directly inferring the marginal causal quantities from observational data. We propose that these models are exceptionally well suited for generating synthetic data to validate causal methods. They can create synthetic datasets that closely resemble the empirical dataset, while automatically and exactly satisfying a user-defined average treatment effect. To our knowledge, Frugal Flows are the first generative model to both learn flexible data representations and also exactly parameterise quantities such as the average treatment effect and the degree of unobserved confounding. We demonstrate the above with experiments on both simulated and real-world datasets. 1 Introduction Simulating realistic datasets such that the marginal causal effect is constrained to take a specific form is a significant challenge in causal inference. Many methods for inferring these effects exist, but simulating from them is a significant challenge ( Young et al., 2008 ; Havercroft and Didelez, 2012 ; Keogh et al., 2021 ) . In particular, it is difficult to simulate complex benchmarks from generative models in such a way that a custom marginal effect exactly holds. The frugal parameterisation ( Evans and Didelez, 2024 ) provides a solution to this problem by constructing a joint distribution that explicitly parameterises the marginal causal effect and builds the rest of the model around it. Frugal models typically represent the dependency between an outcome and pretreatment covariates using copulae. Standard multivariate copulae are parametric, leading to potential model misspecification. In this paper we show how one can construct frugally parameterised marginal causal models using normalising flows ( Rezende and Mohamed, 2015 ; Dinh et al., 2016 , NFs,) to target the causal margin of the distribution (a conditional univariate marginal density of an outcome conditioned on a treatment). We name the resulting model a Frugal Flow (FF). To the best of our knowledge, FFs offer the first likelihood-based framework for learning a marginal causal effect while modelling the outcome and propensity nuisance parameters using flexible generative models. FFs are exceptionally well suited for generating benchmark datasets for causal method validation. Since FFs enable direct parameterisation of the causal margin, they provide a framework for generating causal benchmark datasets which resemble real-world datasets, but which also allow users to encode causal properties in order to validate novel inference models. FFs can be used to generate benchmarks with customisable degrees of unobserved confounding. This can aid in the validation of model robustness under conditions where the assumption of conditional ignorability does not hold. Here, conditional ignorability (or conditional exchangeability) means that marginal distribution of the potential outcomes is independent of the value of treatment, conditional on the observed covariates ( Pearl, 2009 ) . FFs offer marked improvements over current benchmarking generation methods, which use soft constraint optimisation to enforce the desired causal restrictions ( Kendall, 1975 ; Parikh et al., 2022 ) . As a result, post hoc checks are required to see whether these conditions are present in the synthetic data. FFs do not require this second step, as relevant conditions are explicitly encoded in the underlying likelihood. Finally, FFs allow for outcomes to be sampled from marginal logistic and probit models, making them the first generative benchmarking model to facilitate the simulation of binary outcomes with a choice of user specified risk differences, risk ratios, or odds ratios. 2 Background In this paper we consider a static treatment model with an outcome Y\in\mathcal{Y}\subseteq\mathbb{R} and T a binary treatment in \mathcal{T}=\{0,1\} . Let the set of measured pretreatment covariates be \bm{Z}\in\mathcal{Z}\subseteq\mathbb{R}^{D} . Additionally, we will use the notation of Pearl (2009) where intervened distributions are indicated by the presence of a “ \operatorname{do}(\cdot) ” operator, with its absence indicating that the distribution is from the observational regime. 2.1 Marginal Causal Models Causal inference methods are generally developed to estimate the average effect of a treatment (T) on an outcome (Y) for a population defined by a set of pretreatment covariates (\bm{Z}) ( Hernán and Robins, 2020 ) . Let the variables be distributed according to (\bm{Z},T,Y)\sim P_{{\hskip-0.5pt\bm{Z}\hskip-1.0ptT\hskip-0.75ptY}} with density p_{{\hskip-0.5pt\bm{Z}\hskip-1.0ptT\hskip-0.75ptY}} . We make the standard assumptions of a stable unit treatment value (commonly referred to as SUTVA), positivity, and conditional ignorability (equivalent to conditional exchangability) outlined in Pearl (2009) . Additionally, the covariate set \bm{Z} must only include pretreatment covariates. The conditional distribution of Y and \bm{Z} after an intervention on T is equal to p_{{\bm{Z}\hskip-0.5ptY\hskip-0.5pt|\hskip-0.5pt\operatorname{do}(T)}}(\bm{z},~y\mid t)=p_{\bm{Z}}(\bm{z})\cdot p_{{\hskip-0.5ptY\hskip-0.5pt|\hskip-0.5pt\bm{Z}\hskip-1.0pt,\hskip-0.5pt\operatorname{do}(T)}}(y\mid\bm{z},~t). Causal practitioners are often interested in the marginal effect of T on Y on the intervened system, sometimes referred to as the marginal outcome distribution (MOD), p_{Y\mid\operatorname{do}(T)} : p_{{Y\hskip-0.5pt|\hskip-0.5pt\operatorname{do}(T)}}(y\mid t)=\int_{\mathcal{Z}}d\bm{z}~p_{{\hskip-0.5ptY\hskip-0.5pt|\hskip-0.5pt\bm{Z}\hskip-1.0pt,\hskip-0.5pt\operatorname{do}(T)}}(y\mid\bm{z},t)~p_{\bm{Z}}(\bm{z}). (1) The difference between the means of Y under this margin between different values of T is called the average treatment effect (ATE), \tau where, \tau=\mathbb{E}[Y\mid\operatorname{do}(T=1)]-\mathbb{E}[Y\mid\operatorname{do}(T=0)] . Models which target this marginal quantity are known as marginal structural models ( Robins, 1998 , MSMs,) and are frequently used in epidemiological and medical domains to account for time-varying confounding. In particular, they are effective at quantifying the effect of an intervention over a population, where the specific relationships between the outcome and (possibly high dimensional) pretreatment covariates are not relevant, and are modelled as nuisance parameters. The semiparametric question of estimating finite dimensional quantities in the presence of high dimensional nuisance parameters has a long history ( Robins et al., 1995 ; Robins and Rotnitzky, 1995 ) , but has undergone a renaissance since the development of methods such as targeted maximum likelihood estimation ( van der Laan and Rose, 2011 ) and double machine learning ( Chernozhukov et al., 2018 ) , which allow for general machine learning algorithms to flexibly describe the nuisance models and still have valid inference on a low-dimensional treatment effect. 2.2 Frugal Parameterisations Frugally parameterised distributions consist of three distinct components: the distribution of the ‘past,’ \theta_{{\hskip-0.5ptZ\hskip-0.5ptT}} ; the intervened causal quantity of interest, \theta_{{Y\hskip-0.5pt|\hskip-0.5pt\operatorname{do}(T)}} ; and an intervened dependency measure between Y and \bm{Z} conditional on T , \phi_{{\bm{Z}\hskip-0.5ptY\hskip-0.5pt|\hskip-0.5pt\operatorname{do}(T)}} . The key idea is to explicitly parameterise the marginal causal effect, and build the rest of the model around it. In this paper we encode all the dependence among covariates in the copula, so ‘the past’ is really just the propensity for treatment (also called the propensity score) and the product of the univariate margins ( Evans and Didelez, 2024 ) . Figure 1 provides an illustrative summary of our framework, and outline which models are used to parameterise each component of a frugal model. \bm{Z} \theta_{Z}:\left\{F_{Z_{d}}=\mathcal{F}^{-1}_{Z_{d}}\right\}_{d=1}^{D} Y T \theta_{{\hskip-0.75ptT\hskip-0.5pt|\hskip-0.5pt\bm{Z}}}:F_{{\hskip-0.75ptT\hskip-0.5pt|\hskip-0.5pt\bm{Z}}}=\mathcal{C}_{{\hskip-0.75ptT\hskip-0.5pt|\hskip-0.5pt\bm{Z}}}^{-1}\left(\mathcal{F}^{-1}_{T}\mid\mathcal{F}^{-1}_{Z_{1}},\dots,\mathcal{F}^{-1}_{Z_{D}}\right) \theta_{{Y\hskip-0.5pt|\hskip-0.5pt\operatorname{do}(T)}}:F_{{Y\hskip-0.5pt|\hskip-0.5pt\operatorname{do}(T)}}=\mathcal{F}^{-1}_{{Y\hskip-0.5pt|\hskip-0.5pt\operatorname{do}(T)}} \begin{array}[]{c}\phi_{{\bm{Z}\hskip-0.5ptY\hskip-0.5pt|\hskip-0.5pt\operatorname{do}(T)}}:~C_{{\bm{Z}\hskip-0.5ptY\hskip-0.5pt|\hskip-0.5pt\operatorname{do}(T)}}=\\ \mathcal{C}^{-1}\left(\mathcal{F}^{-1}_{{Y\hskip-0.5pt|\hskip-0.5pt\operatorname{do}(T)}},\mathcal{F}^{-1}_{Z_{1}},\dots,\mathcal{F}^{-1}_{Z_{D}}\right)\end{array} Figure 1 : A visual abstract outlining the different components of a frugal model, and how each specific component is parameterised. Univariate CDFs are denoted by F , and copula distribution functions are denoted by C . The marginal causal effect, \theta_{{Y\hskip-0.5pt|\hskip-0.5pt\operatorname{do}(T)}} , is modelled with a