Pulling back the curtain: the road from statistical estimand to machine-learning based estimator for epidemiologists (no wizard required)

Audrey Renson, Lina Montoya, Dana E. Goin, Iván Díaz, Rachael K. Ross · 2025

Read Pulling back the curtain: the road from statistical estimand to machine-learning based estimator for epidemiologists (no wizard required) by Audrey Renson, Lina Montoya, Dana E. Goin, Iván Díaz, Rachael K. Ross (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-05363.txt.

Introduction

Audrey Renson, Lina Montoya, Dana Goin, Iván Díaz, and Rachael Ross write a guide for health researchers in a 2025 paper. More studies now use machine learning to estimate cause and effect from messy data. The math behind those tools can look like a black box. The authors walk readers from a plain research question to a working estimator, step by step.

The route centers on a key formula that shapes an unbiased estimator. The paper defines the formula in plain terms and shows how it lets machine learning help without wrecking the proof. A property called double robustness means the answer stays valid if one of two models is right. The algebra stays light on purpose, so working researchers can follow it.

Catalog record

CREATORAudrey Renson, Lina Montoya, Dana E. Goin, Iván Díaz, Rachael K. Ross
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-05363

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Pulling back the curtain: the road from statistical estimand to machine-learning based estimator for epidemiologists (no wizard required) Audrey Renson, Lina Montoya, Dana E. Goin, Iván Díaz, Rachael K. Ross Abstract Epidemiologists increasingly use causal inference methods that rely on machine learning, as these approaches can relax unnecessary model specification assumptions. While deriving and studying asymptotic properties of such estimators is a task usually associated with statisticians, it is useful for epidemiologists to understand the steps involved, as epidemiologists are often at the forefront of defining important new research questions and translating them into new parameters to be estimated. In this paper, our goal was to provide a relatively accessible guide through the process of (i) deriving an estimator based on the so-called efficient influence function (which we define and explain), and (ii) showing such an estimator’s ability to validly incorporate machine learning, by demonstrating the so-called rate double robustness property. The derivations in this paper rely mainly on algebra and some foundational results from statistical inference, which are explained. Keywords: causal inference, machine learning, semiparametric theory, efficient influence functions Word count: \approx 4,086 / 4,000 Conflicts of interest: None to disclose. Sources of funding: AR is supported by a gift from the Bezos foundation. DEG is supported by award number R00ES033274 from the National Institute of Environmental Health Sciences. LMM is supported by the National Institutes of Health under award number R00MH133985. Publication history: Publication history: This manuscript was previously published in arXiv: doi: 1 Introduction Methods in causal inference that rely on machine learning to estimate nuisance functions (e.g., outcome regressions, propensity scores) are increasingly popular because they can avoid modeling assumptions not supported by scientific knowledge. Such methods are usually well-described (and implemented in software) when the causal parameter and set of assumptions used to identify it are of a familiar variety, such as the average treatment effect (ATE) under conditional exchangeability, positivity, and consistency [ 20 ] . However, if we want to estimate an uncommon causal parameter in order to answer our research question, or if causal identification is based on a less common set of assumptions, estimators may not yet be available. Examples of such uncommon parameters from our own research include the time-varying g-formula under parallel trends [ 10 ] , transported effects from difference-in-differences [ 15 ] , and transported measurement error corrections [ 18 ] . The key challenge in deriving estimators that allow machine learning is in obtaining valid inference (e.g.,confidence intervals). For example, it is understood that doubly robust estimators of the ATE can allow calculation of confidence intervals with nominal coverage (in large samples) even when machine learning is used, while the g-computation estimator cannot outside of special cases [ 13 , 1 ] . Estimators that allow valid inference under machine-learning-based estimation of nuisance functions are usually based on the efficient influence function (EIF), which we define and discuss below. The process for deriving EIF-based estimators and determining their properties has historically been limited to a specialized and highly technical branch of statistical literature. While deriving and studying such estimators in a mathematically rigorous way does require specialized training, in our experience substantial progress can be achieved with less mathematical skill than that required to read and understand most of the literature on this topic. Epidemiologists are often at the forefront of defining new research questions, translating them into causal parameters, and developing reasonable assumptions to identify these parameters; thus, epidemiologists can benefit from understanding the steps to derive machine-learning based estimators. While many reviews exist on the theory and application of this approach [ 20 , 9 , 5 , 11 ] , there remains a gap in translation to a more applied audience. In this paper, we aim to provide a more accessible guide through the steps needed to propose an EIF-based estimator for a unique statistical estimand that corresponds to a relevant causal question, and verify that our resulting estimator can indeed accommodate machine learning. 2 Step 1: Define the statistical estimand Throughout this paper we work with an example estimand motivated by the hypothetical research question, “What would be the average outcome in our sample if everyone were untreated?” We begin by translating the scientific question to a causal parameter. Let Y denote the observed outcome, A a binary treatment, and W some set of observed covariates, so that the observed data can be denoted O_{i}=(W_{i},A_{i},Y_{i}) for i=1,...,n , where n denotes the sample size. We assume the data are independent and identically distributed (iid), though the approaches we present can be extended to non-iid data. We use uppercase to refer to observed values of random variables, and lower case for specific values. Let Y^{a} denote the potential outcome when A is set to a . Using this notation, we can translate the research question to a causal parameter \mathbb{E}(Y^{0}) , the expected outcome under no treatment. Note that this causal parameter is one piece of the the average treatment effect, \mathbb{E}(Y^{1})-\mathbb{E}(Y^{0}) . Then, we use causal assumptions to equate the causal parameter to a statistical estimand based only on the observed data distribution (i.e., to achieve identification). For our example, the causal parameter is identified under three assumptions: 1) conditional exchangeability, Y^{0}\mathchoice{\mathrel{\hbox to0.0pt{$\displaystyle\perp$\hss}\mkern 2.0mu{\displaystyle\perp}}}{\mathrel{\hbox to0.0pt{$\textstyle\perp$\hss}\mkern 2.0mu{\textstyle\perp}}}{\mathrel{\hbox to0.0pt{$\scriptstyle\perp$\hss}\mkern 2.0mu{\scriptstyle\perp}}}{\mathrel{\hbox to0.0pt{$\scriptscriptstyle\perp$\hss}\mkern 2.0mu{\scriptscriptstyle\perp}}}A|W ; 2) positivity, f(w)>0\implies\Pr(A=0|W=w)>0 (where f denotes a probability density or mass function); and 3) causal consistency, A=a\implies Y=Y^{a} . Conditional exchangeability can be assessed with the help of a causal diagram based on subject matter knowledge [ 7 , 16 ] . Under these assumptions, it follows that \mathbb{E}(Y^{0})=\mathbb{E}(\mathbb{E}(Y|W,A=0)) ; the latter is our statistical estimand which we will denote \psi=\mathbb{E}(\mathbb{E}(Y|W,A=0)) . It is often useful to think of the statistical estimand as a mapping ; i.e., a function \psi(P) whose input is a distribution P and whose output is a scalar. That is, if the observed data O is drawn from some distribution P , we can write \psi(P)\equiv\psi\equiv\mathbb{E}_{P}(\mathbb{E}_{P}(Y|W,A=0)) , where the subscripts indicate that the expectation is taken with respect to P . As in much of the literature on machine-learning-based estimators in causal inference, we focus on the statistical estimand \psi=\mathbb{E}(\mathbb{E}(Y|W,A=0)) because it offers a simple introduction to the material presented and is commonly used in applied research. However, the need to derive estimators usually arises because our scientific question or identification result lead to a less-commonly considered estimand. To aid in adapting this approach to more complex problems, we illustrate in Appendix E the derivations for another causal parameter, the expected outcome under no treatment among the treated , one piece of the average treatment effect in the treated. 3 Step 2: Derive the EIF 3.1 What is the EIF and why do we care? We define the EIF formally in Appendix A ; here, we give a heuristic description for intuition. The EIF is a type of derivative: if the statistical estimand is a function of a distribution, then the EIF is a derivative of that function with respect to the distribution, and thus captures how sensitive the estimand is to small changes in the data distribution. The EIF can also be understood as describing the influence that removing unit i ’s data would have on

Read the complete text