revealing the truth: calculating true values in causal inference simulation studies via gaussian quadrature

Alex Ocampo, Enrico Giudice, Zachary McCaw, Tim P. Morris · 2026

Read revealing the truth: calculating true values in causal inference simulation studies via gaussian quadrature by Alex Ocampo, Enrico Giudice, Zachary McCaw, Tim P. Morris (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-05128.txt.

Introduction

Simulation studies judge statistical methods against a known truth, but in causal inference that truth is rarely a simple model parameter. Alex Ocampo and 3 co-authors show how to compute it exactly in a 2026 paper. The target is usually an average treatment effect averaged over the distribution of confounders, variables that influence both treatment and outcome. Without the true value, researchers cannot measure how well a method recovers it across repeated simulated datasets.

The authors use Gaussian quadrature, a precise numerical integration method, to calculate those true values. Exact benchmarks make simulation studies honest: bias and error can be scored rather than guessed. That rigour matters because causal methods guide real decisions in medicine and policy, and their reputations rest on simulation evidence.

Catalog record

CREATORAlex Ocampo, Enrico Giudice, Zachary McCaw, Tim P. Morris
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-05128

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

revealing the truth: calculating true values in causal inference simulation studies via gaussian quadrature Alex Ocampo, Enrico Giudice, Zachary McCaw, Tim P. Morris Abstract Simulation studies are used to understand the properties of statistical methods. A key luxury in many simulation studies is knowledge of the true value ( i.e. the estimand) being targeted. With this oracle knowledge in-hand, the researcher conducting the simulation study can assess across repeated realizations of the data how well a given method recovers the truth. In causal inference simulation studies, the truth is rarely a simple parameter of the statistical model chosen to generate the data. Instead, the estimand is often an average treatment effect, marginalized over the distribution of confounders and/or mediators. Luckily, these variables are often generated from common distributions such as the normal, uniform, exponential, or gamma. For all these distributions, Gaussian quadratures provide efficient and accurate calculation for integrands with integral kernels that stem from known probability density functions. We demonstrate through four applications how to use Gaussian quadrature to accurately and efficiently compute the true causal estimand. We also compare the pros and cons of Gauss–Hermite quadrature to Monte Carlo integration approaches, which we use as benchmarks. Overall, we demonstrate that the Gaussian quadrature is an accurate tool with negligible computation time, yet is underused for calculating the true causal estimands in simulation studies. 1 Introduction Many simulation studies involve generating data from a known distribution and then considering methods’ abilities to recover parameters. The researcher’s oracle-like knowledge of the true value of target parameters is one reason why simulation studies offer greater insights into methods’ operating characteristics than analyzing a real dataset/s. This paper comes from our experience generating data for causal inference simulation studies. Any such analysis must address the question, “what is the truth”; that is, what is the true value of the causal estimand that our methodology is targeting? A fair evaluation of a method in a simulation study requires this knowledge for evaluating certain fundamental performance measures such as bias, mean squared error, and coverage. If the truth is unknown or approximated poorly, then methods that are unbiased may appear to be biased, and so on. Simulation studies frequently focus on what might be termed data-generating model parameter recovery , where the target of inference is a specified parameter of the data-generating model, so its true value is not in doubt. Obtaining true values is often less straightforward in simulation studies where the target of inference is a causal estimand. For instance, if one simulates from a generalized linear regression model with \beta=5 , and \beta is the estimand of interest, we know that we should assess bias, \mathbb{E}(\widehat{\beta})-\beta , using a true value of 5 for \beta . In causal inference, interest revolves around functionals of potential outcome distributions, which may not be derivable from parameters of a data-generating model. For instance, proper confounding control is often important, and therefore we must marginalize (or integrate) functionals over the distributions of all confounders in order to compute the true causal effect of interest. For example, suppose we are interested in the average causal effect \displaystyle\mathbb{E}[Y^{(a=1)}]-\mathbb{E}[Y^{(a=0)}], but need to marginalize over the distribution of a confounder – variable C\in\mathbb{R} – in order to calculate these expectations for a given data-generating mechanism for Y^{(a)} . That is, for both terms above, we need to perform the following 1 1 1 Note that the conditioning on A=a in ( 1 ) is redundant here; it is also harmless, so we retain it for familiarity. : \displaystyle\mathbb{E}[Y^{(a)}] \displaystyle=\mathbb{E}[\mathbb{E}[Y^{(a)}|C]] \displaystyle=\mathbb{E}[\mathbb{E}[Y^{(a)}|A=a,C]] (1) \displaystyle=\int_{-\infty}^{\infty}\mathbb{E}[Y^{(a)}|A=a,C]f(c)dc,\quad\forall a\in\{0,1\}. (2) The term \mathbb{E}[Y^{(a)}|A=a,C] is is typically specified as one of the structural equations of the simulation model. These structural equations are frequently specified as a parametric regression model. This allows the (potential) outcome Y^{(a)} to be simulated conditional on the treatment set to a and the observed value of the confounder C (e.g. \mathbb{E}[Y^{(a)}|A=a,C]=g^{-1}(\beta_{0}+\beta_{a}a+\beta_{C}C ). However, integrating \mathbb{E}[Y^{(a)}|A=a,C] over the distribution of C will not have a simple closed-form expression in general, even for familiar confounder distributions of C when the link function g(\cdot) is nonlinear, for example when g(\cdot)=\text{logit}(\cdot) . One solution to this problem is to simulate a very large sample from the data-generating mechanism, including the outcomes, and analyze it using a method known to be unbiased, returning an estimate to be used as the true value. Nine of the 74 simulation studies reviewed in 14 where the target was an estimand used this simulation-based approach. Its advantages are 1) it is straightforward for statisticians to implement given the data-generating mechanism and 2) because accuracy of the truth is essentially guaranteed by the law of large numbers. However, there are two disadvantages: first, the ‘true’ value is subject to Monte Carlo error due to finite simulated dataset size; second, generation and analysis of an appropriately large dataset carries a computational cost. Although not a “disadvantage”, a condition of using this approach is that, an estimator must be available that is known to be unbiased for the given data-generating mechanism. More recently, 15 proposed Monte Carlo integration as a more accurate yet still practical solution to this problem. This involves again generating a large sample from the data-generating mechanism for some of the variables. However, rather than simulate observed outcomes, we generate the functional of the potential outcomes that defines the estimand. For example, rather than draw a binary outcome to realize values of 0 or 1, we compute its expected value from the data-generating model. We do this under each value of treatment (or more generally cause) of interest. Finally, simple averages are taken that can be transformed if necessary and contrasted across levels of the treatment/cause. The two disadvantages mentioned for outcome simulation remain but the Monte Carlo error associated with the true value is lower (for a given dataset size); put another way, the same Monte Carlo SE can be achieved with a smaller dataset size, making it a more computationally efficient approach. Further, because the approach contrasts potential outcomes, we do not require access to an appropriate unbiased estimator to use it. One opportunity to avoid generating very large datasets and accepting Monte Carlo error in the true value is to note that, oftentimes, the variables we need to marginalize over in causal inference simulation studies are generated from a common distribution. For example, considering the integral defined in ( 2 ), if C\sim\mathscr{N}(\mu_{c},\sigma^{2}_{c}) this would mean evaluating \displaystyle\int_{-\infty}^{\infty}\mathbb{E}[Y|A=a,C]\phi_{C}(c)dc, (3) where \displaystyle\phi_{C}(c)=\frac{1}{\sqrt{2\pi\sigma_{c}^{2}}}e^{-\frac{1}{2\sigma_{c}^{2}}(c-\mu_{c})^{2}} is the probability density function (pdf) of the normal distribution of C . Integrals of this form can be computed instantaneously and accurately via Gauss–Hermite quadrature ( 8 ; 11 ; 9 ) . This paper applies and evaluates the use of Gaussian quadrature for computing true values of interest in simulation studies for causal inference. We begin with an overview of Gaussian quadratures, with particular emphasis on Gauss–Hermite quadrature, since variables in simulation studies are often generated from normal distributions. We then revisit the two examples in 15 and add two further examples from our own simulation studies on mediation analyses. We conclude with a discussion to provide recommendations of when a Monte Carlo integration or Gaussian Quadrature approach may be considered. R code is provided

Read the complete text