On robust Bayesian causal inference

Angelos Alexopoulos, Nikolaos Demiris · 2025

Read On robust Bayesian causal inference by Angelos Alexopoulos, Nikolaos Demiris (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-13895.txt.

Introduction

Angelos Alexopoulos and Nikolaos Demiris develop a sturdier Bayesian method for estimating cause and effect from data gathered over time. Many current methods lean on structural guesses, such as factor models, to handle hidden confounding, and wrong guesses bias the answer. The authors instead target effects specific to each time point and unit directly.

Their framework uses generalised Bayesian inference, which can register and correct for model misfit while keeping results interpretable. A scoring rule that rewards both point and interval accuracy picks the learning rate that controls the correction. Simulations and real-data tests show better calibration, sharper intervals, and more robust effect estimates than standard practice.

Catalog record

CREATORAngelos Alexopoulos, Nikolaos Demiris
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-13895

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

On robust Bayesian causal inference Angelos Alexopoulos, Nikolaos Demiris Abstract This paper develops a Bayesian framework for robust causal inference from longitudinal observational data. Many contemporary methods rely on structural assumptions, such as factor models, to adjust for unobserved confounding, but they can lead to biased causal estimands when mis-specified. We focus on directly estimating time–unit–specific causal effects and use generalised Bayesian inference to quantify model mis-specification and adjust for it, while retaining interpretable posterior inference. We select the learning rate ω \omega based on a proper scoring rule that jointly evaluates point and interval accuracy of the causal estimand, thus providing a coherent, decision-theoretic foundation for tuning ω \omega . Simulation studies and applications to real data demonstrate improved calibration, sharpness, and robustness in estimating causal effects. Keywords: Causal Inference, Model mis-specification, Bayesian, Robust 1 Introduction Problem setting This paper is concerned with causal inference that is robust to model mis-specification. We posit a Bayesian approach to the generic statistical problem of potentially correcting for using the wrong model and then use this method for causal inference. Our main focus lies upon robust causal inference from time-series observational data on multiple units. Such data are common in many scientific disciplines where randomized experiments are often infeasible. We suggest to (i) start with a model that is considered the most appropriate for tackling this problem, (ii) allow for this model to be wrong, (iii) aim to understand the level of mis-specification by focusing on the appropriate estimand and (iv) derive suitably corrected causal effects. Although model mis-specification is common in causal inference, inference in such settings represents a general statistical problem, appearing for example when approximations are derived due to computational reasons, like in Variational Bayes or Composite Likelihood methods. Recent methods in causal inference adjust for unobserved heterogeneity and confounding via data-generating processes such as factor models, see for example 4 and 49 . A proposal for positing models of this kind (up to transformations) as a general data-generating process may be found in 47 . While such models appear like a reasonable baseline they remain subject to mis-specification due to issues like missing confounders, incorrect number of latent factors or unnecessary linearity assumptions. Such mis-specification can lead to biased or misleading causal estimates. Methodological approach In this paper we set the estimand of interest to be the causal effect(s) and aim to understand the degree of model mis-specification with respect to the accuracy of estimating this causal effect. We focus on factor analysis-type models which are commonly used to evaluate real-world interventions while still adjusting for known confounders. We adopt the generalized Bayesian inference paradigm and replace the likelihood with a loss function while retaining Bayesian updating and access to the posterior of the (generally asymmetric, e.g. 12 ) decision space. Estimation accuracy is assessed in terms of calibration and sharpness. Note that focused inference is not new in statistics, e.g. 11 , but is integral in generalised/robust Bayesian analysis, see for example 7 and 14 . We select the learning rate \omega via a proper scoring rule that quantifies the joint accuracy of the posterior mean and credible interval of the causal estimand. The propriety of the scoring rule implies it favours posteriors whose summaries are correctly calibrated under the true data-generating process, providing a transparent and theoretically suitable criterion for tuning \omega . This approach aligns the choice of \omega directly with inferential accuracy rather than predictive or marginal likelihood objectives. The proposed method has several advantages. It enables model-robust causal learning by adaptively adjusting influence of the two model components, the prior and the likelihood. It introduces (semi-)automatic bias and variance corrections based on the degree of model mis-specification. In particular, the posterior behavior adapts by either (i) shifting toward the prior when uncertainty is high or (ii) concentrating more closely to the data when appropriate. Although motivated by factor models, the method is broadly applicable to a range of causal models and other imperfect likelihood settings. Experiments The method is studied in two simulation settings. First, in linear-type models where we find that our method naturally reduces to standard Bayesian inference when the model is well-specified and adapts appropriately as necessitated by the distinct types of model mis-specification. The second class of simulation experiments focus on Factor models where we also observe that selecting the optimal learning rate enables suitable location and scale corrections of the causal treatment effects. In summary, we demonstrate that the proposed method provides robustness and improvement over current alternatives. We evaluate the proposed robust Bayesian causal inference (RBCI) framework using three real-world panel datasets. First, we revisit the California tobacco control program, a benchmark example in synthetic control evaluation ( 2 ) . Second, we analyze the effect of a spatially targeted industrial policy on French regional employment ( 17 ) . Third, we study a digital tax enforcement intervention in the Greek energy market introduced by the Independent Authority for Public Revenue (IAPR). Across all applications, we compare against state-of-the-art matrix completion methods and find that accounting for model mis-specification leads to more accurate causal estimates and substantially improved uncertainty quantification. 1.1 Connections to the relevant literature A vast literature exists on accounting for model mis-specification in general inference settings. Early work includes 22 and also 46 who showed that the asymptotic density of the maximum likelihood estimator in mis-specified models is Gaussian with sandwich covariance matrix and centered on the Kullback–Leibler divergence minimising a pseudo-true parameter value. 32 studied the asymptotic behavior of the posterior in mis-specified parametric models and showed that generally it can have lower asymptotic frequentist risk. A common way to account for model mis-specification in the causal inference literature is via the propensity score, see 36 . This approach essentially generates a second option for obtaining consistency (in addition to using the correct outcome regression model), in the case where one specifies a correct propensity score model, thus leading to the ‘doubly robust’ terminology. A generic framework for causal inference via Inverse Probability weights has been developed by Robins and colleagues and is typically termed G-estimation; a detailed account may be found in 18 . The propensity score approach has been criticised from the Bayesian viewpoint as an unnatural way to characterise a data generating mechanism ( 28 ) . An excellent review of Bayesian approaches to causal inference may be found in 42 who explain the difficulty of casting the propensity score within Bayesian inference. The paper covers some (seemingly unnatural for Bayesians) ways developed in the literature for circumventing such issues, including cutting feedback and two-stage inference. The authors then develop a decision-theoretic approach to incorporate the propensity score within a Bayesian non-parametric (Dirichlet process-based) framework and use the Bayesian bootstrap. 3 developed a Bayesian approach to doubly robust estimation with favourable frequentist properties by estimating a propensity score and an outcome model. 33 proposed to model the propensity score non-parametrically and showed that standard Gaussian process priors satisfy a semi-parametric Bernstein–von Mises theorem. Applications of Bayesian causal inference may be found in numerous diverse fields, including on algorithmic decisions (e.g. 25 and 23 ). A parallel strand of fruitful, mostly non-Bayesian, recent developments may be found in the intersection of

Read the complete text