Predictive posteriors under hidden confounding

Carlos García Meixide, David Ríos Insua, [0.5ex] Instituto de Ciencias Matemáticas, CSIC, [-0.5ex] Departamento de Matemáticas, Universidad Autónoma de Madrid · 2025

Read Predictive posteriors under hidden confounding by Carlos García Meixide, David Ríos Insua, [0.5ex] Instituto de Ciencias Matemáticas, CSIC, [-0.5ex] Departamento de Matemáticas, Universidad Autónoma de Madrid (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-05170.txt.

Introduction

Carlos García Meixide and David Ríos Insua predict honestly under hidden confounding in a 2025 statistics paper. When a model moves to a new hospital or region, unseen factors that sway both inputs and outcomes can quietly wreck its forecasts. Most fixes demand assumptions about exactly how the world shifted.

Their Bayesian framework instead produces full predictive distributions that stay calibrated in the new domain, without naming the confounders. The theory promises faster learning as more datasets accumulate. Simulations plus a medical application showed the uncertainty bands covering reality at close to the advertised rate. Honest error bars, the paper argues, travel better than point guesses.

Catalog record

CREATORCarlos García Meixide, David Ríos Insua, [0.5ex] Instituto de Ciencias Matemáticas, CSIC, [-0.5ex] Departamento de Matemáticas, Universidad Autónoma de Madrid
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-05170

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Predictive posteriors under hidden confounding Carlos García Meixide, David Ríos Insua, [0.5ex] Instituto de Ciencias Matemáticas, CSIC, [-0.5ex] Departamento de Matemáticas, Universidad Autónoma de Madrid Abstract Predicting outcomes in external domains is challenging due to hidden confounders that influence both predictors and outcomes, complicating generalization under distribution shifts. Traditional methods often rely on stringent assumptions or overly conservative regularization, compromising estimation and predictive accuracy. Generative Invariance (GI) is a novel framework that facilitates predictions in unseen domains without requiring hyperparameter tuning or knowledge of specific distribution shifts. However, the available frequentist version of GI does not always enable identification and lacks uncertainty quantification for its predictions. This paper develops a Bayesian formulation that extends GI with well-calibrated external predictions and facilitates causal discovery. We present theoretical guarantees showing that prior distributions assign asymptotic meaning to the number of distinct datasets that could be observed. Simulations and an application case highlight the remarkable empirical coverage behavior of our approach, nearly unchanged when transitioning from low- to moderate-dimensional settings. 1 Introduction In recent years, there has been a surge of interest in machine learning methods that demonstrate robust performance even when there are shifts in the distribution between training and test data [ Wong et al. 2021 , Miller et al. 2020 ] . Much of the existing research in this area focuses on point predictions, often necessary for communication and traditional practices, requiring the definition of an appropriate loss function for evaluation, typically squared error loss. In contrast, probabilistic predictions offer a detailed quantification of uncertainty for future outcomes and are typically more relevant for risk management and decision support purposes, though they are more complex to construct and communicate. This paper focuses on creating probabilistic predictions for a response variable Y\in\mathbb{R} based on a set of covariates X\in\mathbb{R}^{p} , therefore yielding prediction intervals. When a machine learning strategy is trained on a labeled source dataset, it can be expected to perform well on an unlabeled target dataset drawn from the same distribution, provided that generalization guarantees hold [ Boucheron et al. 2013 ] . However, numerous applications often experience distribution shifts, challenging the standard independent and identically distributed (i.i.d.) assumption and complicating the use of existing prediction methods. The majority of research addressing distribution shifts has concentrated on point prediction in regression or classification. One notable strategy is distributionally robust optimization , introduced by Sinha et al. 2020 , which involves minimax optimization over distributions within a certain distance or divergence from the observed data distribution. Another important approach, initiated by Rothenhäusler et al. 2021 , employs a causality-inspired framework to leverage the underlying data structure, thereby improving prediction stability amidst distributional shifts. However, the regularization scheme proposed by the authors prevents the causal parameters from being the actual probability limit of the estimators they introduce; i.e., they are not asymptotically unbiased. Another framework for quantifying uncertainty of any predictive algorithm is conformal prediction . Recent developments in this literature have shown a growing interest in robustness, particularly in constructing robust prediction intervals for a fixed marginal coverage level rather than estimating full distributions [ Tibshirani et al. 2019 ] . In addition, causality has recently been related to a certain risk minimization problem with a corresponding notion of robustness [ Bühlmann 2020 ] . To our knowledge, only two studies address robust probabilistic prediction in the causality literature: Kook et al. 2022 proposed distributional anchor regression for conditional transformation models as an extension of the above mentioned; and Henzi et al. 2024 analysed invariance for probabilistic predictions penalizing empirical risk minimization with the variance of the scoring rule computed across environments. Ai and Ren 2024 argue that distribution shifts comprise both “covariate” and “ Y|X ” types of shifts. Covariate shifts refer to differences in the marginal distribution of X between training and target environments, due e.g. to age or gender distributional structure variations. Y|X shifts involve changes in the conditional relationship between the outcome and covariates, potentially due to unobserved confounders or noncompliance [ Robins 1989 ] . Ai and Ren 2024 suggest reweighting training samples based on estimated covariate shift and adjusting confidence levels to accommodate the worst-case Y|X shift. Importantly, both types of shifts are fundamentally different: while covariate shifts can be identifiable from data, the type Y|X itself is not inherently identifiable. Work introduced in Meixide and Insua 2025 formulates linear algebra hypotheses that enable identification of causal parameters through the so-called Generative Invariance (GI), a projection estimand that adapts predictions to unseen domains without requiring knowledge of the specific test distribution shifts or hyperparameter tuning. GI achieves identifiability under mild, verifiable conditions and accommodates the influence of unobserved confounders across heterogeneous training environments through a parametric component. By redefining the role of invariance and avoiding the over-conservatism of classical instrumental variable (IV) methods [ Angrist et al. 1996 ] , GI ensures optimal predictions while preserving unbiased estimation of causal parameters, marking a fundamental shift from the traditional view of predictive robustness as a minimax optimization problem, as GI does not require introducing bias into estimators of causal parameters. This is made possible by a novel mechanism that overpasses regularization techniques typically used in robustness frameworks [ Rothenhäusler et al. 2021 , Shen et al. 2025 ] . In this regard, GI is the first method exploiting distributional information from unlabeled data in the target domain to provide asymptotically unbiased domain adaptation. This paper builds upon GI to enable further exploration and applicability of its core concepts bringing in Bayesian methods. Frequentist GI facilitates the derivation of an asymptotic normality result for causal parameters but does not say anything about uncertainty at the predictive scale on Y . Here we shall provide principled uncertainty quantification for GI, which will be crucial in at least two important respects. First, we open the door towards credible intervals for causal relationships under hidden confounding and, therefore, enable simultaneous causal discovery and calibrated predictions in this setting: to the best of our knowledge, we deliver the first computationally feasible hypothesis test of a covariate being in the parental set of a target response in a linear structural equation model. Note that obtaining credible statements for existing causal discovery methods is often difficult as one would need to determine the distribution of causal effects estimators after having searched and estimated a graphical structure of the model. Peters et al. 2016 were able to control against false positive causal selection gathering all submodels that are statistically invariant across environments in a suitable sense. Pursuing this thread further, Fan et al. 2024 obtain a finite sample variable selection property and its asymptotic relaxation in high dimensions. Two important limitations of this methodological family is having to assume no hidden confounding and the lack of computational scalability due to an exponentially increasing number of hypothesis tests to be performed, apart from being statistical power not well understood in their context. Second, while classical definitions frame identifiability as a binary property (a parameter is either identified or not), we are the first to explicitly articulate the empirical manifestation of weak identifiability as a gradual phenomenon, intimately connected to ill-posedness of inverse problems, as extensively studied recently by Ghassami et al. 2025 and Bennett

Read the complete text