Disentangling Doubt in Deep Causal AI

Cooper Doyle · 2025

Read Disentangling Doubt in Deep Causal AI by Cooper Doyle (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-03622.txt.

Introduction

Cooper Doyle splits doubt in deep cause models into its two sources in a 2025 paper. Such models guess how a cure would shift one person's outcome. A point guess is not enough for care; teams need to know where the model is unsure, and why, to fix it.

His method toggles a dropout trick in two parts of a twin model, the shared core and the twin outcome heads. That splits total spread into a core share and a head share. In fake shift tests, the core share ruled when input data drifted. On a real twins set with forced shift, the core share alone spiked on odd cases and foretold errors best.

Catalog record

CREATORCooper Doyle
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-03622

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Disentangling Doubt in Deep Causal AI Cooper Doyle Abstract Accurate individual treatment-effect estimation in high-stakes applications demands both reliable point predictions and interpretable uncertainty quantification. We propose a factorized Monte Carlo Dropout framework for deep twin-network models that splits total predictive variance into representation uncertainty ( σ rep 2 \sigma_{\mathrm{rep}}^{2} ) in the shared encoder and prediction uncertainty ( σ pred 2 \sigma_{\mathrm{pred}}^{2} ) in the outcome heads. Across three synthetic covariate-shift regimes, our intervals are well-calibrated (ECE<0.03) and satisfy σ rep 2 + σ pred 2 ≈ σ tot 2 \sigma_{\mathrm{rep}}^{2}+\sigma_{\mathrm{pred}}^{2}\approx\sigma_{\mathrm{tot}}^{2} . Additionally, we observe a crossover—head uncertainty leads on in-distribution data but representation uncertainty dominates under shift. Finally, on a real-world twins cohort with induced multivariate shifts, only σ rep 2 \sigma_{\mathrm{rep}}^{2} spikes on out-of-distribution samples ( Δ ​ σ 2 ≈ 0.0002 \Delta\sigma^{2}\approx 0.0002 ) and becomes the primary error predictor ( ρ rep 2 ≤ 0.89 \rho_{\mathrm{rep}}^{2}\!\leq\!0.89 ), while σ pred 2 \sigma_{\mathrm{pred}}^{2} remains flat. This module-level decomposition offers a practical diagnostic for detecting and interpreting uncertainty sources in deep causal-effect models. 1 Introduction Effective causal decision-making in domains such as finance, healthcare, and public policy requires not only accurate estimates of individual treatment effects (ITE) but also uncertainty measures that distinguish between epistemic uncertainty—due to lack of data or coverage in parts of the covariate space—and aleatoric uncertainty—due to irreducible outcome noise. In practice, selection and sampling biases frequently induce covariate-shifted subpopulations (e.g. under-represented demographic groups or clinical cohorts), making it crucial to diagnose when an ITE model is extrapolating beyond its training distribution. Existing deep-learning approaches (e.g., TARNet [ 1 ] , DragonNet [ 2 ] ) and Bayesian trees (e.g. BART [ 3 ] , Causal Forests [ 4 ] ) provide interval estimates but conflate all uncertainty into a single score, obscuring whether errors stem from encoder-level coverage gaps or head-level noise. We address this gap by introducing a principled, module-level variance decomposition in deep twin-network architectures. Applying Monte Carlo Dropout with distinct dropout masks in the shared encoder and in each treatment-specific head yields two uncertainty components: • Representation uncertainty ( \sigma_{\rm rep}^{2} ), capturing epistemic doubt in the encoder’s latent covariates; • Prediction uncertainty ( \sigma_{\rm pred}^{2} ), capturing aleatoric noise in the outcome heads. By the law of total variance, we obtain \sigma_{\rm tot}^{2}\;\approx\;\sigma_{\rm rep}^{2}\;+\;\sigma_{\rm pred}^{2}. We first confirm well-calibrated intervals (ECE<0.03) and variance additivity on a baseline synthetic task. Next, across three controlled covariate-shift regimes we reveal a “crossover”: on in-distribution data, total uncertainty leads error prediction ( \rho_{\rm tot}=0.42 ), while under strong shift representation uncertainty dominates ( \rho_{\rm rep}=0.53 ). Finally, on a real-world twins cohort with induced multivariate sampling bias, we show that only \sigma_{\rm rep} reliably spikes on out-of-distribution samples ( \Delta\sigma_{rep}^{2}\approx 0.0002 ) and becomes the primary error signal ( \rho_{rep}\approx 0.89 ), whereas \sigma_{\rm pred} remains flat. This factorized framework thus provides practitioners with a clear diagnostic for detecting and interpreting layer-wise uncertainty under distributional drift. 2 Related Work 2.1 Uncertainty in Deep Learning Estimating predictive uncertainty in deep neural networks has been a major focus across vision, language, and beyond. Gal and Ghahramani [ 5 ] showed that Monte Carlo Dropout can be interpreted as approximate Bayesian inference, providing a scalable means to capture epistemic uncertainty. Deep ensembles [ 6 ] improve on this by averaging predictions from multiple independently trained models, yielding both strong accuracy and reliable uncertainty estimates. Deep Gaussian Processes [ 7 ] stack Gaussian Process priors in multiple layers to model both epistemic and aleatoric uncertainty nonparametrically, though scalability remains a challenge. More recent work has revisited the foundational definitions of aleatoric versus epistemic uncertainty, arguing for richer taxonomies and coherence in their interpretation [ 8 , 9 ] . 2.2 Causal Inference and Treatment Effect Estimation Heterogeneous treatment-effect estimation has seen extensive methodological development. Meta-learners such as the T-, S-, and X-learners [ 10 ] adapt any base learner to estimate individual treatment effects. Representation-learning approaches like TARNet [ 1 ] and DragonNet [ 2 ] mitigate selection bias by first learning a shared covariate encoder and then branching into separate treatment and control outcome heads. Bayesian methods—most notably Bayesian Additive Regression Trees (BART) [ 3 , 11 ] and Bayesian Causal Forests [ 4 ] —provide interval estimates for average and individual treatment effects but do not decompose uncertainty into distinct epistemic and aleatoric components. A recent survey of deep causal models highlights the absence of structured uncertainty quantification in this literature [ 12 ] . 2.3 Structured Uncertainty Decomposition Across uncertainty quantification research, a clear distinction is drawn between aleatoric uncertainty (irreducible outcome noise) and epistemic uncertainty (model uncertainty reducible with more data) [ 13 ] . In computer vision and reinforcement learning, methods such as multi-headed networks that jointly predict mean and variance [ 13 ] or single-model techniques for simultaneous aleatoric and epistemic estimation [ 14 ] have begun to disentangle these sources. However, modular deep architectures for causal inference have lacked an analogous structured decomposition. To our knowledge, no prior work has explicitly separated representation-level uncertainty (due to limited or imbalanced feature encoding) from prediction-level uncertainty (due to outcome noise) within a unified deep treatment-effect model. 3 Methodology 3.1 Preliminaries and Notation Let x\in\mathcal{X}\subseteq\mathbb{R}^{p} be a feature vector, t\in\{0,1\} the binary treatment indicator, and Y(t) the potential outcome under treatment t . We observe Y=Y(T) for each unit. A twin network comprises • a shared encoder \Phi(x;\theta_{e})\colon\mathbb{R}^{p}\to\mathbb{R}^{d} , and • two outcome heads f_{0}(z;\theta_{0}),f_{1}(z;\theta_{1})\colon\mathbb{R}^{d}\to\mathbb{R} , so that the estimated individual treatment effect is \hat{\tau}(x)\;=\;f_{1}\bigl(\Phi(x)\bigr)\;-\;f_{0}\bigl(\Phi(x)\bigr). We augment this architecture with Monte Carlo Dropout to obtain uncertainty estimates on \hat{Y}_{t}(x)=f_{t}(\Phi(x)) . 3.2 Monte Carlo Dropout for Factorized Uncertainty Following Gal and Ghahramani [ 5 ] , we insert dropout after every hidden unit in both encoder and heads. Each stochastic forward pass samples a dropout mask, yielding \hat{Y}_{t}^{(n)}(x)=f_{t}\bigl(\Phi(x;\theta_{e}^{(n)});\theta_{t}^{(n)}\bigr),\quad n=1,\dots,N, where (\theta_{e}^{(n)},\theta_{t}^{(n)})\sim q(\theta) approximates the posterior. The overall predictive mean and variance are then estimated by \bar{Y}_{t}(x)=\frac{1}{N}\sum_{n=1}^{N}\hat{Y}_{t}^{(n)}(x),\quad\operatorname{Var}_{\rm tot}(x,t)=\frac{1}{N}\sum_{n=1}^{N}\bigl(\hat{Y}_{t}^{(n)}(x)-\bar{Y}_{t}(x)\bigr)^{2}. 3.3 Principled Variance Decomposition A key insight is that total predictive variance admits a module-level split by the law of total variance . Denote by \hat{Y}_{t}(x) the random output under all dropout masks; then \mathrm{Var}\bigl(\hat{Y}_{t}(x)\bigr)=\underbrace{\mathrm{Var}_{\theta_{e}}\!\Bigl(\mathbb{E}_{\theta_{t}}\bigl[\hat{Y}_{t}(x)\mid\theta_{e}\bigr]\Bigr)}_{\displaystyle\operatorname{Var}_{\rm rep}(x,t)}\;+\;\underbrace{\mathbb{E}_{\theta_{e}}\!\Bigl[\mathrm{Var}_{\theta_{t}}\bigl(\hat{Y}_{t}(x)\mid\theta_{e}\bigr)\Bigr]}_{\displaystyle\operatorname{Var}_{\rm pred}(x,t)}. where \operatorname{Var}_{\rm rep}(x,t)=\operatorname{Var}_{\theta_{e}}\!\bigl(\mathbb{E}_{\theta_{t}}[\hat{Y}_{t}(x)\mid\theta_{e}]\bigr),\quad\operatorname{Var}_{\rm pred}(x,t)=\mathbb{E}_{\theta_{e}}\!\bigl[\operatorname{Var}_{\theta_{t}}(\hat{Y}_{t}(x)\mid\theta_{e})\bigr]. Intuitively, the first term measures uncertainty in the encoder embedding, while the second term measures uncertainty in the prediction heads . In practice we approximate these via controlled dropout: • Representation uncertainty: enable dropout only in the encoder (heads deterministic) to estimate \operatorname{Var}_{\rm rep}(x,t)\approx\frac{1}{N}\sum_{n=1}^{N}\bigl(\hat{Y}^{(n)}_{t,\mathrm{rep}}(x)-\overline{Y}_{t,\mathrm{rep}}(x)\bigr)^{2}. • Prediction uncertainty: enable dropout only in the heads (encoder deterministic) to estimate \operatorname{Var}_{\rm pred}(x,t)\approx\frac{1}{N}\sum_{n=1}^{N}\bigl(\hat{Y}^{(n)}_{t,\mathrm{pred}}(x)-\overline{Y}_{t,\mathrm{pred}}(x)\bigr)^{2}. We empirically verify that \operatorname{Var}_{\rm tot}(x,t)\approx\operatorname{Var}_{\rm rep}(x,t)+\operatorname{Var}_{\rm pred}(x,t), thus confirming our decomposition. 3.4 Model Architecture and Training Our implementation (Figure 1 ) builds on the twin-network paradigm [ 1 , 2 ] . We use a multi-layer perceptron encoder \Phi(x;\theta_{e}) with dropout after each hidden block, and two identically-structured heads f_{0},f_{1} each with their own dropout. We train by minimizing the factual mean-squared error \mathcal{L}(\theta_{e},\theta_{0},\theta_{1})=\frac{1}{n}\sum_{i=1}^{n}\Bigl(\mathbb{I}[t_{i}=0]\,f_{0}(\Phi(x_{i}))+\mathbb{I}[t_{i}=1]\,f_{1}(\Phi(x_{i}))-y_{i}\Bigr)^{2}. Optionally, one can add an IPM-based regularizer to balance treated and control embeddings [ 1 ] . 3.5 Inference Procedure At test time for a new x : 1. mode=‘total’ : Run N stochastic passes to compute \bar{Y}_{t}(x) and \operatorname{Var}_{\rm tot}(x,t)

Read the complete text