Stochastic Neural Networks for Causal Inference with Missing Confounders
Yaxin Fang, Faming Liang · 2026
Read Stochastic Neural Networks for Causal Inference with Missing Confounders by Yaxin Fang, Faming Liang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-01230.txt.
Introduction
Fang and Liang propose Confounder Imputation with Stochastic Neural Networks, a causal-guessing method for unmeasured hidden factors. It models a causal graph with a stochastic neural network and fills in latent confounders by tuned stochastic-gradient Hamiltonian Monte Carlo. Under standard rules and a size-capped sparse network class, they prove model ID and steady gauging of the mean future outcome under a fixed treatment. The latent confounder is known only up to rewrites keeping the joint treatment-outcome spread, but the causal target stays fixed across that class.
Catalog record
| CREATOR | Yaxin Fang, Faming Liang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 120043 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.01230
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Stochastic Neural Networks for Causal Inference with Missing Confounders Yaxin Fang, Faming Liang Abstract Unmeasured confounding is a fundamental obstacle to causal inference from observational data. Latent-variable methods address this challenge by imputing unobserved confounders, yet many lack explicit model-based identification guarantees and are difficult to extend to richer causal structures. We propose Confounder Imputation with Stochastic Neural Networks (CI-StoNet), which parameterizes the conditional structure of a causal directed acyclic graph using a stochastic neural network and imputes latent confounders via adaptive stochastic-gradient Hamiltonian Monte Carlo. Under SUTVA and overlap, and assuming that the structural components of the data-generating process are well approximated by a capacity-controlled sparse deep neural network class, we establish model identification and consistent estimation of the mean potential outcome under a fixed intervention within this class. Although the latent confounder is identifiable only up to reparameterizations that preserve the joint treatment–outcome distribution, the causal estimand is invariant across this observationally equivalent class. We further characterize the effect of overlap on estimation accuracy. Empirical results on simulated and benchmark datasets demonstrate accurate performance, and the framework extends naturally to proxy-variable and multiple-cause settings with overlap diagnostics and bootstrap-based uncertainty quantification. 1 Introduction Causal inference from observational studies is a topic of significant interest in fields such as genetics, economics, and social science. Under the potential outcome framework ( 26 ) , a fundamental condition for identifying causal effects is the strong ignorability condition ( 25 ) : {\boldsymbol{A}}\ \rotatebox[origin]{90.0}{$\models$}\ \{{\boldsymbol{Y}}({\boldsymbol{a}}):{\boldsymbol{a}}\in\mathcal{A}\}\ |\ {\boldsymbol{Z}}, (1) where {\boldsymbol{A}} denotes the treatment variable taking values in the space \mathcal{A} , {\boldsymbol{Y}}(\cdot) denotes the outcome function, and {\boldsymbol{Z}} denotes confounders. A confounder refers to a variable that influences both the treatment and the outcome. The strong ignorability assumption requires that all confounders be observed. In observational studies, this condition is seldom fully met, thereby introducing the risk of substantial bias in causal effect estimation. One strategy to address the issue of missing confounders is to model them as latent variables. 35 proposed using a latent factor model to obtain a latent representation for multiple causes, enabling the capture of multiple-cause confounders under the assumption that no single-cause confounder exists. 11 tackled this problem under a proxy variable setting by leveraging the low-rank components of the proxy variables, obtained through matrix factorization, as an approximation to the true confounders. 18 also addressed the issue with proxy variables and introduced the causal effect variational autoencoder (CEVAE) to infer missing confounders from the observational distribution of the proxy, treatment, and outcome. These works represent significant advancements in causal inference using observational data; however, they have notable limitations. For instance, 9 pointed out that 35 essentially models the substitute confounder as a deterministic function of treatments, leading it to converge to a function of the observed treatments rather than the true confounder. 11 focuses primarily on the linear regression setting, limiting its applicability to nonlinear models unless many proxies are available for a small number of latent variables. 24 examined the consistency of the causal effect estimator in 18 and showed that it fails to correctly estimate cause effects when the latent variable is misspecified or the data distribution is overly complex. In this paper, we propose a latent variable imputation approach to address the issue of missing confounders. This new approach is built on the stochastic neural network (StoNet) ( 32 ; 17 ) and sparse deep learning theory ( 31 ) , effectively overcoming the limitations of existing approaches. The core idea is to encode the causal DAG’s Markov factorization in StoNet and to impute latent confounders through the resulting conditional distributions. Importantly, our theoretical guarantee is model-based: under SUTVA and overlap, and assuming the treatment and outcome mechanisms lie in a function class that can be well approximated by sparse DNNs, the causal functional \mathbb{E}[Y({\boldsymbol{a}})] is uniquely determined and is consistently estimable. The StoNet is trained using an adaptive stochastic gradient MCMC algorithm ( 17 ; 6 ) , which allows for the simultaneous imputation of missing confounders and estimation of sparse StoNet parameters. We refer to the proposed approach as Confounder Imputation with Stochastic Neural Networks (CI-StoNet). In summary, it offers the following advantages in addressing the missing confounder issue: (i) Accurate Causal Effect Estimation: This property is supported by StoNet’s inherent ability to handle missing data, the consistency of sparse deep learning, and the convergence guarantee offered by the adaptive stochastic gradient MCMC algorithm. (ii) Complex nonlinear modeling. CI-StoNet inherits the universal - approximation property of deep neural networks (DNNs), enabling effective modeling of complex nonlinear relationships across diverse applications. (iii) Structural flexibility. The Markovian architecture of CI-StoNet provides structural flexibility for representing diverse dependency patterns in causal DAGs. It supports localized updates to each DNN module, promoting modular design and easy adaptation to varying causal relationships. 2 CI-StoNet for Missing Confounders 2.1 The CI-StoNet Approach This section introduces the CI-StoNet approach or, more generally, a deep learning framework for performing causal inference in presence of missing confounders. Figure 1: simple confounding Consider the scenario of simple confounding, as depicted by Figure 1 , which involves treatment {\boldsymbol{A}}\in\{{\boldsymbol{a}}_{1},\ldots,{\boldsymbol{a}}_{m}\} , missing/latent confounders {\boldsymbol{Z}} , and an outcome {\boldsymbol{Y}} . The corresponding model is given by \begin{split}{\boldsymbol{A}}&=g_{1}({\boldsymbol{Z}},{\boldsymbol{e}}_{a}),\\ {\boldsymbol{Y}}&=g_{2}({\boldsymbol{Z}},{\boldsymbol{A}})+{\boldsymbol{e}}_{y},\\ \end{split} (2) where g_{1}(\cdot) and g_{2}(\cdot) are unknown functions that can be nonlinear and highly complex, and {\boldsymbol{e}}_{a} and {\boldsymbol{e}}_{y} are random errors. In this paper, we assume {\boldsymbol{e}}_{y}\sim N(0,\sigma_{y}^{2}I_{d_{y}}) , where d_{y} denotes the dimension of {\boldsymbol{Y}} . There is flexibility in specifying the distribution of {\boldsymbol{e}}_{a} . If {\boldsymbol{A}} is continuous, then {\boldsymbol{e}}_{a} can be assumed to follow a Gaussian distribution or any other continuous distribution. If {\boldsymbol{A}} is mixed, the distribution of each component of {\boldsymbol{e}}_{a} can be specified accordingly. This scenario has included multiple causes considered in 35 , where {\boldsymbol{a}}_{i} is a multi-dimensional vector, as a special case. Since {\boldsymbol{Z}} is missing, we impute it from the conditional distribution: \begin{split}\pi({\boldsymbol{Z}}|{\boldsymbol{A}},{\boldsymbol{Y}})&\propto\pi({\boldsymbol{Z}})\pi({\boldsymbol{A}}|{\boldsymbol{Z}})\pi({\boldsymbol{Y}}|{\boldsymbol{Z}},{\boldsymbol{A}})\propto\pi({\boldsymbol{Z}}|{\boldsymbol{A}})\pi({\boldsymbol{Y}}|{\boldsymbol{Z}},{\boldsymbol{A}}),\end{split} (3) where \pi(\cdot) denotes a distribution or conditional distribution in the appropriate context. Figure 2: Diagram of CI-StoNet under simple confounding, where white rectangles represent variables from observed data; light-grey rounded-rectangles represent latent variable to impute; and dark-grey rectangles represent neural network modules to learn respective conditional distributions. The latter part of Eq. ( 3 ) suggests that, mathematically, {\boldsymbol{A}} , {\boldsymbol{Z}} , and {\boldsymbol{Y}} can be interpreted as the exogenous input, latent state and output of a stochastic model. Motivated by this view, we propose to perform the imputation using a CI-StoNet (see Figure 2 for its structure), formulated as: \begin{split}{\boldsymbol{Z}}&=\mu_{1}({\boldsymbol{A}},{\boldsymbol{\theta}}_{1})+{\boldsymbol{e}}_{z},\\ {\boldsymbol{Y}}&=\mu_{2}({\boldsymbol{Z}},{\boldsymbol{A}},{\boldsymbol{\theta}}_{2})+{\boldsymbol{e}}_{y},\\ \end{split} (4) where \mu_{1}(\cdot) and \mu_{2}(\cdot) are two neural network functions, parameterized by {\boldsymbol{\theta}}_{1} and {\boldsymbol{\theta}}_{2} , respectively; {\boldsymbol{e}}_{z}\sim N(\boldsymbol{0},\sigma^{2}_{z}I_{d_{z}}) ; and {\boldsymbol{e}}_{y} is as defined in ( 2 ). The two neural networks are interconnected through the latent variable {\boldsymbol{Z}} . Additionally, we impose the following assumptions on the models ( 2 ) and ( 4 ): Assumption 1 . (i) {\boldsymbol{e}}_{a}\rotatebox[origin]{90.0}{$\models$}{\boldsymbol{e}}_{y} , {\boldsymbol{e}}_{a}\rotatebox[origin]{90.0}{$\models$}{\boldsymbol{Z}} , {\boldsymbol{e}}_{y}\rotatebox[origin]{90.0}{$\models$}({\boldsymbol{Z}},{\boldsymbol{A}}) ; (ii) there exist sparse DNNs \mu_{1}(\cdot) and \mu_{2}(\cdot) such that ( 4 ) holds, {\boldsymbol{e}}_{z}\sim N({\bf 0},\sigma_{z}^{2}I_{d_{z}}) , {\boldsymbol{e}}_{y}\sim N(0,\sigma_{y}^{2}I_{d_{y}}) , {\boldsymbol{e}}_{z}\rotatebox[origin]{90.0}{$\models$}{\boldsymbol{e}}_{y} , and {\boldsymbol{e}}_{z}\rotatebox[origin]{90.0}{$\models$}{\boldsymbol{A}} ; Part (i) of Assumption 1 ensures that strong ignorability ( 1 ) holds. Part (ii) specifies the working model class by restricting the