Coupling Generative Modeling and an Autoencoder with the Causal Bridge

Ruolin Meng Ming-Yu Chung Dhanajit Brahma Ricardo Henao Lawrence Carin · 2025

Read Coupling Generative Modeling and an Autoencoder with the Causal Bridge by Ruolin Meng Ming-Yu Chung Dhanajit Brahma Ricardo Henao Lawrence Carin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-25599.txt.

Introduction

Ruolin Meng and a team of co-authors join generative modeling with an autoencoder to estimate causal effects, in two thousand twenty-five. A hidden factor can sway both a treatment and its outcome, which blocks plain causal reading. Two sets of proxy measures, one tied to each side, can unlock the effect through a function called the causal bridge.

The authors give a new theory view of when that bridge can be estimated, plus an error bound when its assumptions fail. Coupling the bridge with an autoencoder lets the parts share statistical strength. Tests on synthetic and real data beat leading methods for proxy-based causal estimation, they report.

Catalog record

CREATORRuolin Meng Ming-Yu Chung Dhanajit Brahma Ricardo Henao Lawrence Carin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE93 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-25599

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Coupling Generative Modeling and an Autoencoder with the Causal Bridge Ruolin Meng Ming-Yu Chung Dhanajit Brahma Ricardo Henao Lawrence Carin Abstract We consider inferring the causal effect of a treatment (intervention) on an outcome of interest in situations where there is potentially an unobserved confounder influencing both the treatment and the outcome. This is achievable by assuming access to two separate sets of control (proxy) measurements associated with treatment and outcomes, which are used to estimate treatment effects through a function termed the causal bridge (CB). We present a new theoretical perspective, associated assumptions for when estimating treatment effects with the CB is feasible, and a bound on the average error of the treatment effect when the CB assumptions are violated. From this new perspective, we then demonstrate how coupling the CB with an autoencoder architecture allows for the sharing of statistical strength between observed quantities (proxies, treatment, and outcomes), thus improving the quality of the CB estimates. Experiments on synthetic and real-world data demonstrate the effectiveness of the proposed approach in relation to the state-of-the-art methodology for proxy measurements. 1 Introduction Estimating the causal effect of a treatment on an outcome is crucial in various domains, but the presence of unobserved confounders can hinder accurate inference ( pearl2016causal ; Rubin_potential_outcomes ) . Traditional methods often rely on strong assumptions, such as the absence of unobserved confounders ( rubin1974estimating ; unconfounding ) . Other approaches have assumed available instrumental variables with specific properties ( Rubin_IV ; Gretton_IV ; DeepIV ) . However, these assumptions may not always hold in practice, leading to biased estimates of causal effects. A promising approach to address this challenge is the use of proxy variables ( frost1979proxy ; miao2018identifying ; VAE_causal ) , also known as negative control variables . These are variables that are affected by the unobserved confounder, but do not necessarily directly influence the treatment or outcome. Consequently, leveraging information from these proxies, we can gain insight into the underlying causal mechanisms and potentially mitigate the bias caused by unobserved confounders. Recent work has introduced the concept of a causal bridge function , which uses two sets of proxy variables, one related to the treatment and the other to the outcome, to estimate causal effects ( miao2018identifying ; Miao2020 ; gretton_causal ) . This approach has shown promising results, but there is still room for improvement in terms of both theoretical understanding and practical implementation. This paper builds on the causal bridge framework and makes several key advances. We provide a refined theoretical analysis, clarifying the assumptions and conditions under which the causal bridge function yields accurate causal effect estimates. Furthermore, we introduce a novel learning approach that leverages the power of generative models to enhance the estimation of the causal bridge. Our approach enables the sharing of statistical strength between observed variables, leading to more robust and accurate causal inference. Finally, we extend the causal bridge framework to handle survival outcomes, a common type of data in biomedical applications. In summary: 1. We develop a novel framework for causal inference with proxy variables, building upon the causal bridge function. Specifically: (a) We re-examine the assumptions underlying the causal bridge function, providing a new bound on the average error of the treatment effect when the assumption that the causal bridge is independent of the treatment proxy is violated (Section 4 ). (b) We introduce a new formulation for learning the causal bridge that utilizes generative models to sample from the conditional distribution of the outcome proxy given the treatment proxy and treatment (Section 6 ). This approach allows for more efficient and flexible estimation compared to previous methods that rely on estimating conditional expectations. (c) We propose an autoencoder architecture that enables the sharing of statistical strength between observed variables (Section 6 ), leading to improved estimation of the causal bridge and more accurate causal effect estimates. (d) We extend the causal bridge framework to handle survival outcomes (Section 6 ), broadening its applicability to important real-world problems. 2. We validate our framework through experiments on synthetic and real-world datasets (Section 7 ), including comparison with a randomized control trial (RCT). Our results illustrate the implications of our assumptions and demonstrate the effectiveness of our approach compared to state-of-the-art methods for causal inference with proxy variables. 2 Related Work Traditional approaches to dealing with unobserved confounders often involve sensitivity analysis ( Sensitivity ; sensitivity_no_assumptions ) , which assesses the robustness of causal effect estimates to different assumptions about the unobserved confounder ( binary_latent ; Sensitivity_Robins ; imbens_confounding ; Sensitivity ; kallus_confounding ) . Another common approach is the use of instrumental variables (IVs), variables that influence the treatment but are independent of the unobserved confounder ( Imben_IV ; Rubin_IV ; DeepIV ; Gretton_IV ) . However, finding valid IVs can be challenging in practice. More recently, there has been growing interest in using proxy variables to address unobserved confounding. Early work focused on categorical data and unobserved confounders ( kuroki2014measurement ) , showing that causal effects can be estimated under certain conditions. The concept of causal bridge function ( miao2018identifying ; Miao2020 ; gretton_causal ) extends this idea to more general settings, using two sets of proxies to estimate causal effects. These studies have provided valuable theoretical insights and practical tools for causal inference with proxy variables. Deep learning has also been increasingly applied to causal inference, enabling the development of more flexible models. For example, deep-generative models have been used to improve IV analysis ( DeepIV ) and to address unobserved confounding in various settings ( VAE_causal ; GANITE ; assaad ) . Our work builds on these advances, leveraging generative models to enhance the estimation of the causal bridge function. Our work draws inspiration from and contributes to several active research areas within causal inference, particularly those focused on handling unobserved confounders and leveraging proxy variables. Although our research builds upon these foundations, it makes several novel contributions, as elucidated in the previous section. 3 Background on the Causal Bridge Figure 1: Graphical model for the causal-inference problem. U is the unobserved confounder, X is the treatment, Y is the outcome of interest, and Z and W are the treatment and outcome controls, respectively. The dashed lines represent dependencies that may or may not be present. Let X and Y represent a treatment (intervention) and outcome, respectively. In the examples we consider here, Y will be continuous and X could be real or categorical (with binary being an important special case). It is assumed that X and Y are both dependent on an unobserved confounder U , as illustrated in Figure 1 . As discussed in ( kuroki2014measurement ; Pearl_book ; miao2018identifying ; Miao2020 ; gretton_causal ) , to perform inference in the presence of the unobserved U , control (proxy) measurements are assumed to be available, which are also dependent on U . Specifically, Z is a treatment control variable, and W is an outcome control variable. As shown in Figure 1 , the outcome may depend on W and the treatment may depend on Z . We assume for simplicity that there are no additional covariates, but such could be included if available, as discussed in ( Miao2020

Read the complete text