MediEncoder: Nonlinear Representation Learning for High-Dimensional Causal Mediation Analysis

Shi Bo, Debarghya Mukherjee, AmirEmad GhassamiDepartment of Mathematics and Statistics, Boston University · 2026

Read MediEncoder: Nonlinear Representation Learning for High-Dimensional Causal Mediation Analysis by Shi Bo, Debarghya Mukherjee, AmirEmad GhassamiDepartment of Mathematics and Statistics, Boston University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30648.txt.

Introduction

Shi Bo, Debarghya Mukherjee and AmirEmad Ghassami present MediEncoder, a framework for causal mediation analysis with high-dimensional data. Mediation analysis splits a treatment's effect into two parts. One part flows through intermediate variables, called mediators. The other bypasses them. In modern medical studies, the true drivers are hidden processes, while the measurements are noisy proxies with many dimensions.

MediEncoder learns compact summaries of the background factors and the mediators together, using a coupled encoder-decoder design. A cross-factor network links the two sides, respecting how they depend on each other. The summaries feed a cross-fitted estimator of natural direct and indirect effects. The estimator is multiply robust, so it stays valid when parts of the model are right. Simulations beat rival reduction methods, and an application to Alzheimer's imaging data showed the method at work.

Catalog record

CREATORShi Bo, Debarghya Mukherjee, AmirEmad GhassamiDepartment of Mathematics and Statistics, Boston University
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE132 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.30648

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MediEncoder: Nonlinear Representation Learning for High-Dimensional Causal Mediation Analysis Shi Bo, Debarghya Mukherjee, AmirEmad GhassamiDepartment of Mathematics and Statistics, Boston University Abstract Causal mediation analysis decomposes a treatment effect into indirect pathways through mediators and direct pathways not operating through them. Modern biomedical studies often involve high-dimensional covariates and mediators that are noisy proxies for lower-dimensional latent biological processes. Existing methods typically rely on sparsity, linear factor models, or ignore the connection among variables in the learned representations, which can be restrictive when measurements are nonlinear and covariate and mediator factors are structurally dependent. We propose MediEncoder , a representation-learning framework for nonlinear high-dimensional mediation analysis. MediEncoder jointly learns low-dimensional covariate and mediator representations using a coupled encoder--decoder architecture with a cross-factor network that links treatment and covariate representations to mediator representations. The learned features are then used in a cross-fitted efficient influence function-based estimator of natural direct and indirect effects. The resulting estimator is multiply robust and asymptotically normal under suitable regularity conditions. Simulations show that MediEncoder improves estimation accuracy over competing dimension-reduction approaches, and an application to Alzheimer’s Disease Neuroimaging Initiative data illustrates its utility in high-dimensional biomedical causal mediation analysis. † † † Corresponding authors. Keywords— Causal Inference; Dimension Reduction; Factor Models; High-Dimensional Data; Auto-encoder 1 Introduction Causal mediation analysis seeks to explain how a treatment affects an outcome by decomposing the total effect into pathways operating through intermediate variables, or mediators ( 5 ; 39 ; 26 ; 46 ) . In the potential-outcomes framework ( 43 ) , this amounts to studying counterfactual means whose contrasts yield the natural indirect effect, natural direct effect, and total effect. Classical methods typically assume that the relevant covariates and mediators are directly observed and low-dimensional. Modern biomedical studies often violate both assumptions: the causal mechanisms of interest are latent, while the available measurements are noisy, high-dimensional proxies. This setting arises across genomics and multi-omics applications. High-dimensional molecular measurements, such as metabolomic or multi-omics profiles, are often indirect views of lower-dimensional biological states ( 50 ; 41 ) . For example, oxidative stress has been proposed as a pathway linking depression to Alzheimer’s disease ( 34 ; 10 ) , but reactive oxygen species are short-lived and difficult to measure directly ( 30 ) . Researchers therefore rely on downstream molecular signatures, including DNA damage and DNA methylation changes ( 38 ; 8 ; 36 ) . Such measurements may be nonlinear functions of latent biological processes ( 28 ; 48 ) ; moreover, upstream covariate factors, treatments, and mediator factors can interact in ways that complicate causal identification and estimation ( 47 ) . These features motivate a mediation framework that can handle latent structure, high dimensionality, nonlinear measurement maps, and treatment–covariate–mediator interactions simultaneously. Existing high-dimensional mediation methods address only parts of this problem. Sparse and variable-selection approaches can screen many candidate mediators ( 54 ; 56 ; 9 ; 29 ) , but they usually treat the observed variables as the mediators and do not model latent structure. Dimension-reduction methods based on PCA or linear factor models provide low-dimensional summaries ( 12 ; 14 ) , but linear measurement maps can be restrictive in complex biological systems ( 1 ) . Autoencoders and related deep models can learn nonlinear representations ( 25 ; 19 ) , yet applying them separately to covariates and mediators ignores the structural dependence between the two latent systems. Deep mediation estimators such as ( 52 ) improve robustness to nuisance model misspecification, but do not explicitly target nonlinear high-dimensional latent-factor settings. Variational autoencoder approaches for indirectly observed mediators ( 27 ) model latent mediators, but do not jointly accommodate latent nonlinear covariate structure, structural dependence between covariate and mediator representations, and interaction effects; see Appendix A for further discussion. Overall, existing methods address individual aspects of the problem but do not simultaneously address all the aforementioned challenges. The key missing ingredient is a framework that learns nonlinear covariate and mediator representations jointly, aligns them with the latent mediation structure, and then uses these representations in a statistically valid causal estimator. To bridge this gap, we propose MediEncoder , a nonlinear representation-learning framework for high-dimensional causal mediation analysis. The method jointly learns low-dimensional representations of covariates and mediators through a structured encoder–decoder architecture. A cross-factor network links the treatment and covariate representation to the mediator representation, encouraging the learned features to respect the causal structure of the latent mediation problem. Exact recovery of the original latent factors is not required: it suffices to learn representations that preserve the information needed for the mediation functional, and our theory formalizes invariance under left-invertible transformations of the latent factors. Our contributions are fourfold. (i) First, we introduce a nonlinear latent-factor framework for mediation analysis with high-dimensional covariates and mediators, avoiding linearity and sparsity requirements. (ii) Second, we develop MediEncoder, a coupled representation-learning algorithm that uses a cross-factor network to capture structural dependence between covariate and mediator representations. (iii) Third, we develop a modular asymptotic theory for the resulting cross-fitted efficient influence-function estimator. The theory formalizes that exact factor recovery is unnecessary: it suffices for the learned representation to approximate a left-invertible transformation of the latent factors, and the resulting inference remains valid under high-level factor-recovery and nuisance-rate conditions. (iv) Fourth, we demonstrate the empirical performance of MediEncoder in extensive simulations and in a biomedical application using data from the Alzheimer’s Disease Neuroimaging Initiative (ADNI). 2 Model Description We consider a binary treatment (or exposure) A\in\{0,1\} and a real-valued outcome Y\in\mathbb{R} . Let \bm{f}_{X}\in\mathbb{R}^{\bar{p}} denote a vector of pre-treatment latent covariate factors and let \bm{f}_{M}\in\mathbb{R}^{\bar{q}} denote a vector of latent mediator factors. The covariate factors may confound the treatment–mediator, treatment–outcome, and mediator–outcome relationships, whereas the mediator factors are the mechanisms through which part of the effect of A on Y may be transmitted. We use boldface notation for random latent vectors and write f_{X} and f_{M} for their generic values. A compact structural representation of the latent mediation model is \displaystyle\bm{f}_{M} \displaystyle=(1-A)\{\mu_{0}^{*}(\bm{f}_{X})+\bm{u}_{XM}\}+A\{\mu_{1}^{*}(\bm{f}_{X})+\bm{u}^{\prime}_{XM}\}, (2.1) \displaystyle Y \displaystyle=(1-A)\{\mu_{0}(\bm{f}_{X},\bm{f}_{M})+\epsilon^{\prime}\}+A\{\mu_{1}(\bm{f}_{X},\bm{f}_{M})+\epsilon\}, where \mu_{0}^{*},\mu_{1}^{*}:\mathbb{R}^{\bar{p}}\to\mathbb{R}^{\bar{q}} and \mu_{0},\mu_{1}:\mathbb{R}^{\bar{p}+\bar{q}}\to\mathbb{R} are unknown structural functions and \epsilon , \epsilon^{\prime} , \bm{u}_{XM}\in\mathbb{R}^{\bar{q}} , and \bm{u}_{XM}^{\prime}\in\mathbb{R}^{\bar{q}} are centered noise terms. In the applications motivating this work, \bm{f}_{X} and \bm{f}_{M} are not directly observed. Instead, we observe high-dimensional measurements X\in\mathbb{R}^{p} and M\in\mathbb{R}^{q} , with p\gg\bar{p} and q\gg\bar{q} , that serve as noisy proxies for the latent factors; see Figure 1 . We assume the measurement model X=\phi_{X}(\bm{f}_{X})+\bm{u}_{X},\hskip 18.49988ptM=\phi_{M}(\bm{f}_{M})+\bm{u}_{M}, (2.2) where \phi_{X}:\mathbb{R}^{\bar{p}}\to\mathbb{R}^{p} and \phi_{M}:\mathbb{R}^{\bar{q}}\to\mathbb{R}^{q} are unknown loading functions, and \bm{u}_{X} and \bm{u}_{M} are centered idiosyncratic errors. The classical linear factor model is a special case of ( 2.2 ), obtained by taking \phi_{X}(f_{X})=\Gamma_{X}f_{X} and \phi_{M}(f_{M})=\Gamma_{M}f_{M} for loading matrices \Gamma_{X}\in\mathbb{R}^{p\times\bar{p}} and \Gamma_{M}\in\mathbb{R}^{q\times\bar{q}} . We next define the causal estimands at the latent-factor level. Let \bm{f}_{M}^{(a)} denote the mediator factors that would be observed if the treatment were set to a , and let Y^{(a,f_{M})} denote the potential outcome if the treatment were set to a and the mediator factors were set to the value f_{M} . We use the shorthand Y^{(a)}=Y^{(a,\bm{f}_{M}^{(a)})} . For treatment level 1 relative to 0 , the total effect decomposes as \textstyle\underbrace{\mathbb{E}\{Y^{(1)}-Y^{(0)}\}}_{\text{Total effect}}=\underbrace{\mathbb{E}\!\left[Y^{(1,\bm{f}_{M}^{(1)})}-Y^{(1,\bm{f}_{M}^{(0)})}\right]}_{\text{Natural indirect effect}}+\underbrace{\mathbb{E}\!\left[Y^{(1,\bm{f}_{M}^{(0)})}-Y^{(0,\bm{f}_{M}^{(0)})}\right]}_{\text{Natural direct effect}}. (2.3) Identification of parameters of the form \theta(a,a^{\prime})=\mathbb{E}\{Y^{(a,\bm{f}_{M}^{(a^{\prime})})}\} for any a,a^{\prime}\in\{0,1\} yields

Read the complete text