Identifying Direct Causal Effects in Latent Factor Models by Accounting for Unidentified Parents

Tom Hochsprung, Nils Sturma, Jakob Runge, Mathias Drton, Andreas Gerhardus · 2026

Read Identifying Direct Causal Effects in Latent Factor Models by Accounting for Unidentified Parents by Tom Hochsprung, Nils Sturma, Jakob Runge, Mathias Drton, Andreas Gerhardus (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28105.txt.

Introduction

Hochsprung and colleagues pin down direct cause links in factor models with hidden variables, where seen variables share many hidden confounders. Their rule extends step-by-step identification by owning up to parent causes whose links stay unknown, with flow math keeping the hunt cheap. It proves links that hide-from-view methods miss and ships as working code.

Catalog record

CREATORTom Hochsprung, Nils Sturma, Jakob Runge, Mathias Drton, Andreas Gerhardus
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE167040
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.28105

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Identifying Direct Causal Effects in Latent Factor Models by Accounting for Unidentified Parents Tom Hochsprung, Nils Sturma, Jakob Runge, Mathias Drton, Andreas Gerhardus Abstract We consider linear structural equation models with explicitly modelled latent variables. In such models, observed and latent variables solve linear equations including stochastic noise terms. The goal of our work is to identify the direct causal effects between the observed variables of interest by providing (rational) formulas in the observed covariances. Most prior identification approaches operate in the latent projection framework, where latent variables are projected away into dependent error terms. However, when the observed variables are densely confounded, even if only by a few latent variables, the projection-based approaches are unable to certify identifiability of most effects. For such problems, approaches that explicitly use the latent variables are more effective, but algorithms that were recently proposed for this purpose often remain inconclusive for denser causal graphs. We develop a new identification criterion that is able to better handle dense graphs by leveraging the key insight that recursive identification schemes can be generalized by explicitly accounting for causal parents with (yet) unidentified direct effects. Combinatorial search problems in our new criterion can be tackled with the help of network-flow computations, leading to a practical useful algorithmic tool that we also make available in software. Keywords: causal inference, causal effect identification, latent variables, factor analysis, structural equation model 1 Introduction We consider linear structural equation models (LSEMs) with explicitly modelled latent variables. In such LSEMS, structural equations state that the components of the observed random vector X are noisy linear functions of a subset of the other components of X and a vector of latent variables L . Solving the equations induces the joint distribution the model postulates for X . For LSEMs with latent variables, it is important to clarify which of the coefficients in the structural equations are identifiable (that is, uniquely recoverable) from the covariance matrix of X and also to derive (rational) identification formulas. This parameter identification problem is relevant for a broad range of applied sciences because one can naturally interpret the coefficients as direct causal effects between different variables (e.g., 37 ; 29 ; 31 ). The setting in our paper is similar to the one in 3 . Consider a collection X=(X_{v})_{v\in V} of d=|V| observed random variables and a further collection L=(L_{h})_{h\in\mathcal{L}} of \ell=|\mathcal{L}| latent (unobserved) random variables. We assume that V and \mathcal{L} are both finite and that all variables X_{v} are related by linear equations as \displaystyle X_{v}=\sum_{w\neq v}\lambda_{wv}X_{w}+\sum_{h\in\mathcal{L}}\gamma_{hv}L_{h}+\epsilon_{v},\quad v\in V. (1.1) The \epsilon_{v} constitute noise in the form of jointly independent random variables with zero mean and variances \omega_{vv}:=\mathbb{E}[\epsilon_{v}^{2}]\in(0,\infty) . The \lambda_{wv} and \gamma_{hv} are real-valued parameters commonly referred to as the direct causal effects of X_{w} on X_{v} and L_{h} on X_{v} , respectively. We assume the latent variables (L_{h})_{h\in\mathcal{L}} to be directly sampled from some underlying distribution with strictly positive and finite variance and that the latent variables (L_{h})_{h\in\mathcal{L}} are jointly independent and independent of the noise terms \epsilon=(\epsilon_{v})_{v\in V} . Furthermore, without loss of generality we assume that the means of the latent variables (L_{h})_{h\in\mathcal{L}} equal 0 . Understanding X , L and \epsilon as vectors, we can recast ( 1.1 ) as the matrix equation \displaystyle X=\Lambda^{T}X+\Gamma^{T}L+\epsilon, (1.2) where \Lambda=(\lambda_{wv})\in\mathbb{R}^{d\times d} and \Gamma=(\gamma_{hv})\in\mathbb{R}^{\ell\times d} are parameter matrices. The matrix \Lambda has zero diagonal entries and, to ensure solvability of ( 1.2 ), it is assumed that I_{d}-\Lambda is invertible, where I_{d} is the d\times d -identity matrix. Solving for X in ( 1.2 ), we have \displaystyle X=(I_{d}-\Lambda)^{-T}(\Gamma^{T}L+\epsilon). (1.3) The vector \Gamma^{T}L+\epsilon follows a latent-factor model and has covariance matrix \displaystyle\Omega:=\textnormal{Var}(\epsilon+\Gamma^{T}L)=\Omega_{\textnormal{diag}}+\Gamma^{T}\mathcal{V}_{L}\Gamma, where \Omega_{\textnormal{diag}}:=\textnormal{Var}(\epsilon) is diagonal, and we write \mathcal{V}_{L}:=\textnormal{Var}(L) . From ( 1.3 ), we see that X has covariance matrix \displaystyle\Sigma=(I_{d}-\Lambda)^{-T}\Omega(I_{d}-\Lambda)^{-1}. (1.4) The goal of this paper is to derive conditions under which \Lambda (or some of its entries) can be identified from the observed covariance matrix \Sigma . We study the identification problem from a graphical perspective and encode the parametrized equation in ( 1.2 ) by a graph whose nodes represent the latent and observed variables in L and X . If the model allows an effect \lambda_{vw} or \gamma_{hw} , for v,w\in V and h\in\mathcal{L} , to be non-zero, then the graph contains a directed edge v\rightarrow w or h\rightarrow w , respectively. We call this graph a latent-factor graph and emphasize that it explicitly shows the latent variables. SES IP HS HA TA TC Figure 1 : Latent-factor graph corresponding to an example about the total energy consumption (TC) of a household; see Example 1.1 . Example 1.1 . We consider an example about the total energy consumption (TC) of a household, adapted from 12 and 22 . Three variables, namely, total heated floor area (TA) , household appliances (HA) and household size (HS) , are assumed to have a direct causal effect on total energy consumption. Additionally, the household size is assumed to have a direct effect on total heated floor area and household appliances. All of these four observed variables are also caused by the unobserved variable social economic status (SES) . Furthermore, one measures a proxy of SES that is conditionally independent of all the other observed variables given SES; for example, this independent observed proxy (IP) could be the car value. The corresponding LSEM with L=(L_{\textnormal{SES}}) and X=(X_{\textnormal{IP}},X_{\textnormal{HS}},X_{\textnormal{HA}},X_{\textnormal{TA}},X_{\textnormal{TC}})^{T} is given by \displaystyle X=\underbrace{\begin{pmatrix}0&0&0&0&0\\ 0&0&0&0&0\\ 0&\lambda_{\textnormal{HS},\textnormal{HA}}&0&0&0\\ 0&\lambda_{\textnormal{HS},\textnormal{TA}}&0&0&0\\ 0&\lambda_{\textnormal{HS},\textnormal{TC}}&\lambda_{\textnormal{HA},\textnormal{TC}}&\lambda_{\textnormal{TA},\textnormal{TC}}&0\end{pmatrix}}_{=\Lambda^{T}}X+\underbrace{\begin{pmatrix}\gamma_{\textnormal{SES},\textnormal{IP}}\\ \gamma_{\textnormal{SES},\textnormal{HS}}\\ \gamma_{\textnormal{SES},\textnormal{HA}}\\ \gamma_{\textnormal{SES},\textnormal{TA}}\\ \gamma_{\textnormal{SES},\textnormal{TC}}\end{pmatrix}}_{=\Gamma^{T}}L+\epsilon. The induced latent-factor graph is depicted in Figure 1 . Explicitly modelling the latent variables is particularly effective when the latent confounding is dense but low-dimensional, that is, when only a few latent variables confound many observed variables. The literature offers several graphical methods that seek to leverage this perspective. For example, 38 and 26 consider problems that feature only one latent variable. The conditional instrument approach of 46 only considers cases where no confounder directly influences all observed variables, and another line of work assumes availability of observed proxies of the latent confounder ( 23 ; 21 ; 25 ; 42 ; 41 ) . A criterion that allows the treatment of general latent-factor graphs is the latent-factor half-trek criterion (LF-HTC) of 3 , which applies exactly to our considered setting with latent variables that are independent and source variables. There also exist recent works such as 2 , 9 , or 39 , which generalize LF-HTC type methods to settings with causal effects among latents. Furthermore, there exist recent identification results from 18 for linear time series models having explicitly modelled latent confounding time series. Already for our latent-factor graph setting, there exist many graphs that are not identifiable via the LF-HTC, which to our knowledge is currently the most encompassing criterion, despite the fact that (rational) identifiability can be proven with computer algebra methods. In this paper, motivated by the aforementioned related results in the time series setting ( 18 ) , we propose a more general criterion for latent-factor graphs that is able to certify identifiability of direct effects for significantly more graphs. Example 1.1 (continued) . Consider again the model for total energy consumption of a household, with the graph from Figure 1 . It turns out

Read the complete text