Causal representation learning from network data

Jifan Zhang, Michelle M. Li, Elena Zheleva · 2025

Read Causal representation learning from network data by Jifan Zhang, Michelle M. Li, Elena Zheleva (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-01916.txt.

Introduction

Jifan Zhang, Michelle M Li, and Elena Zheleva learn causal structure from network data with the help of known interaction maps. Causal disentanglement, pulling apart true cause programs, is possible under set assumptions with both plain and intervened data. Past work ignored the known networks that link measured items, like protein interaction maps. Their model treats pathway membership as an extra view of the hidden causal programs.

A graph neural encoder uses the biology graph and pathway view to sharpen inference. The decoder stays a causal model with soft interventions. Theory shows the method keeps the identifiability guarantees of its base family. Tests on three CRISPR perturbation sets, where genes are edited, show better forecasts of intervention results, even for unseen edit combos.

Catalog record

CREATORJifan Zhang, Michelle M. Li, Elena Zheleva
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-01916

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Causal representation learning from network data Jifan Zhang, Michelle M. Li, Elena Zheleva Abstract Causal disentanglement from soft interventions is identifiable under the assumptions of linear interventional faithfulness and availability of both observational and interventional data. Previous research has looked into this problem from the perspective of i.i.d. data. Here, we develop a framework, GraCE-VAE , for non-i.i.d. settings, in which structured context in the form of network data is available. GraCE-VAE integrates discrepancy-based variational autoencoders with graph neural networks to jointly recover the true latent causal graph and intervention effects. We show that the theoretical results of identifiability from i.i.d. data hold in our setup. We also empirically evaluate GraCE-VAE against state-of-the-art baselines on three genetic perturbation datasets to demonstrate the impact of leveraging structured context for causal disentanglement. Introduction Discovering the causal factors underlying data and how they influence each other is a key challenge in machine learning. Early disentangled representation learning methods have aimed to learn latent features that correspond to distinct generative factors, typically assuming that these factors are statistically independent ( Higgins et al. 2018 ; Kumar, Sattigeri, and Balakrishnan 2017 ; Higgins et al. 2017 ) . However, this assumption rarely holds in real-world scenarios, where generative factors often exhibit intricate dependencies. This realization has led to causal disentanglement approaches, which relax the independence assumption by modeling latent factors as nodes in a causal graph that can influence each other, i.e. the structural causal model (SCM). Recent works have begun learning such causal representations from data, for instance, by integrating SCM constraints into variational autoencoders (VAEs) ( Yang et al. 2021 ; Zhang et al. 2023 ) . These methods show that with appropriate data (including interventions) and assumptions, one can recover the latent causal model up to equivalence and predict intervention outcomes. Notably, Zhang et al. 2023 prove that even when the true causal variables are unobserved, a combination of observational and interventional data is sufficient to identify the latent causal directed acyclic graph (DAG) up to permutations of equivalent factors and to accurately extrapolate to novel interventions. Such progress provides a foundation for causal representation learning in complex settings. While causal disentanglement has advanced for i.i.d. data, many real-world data come in the form of network data with rich relational structure among the entities. Examples include social networks, where users are connected by friendships and hidden traits may influence their behaviors, and biological networks, where genes or proteins may interact via unobserved regulatory factors. In such cases, the observed variables \mathbf{X} are nodes connected by various relations (e.g., friendship, genetic interactions) and there may exist additional nodes \mathbf{H} (e.g., communities, biological pathways) that group the nodes and mediate these relations. However, existing causal representation learning methods largely ignore relational structure. They typically assume a flat data distribution and do not exploit known links between the entities. Conversely, graph-based inference methods in the literature often assume that the causal graph is fully/partially known ( Feng, Zhang, and Yang 2023 ; Sanchez-Martin, Rateike, and Valera 2021 ) or consider only observable interventions on known nodes ( Khemakhem et al. 2021 ) . This leaves a significant gap: There is no general framework to learn a latent causal model from data that is relational nor can handle the realistic setting where the intervened variables are latent and unknown. In this paper, we introduce a novel approach, Graph-Aware Causal Effects Variational AutoEncoder ( GraCE-VAE ), that combines graph neural networks with deep generative modeling to discover latent causal factors from network data enriched with interventions. At a high level, GraCE-VAE extends the VAE framework to incorporate an external network data’s structure among the entities. The encoder of GraCE-VAE is a graph neural network (GNN) that processes the heterogeneous network data of observed nodes ( \mathbf{X} -entities), their observed group nodes ( \mathbf{H} -entities), and various relationships between them. This GNN-based encoder passes messages along the observed edges, capturing structural context (e.g., connectivity patterns and neighbor attributes) to produce enriched embeddings for the \mathbf{X} nodes. These structure-aware embeddings are then fed into a variational inference network to approximate the posterior over latent variables. By doing so, the encoder infuses information from the network into the inferred latent representation, biasing the model towards explanations consistent with the relational patterns. The decoder of GraCE-VAE instantiates an SCM over the latent variables. In particular, the decoder learns a DAG that captures the hypothesized causal structure among the latent factors. Interventions are modeled through a two-stage process. First, an intervention encoder maps each intervention indicator to a soft selection over latent variables and a proposed mechanism modification. Then, the decoder applies this modification by altering the causal mechanism of the selected latent variable, while leaving others unchanged. GraCE-VAE simultaneously learns: (1) the latent causal graph G , (2) the correspondence of interventions to latent targets via the intervention encoder’s assignments, and (3) a generative model capable of simulating interventional outcomes on the observed network. This work has three key contributions : • We propose a framework for latent causal discovery that leverages structured context. GraCE-VAE , a variational graph autoencoder for causal disentanglement, jointly learns a latent causal graph and intervention effects that are informed by prior knowledge (via heterogeneous network data). Unlike existing methods that assume a given causal graph, fully observed variables, or independent observations, GraCE-VAE discovers the latent causal structure, guided by both network connectivity and intervention data. • We show that our method, GraCE-VAE , inherits identifiability guarantees for causal representation learning ( Zhang et al. 2023 ) . In other words, GraCE-VAE ’s learned causal model is theoretically identifiable up to equivalence under the assumptions of linear interventional faithfulness and conditional independence. • Through comprehensive experiments with 3 benchmark datasets on genetic perturbations, we empirically demonstrate that GraCE-VAE reliably recovers the true latent causal graph and outperforms state-of-the-art baselines on predicting intervention outcomes for unseen perturbation combinations. Ablations on GraCE-VAE show that both the graph-based encoder and the causal decoder are crucial to its success; removing either component degrades both structure learning and predictive accuracy. Overall, GraCE-VAE offers a new approach to uncovering latent causal factors in complex network systems, pushing the state of the art in both causal discovery and graph representation learning. It addresses a critical gap by unifying relational information and intervention-based causal inference, leading to more reliable causal analysis. Related Works Causal disentanglement learning The concept of disentangled representation is formally defined by Higgins et al. 2018 . A representation is considered disentangled if it can be decomposed into independent features such that altering a single factor of the input data affects only one corresponding feature. Most disentangled representation learning methods are based on generative models, particularly VAEs ( Kumar, Sattigeri, and Balakrishnan 2017 ; Higgins et al. 2017 ; Zhu, Xu, and Tao 2021 ) . VAEs approximate the unknown true posterior p(z|x) using a variational posterior q(z|x) . To enhance disentanglement, researchers have introduced various regularization techniques to the original VAE loss function. For instance, \beta -VAE ( Higgins et al. 2017 ) incorporates a penalty coefficient into the Evidence Lower Bound (ELBO) loss to enforce a stronger independence constraint on the posterior distribution q(z|x) . Some studies have disagreed

Read the complete text