Causal Discovery on Dependent Mixed Data with Applications to Gene Regulatory Network Inference
Alex Chen, Qing Zhou · 2026
Read Causal Discovery on Dependent Mixed Data with Applications to Gene Regulatory Network Inference by Alex Chen, Qing Zhou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-24783.txt.
Introduction
Chen and Zhou tackle causal discovery on dependent data with mixed continuous and discrete variables. Most methods assume samples are independent, which modern datasets often violate. Their framework uses a structural equation model with latent variables and correlated Gaussian errors across units. A pairwise likelihood estimator recovers how the samples depend on each other. An EM algorithm fills in the latent values behind discrete data. After de-correlation, standard tools learn the graph. Tests show much better recovery than ignoring it, with gene networks as the target use.
Catalog record
| CREATOR | Alex Chen, Qing Zhou |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68374 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.24783
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Causal Discovery on Dependent Mixed Data with Applications to Gene Regulatory Network Inference Alex Chen, Qing Zhou Abstract Causal discovery aims to infer causal relationships among variables from observational data, typically represented by a directed acyclic graph (DAG). Most existing methods assume independent and identically distributed observations, an assumption often violated in modern applications. In addition, many datasets contain a mixture of continuous and discrete variables, which further complicates causal modeling when dependence across samples is present. To address these challenges, we propose a de-correlation framework for causal discovery from dependent mixed data. Our approach formulates a structural equation model with latent variables that accommodates both continuous and discrete variables while allowing correlated Gaussian errors across units. We estimate the dependence structure among samples via a pairwise maximum likelihood estimator for the covariance matrix and develop an EM algorithm to impute latent variables underlying discrete observations. A de-correlation transformation of the recovered latent data enables the use of standard causal discovery algorithms to learn the underlying causal graph. Simulation studies demonstrate that the proposed method substantially improves causal graph recovery compared with applying standard methods directly to the original dependent data. We apply our approach to single-cell RNA sequencing data to infer gene regulatory networks governing embryonic stem cell differentiation. The inferred regulatory networks show significantly improved predictive likelihood on test data, and many high-confidence edges are supported by known regulatory interactions reported in the literature. and ?? Department of Statistics and Data Science, University of California, Los Angeles ?? 1 Introduction Causal discovery aims to identify the underlying causality among variables from observed data. It is usually formalized through the framework of directed acyclic graphs (DAGs), where the nodes of a DAG represent random variables and edges encode causal relationships between variables. Specifically, let V=\{V_{1},\ldots,V_{p}\} denote a set of p random variables, and let \mathcal{G}=(V,E) be a DAG with variable (node) set V and edge set E such that an edge i\rightarrow j\in E implies V_{i} is a direct cause of V_{j} . A causal discovery method learns the structure (i.e., the edge set) of the underlying DAG that best explains the observed conditional independencies among the variables. The directed edges in the learned graph indicate which variables directly influence others, thereby distinguishing association from causation. Causal discovery methods are commonly separated into three categories: constraint-based, score-based, and hybrid approaches. 10 and 21 provide comprehensive reviews of causal discovery methods. Here, we briefly review the most classical algorithms from each category. Constraint-based methods perform a sequence of conditional independence tests to systematically identify and orient edges in a graph. Typically, these methods begin with a complete undirected graph over the observed variables and then iteratively prune edges when two variables are conditionally independent given a set of other observed variables. The result of the pruning stage is a skeleton, which is then oriented using logical orientation rules derived from graph properties such as v-structures and acyclicity as introduced by 18 . The most well-known constraint-based method is the PC algorithm ( 26 ) . Score-based methods search over a space of graphs to identify a DAG or an equivalence class of DAGs that maximizes a predefined scoring function. A commonly used example is the Bayesian Information Criterion (BIC) ( 23 ) , which balances goodness of fit with model complexity by penalizing overly complex graphs. Common examples of score-based methods include Greedy Equivalence Search (GES) ( 5 ) and Greedy Hill Climbing ( 9 ) , both of which iteratively modify the graph in order to improve the score. Hybrid methods integrate both approaches, constraint and score-based learning, in order to leverage different strengths of each approach. One example is the Max-min Hill-Climbing (MMHC) algorithm ( 27 ) . MMHC first uses conditional independence tests to identify a skeleton. Then, a score-based search is used to orient the edges in the learned skeleton by selecting directions that maximize the scoring criterion. 1.1 Motivation Most causal discovery methods rely on a key assumption: observations (units) are independent and identically distributed (i.i.d.). However, this assumption is often violated in real-world applications, where dependence among samples naturally arises. For instance, in social network analysis, individuals’ behaviors are influenced by their social connections, such as friends, families, or colleagues, resulting in interdependent features across individuals. Another layer of complexity arises when the data consists of both continuous and discrete variables. Social network data can contain a mixture of continuous engagement metrics, binary indicators, and categorical demographic variables. In genomics, some variables are typically represented as discrete states, such as the presence or absence of a protein in the cell, while other variables, say the expression levels of genes, vary continuously. It is also a common practice to discretize gene expression levels depending on the data quality and generation mechanisms. Mixed data can be particularly challenging when we model between-sample dependence, since it is not straightforward to introduce dependence in the discrete data among different units. To address these challenges, we propose a DAG model for mixed data with sample dependence and develop a de-correlation method that facilitates the structure learning of causal DAGs under these settings. Although our method is broadly applicable across a range of data domains, the primary application in this work is the inference of gene regulatory networks (GRNs) from single-cell RNA sequencing (scRNA-seq) data. We model a GRN by a causal DAG, where a directed edge V_{i}\rightarrow V_{j} implies that gene i directly regulates the expression of gene j . Cells may originate from the same lineage or follow shared differentiation trajectories, leading to implicit association in gene expression patterns. Such dependency structures induce intrinsic correlations among cells, which may be further amplified by technical factors such as batch effects. As another example, intercellular signaling and spatial organization create structured dependence among cells ( 1 ) , leading to correlated gene expression patterns. As a result, gene expression measurements in scRNA-seq data may violate the i.i.d. assumption underlying many standard causal discovery methods. Moreover, gene expression can be represented as a combination of continuous and discretized data, yielding a mixed data setting. GRN inference methods have been developed specifically for single-cell applications. 22 provide a comprehensive benchmark study of various GRN inference methods using synthetic GRNs and evaluates their performance across multiple criteria. Among the top performing methods, GENIE3 ( 12 ) performs GRN inference via a series of regression problems. Specifically, for each target gene, a tree-based ensemble model (e.g. random forest) is trained to predict its expression as a function of all other genes. Feature importance scores are aggregated across models to infer regulatory edges. Similarly, GRNBoost2 ( 20 ) builds upon GENIE3 by using gradient boosting machines to improve performance and scalability to large single-cell datasets. Both GENIE3 and GRNBoost2 rely on predictive models for the conditional distribution [V_{i}|V_{-i}] . As such, the resulting regulatory network captures statistical dependencies but lack a causal interpretation. Another top performing method, PIDC ( 3 ) , infers GRN structures via an information-theoretic method based on mutual information between gene pairs but only estimates an undirected network. While these methods have demonstrated empirical results in recovering plausible biological interactions in single-cell data, they all rely on the implicit assumption that