When Does Gene Regulatory Network Inference Break? A Controlled Diagnostic Study of Causal and Correlational Methods on Single-Cell Data
Miguel Fernandez-de-Retana, Rubén Sánchez-Corcuera, Unai Zulaika, Aritz Bilbao-Jayo, Aitor Almeida · 2026
Read When Does Gene Regulatory Network Inference Break? A Controlled Diagnostic Study of Causal and Correlational Methods on Single-Cell Data by Miguel Fernandez-de-Retana, Rubén Sánchez-Corcuera, Unai Zulaika, Aritz Bilbao-Jayo, Aitor Almeida (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-04930.txt.
Introduction
Miguel Fernandez-de-Retana and four co-authors ask when methods for inferring gene regulatory networks from single-cell data actually break down. Networks of gene control matter for understanding cells, yet causal methods often fail to beat simple correlation in realistic tests. Earlier benchmarks mixed many flaws at once, hiding which flaw hurt which method.
Their diagnostic framework isolates seven problems, including dropout, hidden confounders, mixed cell types, and feedback loops, and turns each up in turn. Across thousands of controlled experiments, causal methods did win in clean settings, but dropout and confounders removed that edge. Methods with similar scores also made quite different kinds of errors.
Catalog record
| CREATOR | Miguel Fernandez-de-Retana, Rubén Sánchez-Corcuera, Unai Zulaika, Aritz Bilbao-Jayo, Aitor Almeida |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.04930
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
When Does Gene Regulatory Network Inference Break? A Controlled Diagnostic Study of Causal and Correlational Methods on Single-Cell Data Miguel Fernandez-de-Retana, Rubén Sánchez-Corcuera, Unai Zulaika, Aritz Bilbao-Jayo, Aitor Almeida Abstract Despite theoretical advantages, causal methods for Gene Regulatory Network (GRN) inference from single-cell RNA-seq data consistently fail to match or outperform correlation-based baselines in many realistic benchmarks, a persistent puzzle which casts doubt on the value of causality for this task. We argue that existing benchmarks are insufficiently controlled to answer this question because they evaluate on real or semi-real data where multiple pathologies co-occur, confounding failure modes, and obscuring the specific conditions under which different inference methods excel or fail. To address this gap, we introduce a controlled diagnostic framework that isolates seven biologically motivated pathologies (dropout, latent confounders, cell-type mixing, feedback loops, network density, sample size, and pseudotime drift) and measure how six representative methods spanning three inference paradigms degrade as each pathology intensifies. Across 6,120 controlled experiments, we find that causal methods genuinely dominate in clean and structurally favorable regimes, but specific pathologies (notably dropout and latent confounders) selectively neutralize their advantages. We further introduce an error-type decomposition that reveals methods with similar aggregate accuracy commit qualitatively different errors. To probe whether single-pathology effects persist when multiple stressors co-occur, we perform an interaction sweep over the three most impactful pathologies and find that their joint effects are sub-additive, while also exposing density-conditional cross-overs invisible to single-dial analysis. Our findings offer a nuanced understanding of when and why different methods succeed or fail for GRN inference, providing actionable insights for method development and practical guidance for practitioners. 1 1 1 Code available at: https://github.com/miguelfrndz/GRN-Inference-Diagnosis Keywords: Benchmarks, Causal Inference, Computational Biology and Bioinformatics, Network Analysis, Systems Biology 1 Introduction Inferring Gene Regulatory Networks (GRNs) from single-cell transcriptomic data is a central problem in computational biology, with profound implications for understanding cellular function, disease mechanisms, drug response, and therapeutic interventions, among others ( 13 ; 2 ) . Fundamentally, a GRN is a directed graph \mathcal{G}=(V,E) encoding regulatory relationships where nodes ( V ) represent genes and edges ( E ) represent functional interactions, such as transcription factors activating or repressing target genes in specific cellular contexts. More formally, the problem of GRN inference can be framed as a structure learning task, where given expression data for p genes across n cells, the goal is to recover the directed adjacency matrix \mathbf{W}\in\mathbb{R}^{p\times p} of the underlying regulatory graph \mathcal{G} , where W_{ij}\neq 0 indicates a regulatory influence of gene i on gene j and the sign of W_{ij} indicates activation or repression. Historically, a wide variety of methods have been proposed for GRN inference, ranging from simple correlation-based approaches (e.g., Pearson correlation, mutual information) to more sophisticated causal inference methods (e.g., PC, GES, NOTEARS) that explicitly model the data-generating process and attempt to recover directed edges. Theoretically, causal methods should have a fundamental advantage: by modeling the underlying generative process, they can, in principle, distinguish direct regulatory interactions from indirect associations and confounding effects, leading to more accurate and interpretable GRN reconstructions. However, a growing body of empirical evidence reveals a puzzling finding: simple correlation-based methods such as Pearson correlation and GENIE3 ( 11 ) frequently match or outperform theoretically stronger causal inference methods on real single-cell data. This has been documented systematically by CausalBench ( 6 ) , which found that causal methods do not reliably outperform baselines on perturbational benchmarks, and by geneRNIB ( 19 ) , whose living benchmark reported that simple correlational models often outperformed more complex approaches. These findings have led some to question whether the additional complexity of causal methods is justified for GRN inference at all. We argue that this conclusion is premature. Existing benchmarks evaluate on real or semi-real data where multiple data pathologies, understood as biological or technical challenges that violate the assumptions of different inference methods, co-occur: dropout artifacts, latent confounders, cell-type heterogeneity, and non-stationarity are all present simultaneously. Because these pathologies are confounded with each other and with the unknown ground-truth, benchmarks are underpowered to attribute failures to specific causes. In other words, observing that method \mathcal{A} beats method \mathcal{B} on dataset \mathcal{D} does not tell us why , because we do not know which pathology (or combination of pathologies) is responsible for the performance gap. This lack of diagnostic resolution means we cannot identify the specific conditions under which different methods excel or break, and without knowing why, we cannot improve methods or advise practitioners. Our Approach. We introduce a controlled diagnostic framework inspired by ablation studies in Machine Learning (ML) and perturbation-based analyses to isolate method failure mechanisms under specific pathologies and quantify their impact on performance. We construct a synthetic simulator building upon the previous work by 10 that generates single-cell expression data from a known linear structural causal model with seven independently controllable pathology “dials” . Each dial corresponds to a specific biological or technical challenge: dropout, latent confounders, cell-type mixing, feedback loops, network density, sample size, and non-stationarity along a pseudotime trajectory (pseudotime drift). By sweeping one dial at a time while holding all others fixed, we isolate the mechanism of failure for each pathology and quantify its impact on performance. This approach allows us to answer questions such as: Does dropout selectively neutralize the advantage of causal methods? Do latent confounders degrade all methods equally? Are some methods more robust to feedback loops than others? By systematically characterizing the degradation patterns of six representative methods spanning three inference paradigms (correlational, tree-ensemble, and causal), we provide a thorough understanding of when and why methods succeed or fail for GRN inference. We evaluate six representative methods spanning five method classes: correlational (Pearson, mutual information), tree-ensemble (GENIE3), constraint-based causal (PC), score-based causal (GES), and optimization-based causal (NOTEARS); using two complementary metrics: Area Under the Precision–Recall Curve (AUPRC) for characterizing the edge-recovery accuracy of each method as pathology intensifies, and a novel error-type decomposition that classifies each predicted edge as true, reversed, confounded, spurious, or missed. Key Findings. Across 2,100 controlled experiments ( 7 pathologies \times 5 levels \times 10 replicates \times 6 methods) for both linear and nonlinear SCMs, and a complementary interaction sweep over dropout, latent confounders, and density, we find that no method breaks uniformly: causal methods (NOTEARS, GES) dominate under clean conditions (AUPRC >0.94 ) and remain the top performer at the hardest level of 6 of the 7 pathology dimensions, but heavy dropout is the exception, where Pearson correlation outperforms all methods. Dropout is also the most discriminating: MI and GENIE3 collapse ( \Delta AUPRC \approx-0.7 ), while Pearson degrades gracefully ( \Delta AUPRC =-0.28 ). Latent confounders and cell-type mixing are the great equalizers, compressing all methods into narrow bands at comparable rates. Error decomposition shows that similar aggregate AUPRC can hide qualitatively different behaviors (e.g., methods may differ in whether their errors are orientation reversals, confounder-induced false positives, or pure hallucinations). Finally, the interaction sweep shows that joint pathologies degrade performance markedly less than the sum of their individual effects, while also revealing density-conditional cross-overs invisible to single-dial analysis. 2 Related Work GRN Inference Benchmarks. BEELINE ( 21 ) benchmarked 12 algorithms on synthetic (BoolODE) and curated networks, establishing AUROC