Learning a directed acyclic graph with additive heteroscedastic errors
Xintao XiaLi ChenYue Hu, Chunlin Li · 2026
Read Learning a directed acyclic graph with additive heteroscedastic errors by Xintao XiaLi ChenYue Hu, Chunlin Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-26515.txt.
Introduction
Xintao Xia and three colleagues learn directed acyclic graphs under heteroscedastic errors. They prove new results showing uneven noise can reveal which way causation runs. Their RESQUE method repeats two steps: building residuals, then composite quantile fits, finding sink nodes one by one through scale coefficients that stay steady across quantiles. Theory backs recovery of node order and graph shape even as variable count grows with sample size. Simulations and benchmark data favor RESQUE over older methods, especially when causal facts hide partly in spread rather than averages.
Catalog record
| CREATOR | Xintao XiaLi ChenYue Hu, Chunlin Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63900 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.26515
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning a directed acyclic graph with additive heteroscedastic errors Xintao XiaLi ChenYue Hu, Chunlin Li Abstract This paper studies causal discovery for a directed acyclic graph under a structural equation model with additive heteroscedastic errors. We first establish new identifiability results for location-scale noise models, showing that heteroscedasticity can be leveraged to recover causal directions. Based on these insights, we propose a novel iterative procedure, Residual Simultaneous Quantile Estimation (RESQUE), where each iteration consists of a residual-construction stage and a composite quantile regression stage, enabling recursive identification of sink nodes via the invariance of conditional scale coefficients across quantiles. We then establish its theoretical guarantees for recovering topological order and graph structure, even when the number of variables diverges with the sample size. Simulation studies and application to benchmark datasets show that RESQUE performs favorably compared with existing methods, especially when causal information is partly encoded in the variance component. These results highlight exploiting structured variance signals for causal discovery and provide a principled framework for multivariate causal discovery beyond mean-based modeling. Keywords: Causal discovery; Composite quantile regression; Identifiability; Location-scale noise models. 1 Introduction Establishing causal relations enables formal reasoning about interventions and counterfactuals, and has been an important topic in modern science and engineering, with applications in biology ( 43 ; 31 ) , econometrics ( 58 ) , psychometrics ( 6 ) , industrial manufacturing ( 60 ) , dynamical systems 29 , artificial intelligence ( 44 ) , and other domains. While randomized experiments are the gold standard for causality, they are often unethical or infeasible. Causal discovery aims to learn causal relations among variables from observational data ( 17 ) , moving beyond statistical associations to determine the direction of effects. It is useful for formulating data-driven conjectures in scientific studies and is viewed as a crucial step towards building automated learning and reasoning systems ( 44 ) . Formally, causal relations among variables are often represented using a directed acyclic graph (DAG) ( 48 ; 37 ) , a directed graph with no directed cycles, where nodes represent variables of interest, directed edges encode direct causal effects, and the absence of an edge indicates the lack of a direct causal relation. The acyclicity constraint rules out feedback loops, ensuring that the associated data-generating process is well defined ( 40 ) . The goal of causal discovery is to reconstruct the underlying DAG. With solely observational data, determining causal directions is impossible without additional identifiability assumptions on the data-generating process, which is often described by a structural equation model (SEM). Such identifiability assumptions often impose restrictions on the function class or error distributions in the SEM. From a modeling perspective, these conditions reflect a researcher’s inductive bias toward simplicity, modularity, and interpretability in the underlying causal mechanisms. For example, LINGAM assumes linear structural equations while requiring the errors to be non-Gaussian and homoscedastic ( 47 ) ; SEMs with homoscedastic Gaussian additive errors require the functions to be nonlinear and smooth ( 40 ) . Recently, due to the prevalence of heteroscedasticity observed in data, causal models with heteroscedastic errors have received increasing attention ( 23 ; 59 ; 54 ; 62 ; 30 ) ; however, they mainly focus on bivariate cases while multivariate causal discovery remains understudied. The challenge is two-fold. First, existing identifiability results ( 23 ; 51 ; 30 ) are not applicable to bounded variables. It is still unclear under what assumptions the DAG is identifiable when there are bounded and/or unbounded (continuous) variables. Second, likelihood-based methods are prone to parametric misspecification in heteroscedastic models 52 ; 46 , leading to inconsistent estimation. Meanwhile, independence testing based methods, such as those based on HSIC ( 67 ) or mutual information ( 51 ) , often require sample splitting and struggle in high dimensions ( 7 ) , as they do not fully exploit the structured signals in variance components. In this work, we study causal discovery under an SEM with heteroscedastic errors and address the above questions. Specifically, we contribute to the following aspects: 1. We establish new identifiability results for DAGs with additive heteroscedastic errors. These results unify the identifiability theory for both bounded and unbounded continuous variables in multivariate causal discovery, accommodating practically important yet largely overlooked scenarios. In particular, we find that causal discovery among bounded variables requires much milder conditions than for unbounded variables, thereby complementing the existing theory. 2. We propose a novel iterative estimation procedure, Residual Simultaneous Quantile Estimation (RESQUE), with each iteration consisting of a residual construction step and a composite quantile regression step, integrated with shrinkage techniques to exploit heteroscedastic errors. The proposed approach recursively identifies sink nodes via their parallel conditional quantiles. Thus, it examines error independence rather than optimizing a likelihood function, circumventing the reliance on parametric specification. It exploits the structured, sparse signals in variance components by transforming independence testing to feature selection. In this way, RESQUE avoids sample splitting and many high-dimensional (nonparametric) independence tests, leading to improved performance in causal discovery. 3. We analyze the theoretical properties of RESQUE and prove its consistency for order and graph estimation. The simulations and real-data benchmarks demonstrate the strong performance of RESQUE, consistent with our motivation and theoretical analysis. The central message is two-fold: bounded variables help with the identifiability of heteroscedastic SEMs, and structured causal signals in heteroscedastic patterns should be exploited for multivariate causal discovery. Related work. Causal discovery has been extensively studied; see 21 ; 17 ; 56 for comprehensive reviews. Broadly, there are four distinct but interconnected approaches to causal discovery from solely observational data. (a) Constraint-based methods 49 ; 19 ; 50 test conditional independence to infer the underlying causal graph up to its Markov equivalence classes. (b) Asymmetry-based methods exploit the algebraic asymmetry implied by SEMs to determine the causal order. Prominent examples include order-based approaches 40 ; 69 and independent component analysis approaches 47 ; 65 . (c) Score-based methods estimate the causal graph by optimizing a certain criterion function over a discrete 12 or a continuous search space 70 ; 26 . (d) Hybrid methods 55 ; 10 seek to combine a constraint-based approach with an asymmetry- or score-based approach. Our work belongs to the family of asymmetry-based methods. Among the above approaches, (b)–(d) often introduce an SEM, also called functional causal model, to describe the data-generating process, where the underlying DAG is induced by the SEM. Thus, the identifiability of the SEM has been a central topic in causal discovery 47 ; 66 ; 65 ; 22 ; 39 ; 40 ; 9 ; 36 . Notably, 47 studies multivariate linear SEMs with non-Gaussian errors; 65 comprehensively characterizes bivariate post-nonlinear causal models; 40 thoroughly discusses the identifiability of multivariate additive noise models (ANMs); and 23 ; 51 ; 30 offer identifiability results for heteroscedastic SEMs. Nonetheless, most work has focused exclusively on continuous variables with full (unbounded) support. Exceptions include 39 , which discusses ANMs with discrete variables, and 9 , which studies ANMs with compactly supported variables and smooth monotonic functional relations. Our work adds to the prior literature by offering a unifying identification for multivariate heteroscedastic SEMs with bounded and unbounded continuous variables. Organization. The rest of the paper is