GRACE : Gated Refinement for Accurate Causal Edge Discovery in High-Dimensional Time Series
Mohammad Fesanghary, Abhinav Havaldar · 2026
Read GRACE : Gated Refinement for Accurate Causal Edge Discovery in High-Dimensional Time Series by Mohammad Fesanghary, Abhinav Havaldar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-23880.txt.
Introduction
Fesanghary and Havaldar prune false causal links out of large time series datasets with a gated refinement step, in a 2026 paper on causal discovery. Finding which variables truly drive which others is central to climate science, neuroscience, and gene regulation. Constraint based methods are rigorous but their nonlinear tests become infeasible at scale. Score based methods need arbitrary thresholds to binarize their scores. GRACE starts from a fast linear test skeleton that keeps almost all true edges, false positives included.
Each candidate edge gets its own learnable gate, pushed toward fully open or fully closed by a sparsity penalty. Useful edges survive because they improve prediction. On synthetic networks up to one hundred variables, GRACE sharply improves accuracy over its base method at a fraction of the cost of full nonlinear testing. On Elbe River data it recovered nine of eleven causal edges.
Catalog record
| CREATOR | Mohammad Fesanghary, Abhinav Havaldar |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.23880
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GRACE : Gated Refinement for Accurate Causal Edge Discovery in High-Dimensional Time Series Mohammad Fesanghary, Abhinav Havaldar Abstract From climate teleconnections to gene regulation, modern time-series datasets encompass tens or hundreds of interacting variables, making causal discovery increasingly challenging. Constraint-based methods offer statistical rigor but their nonlinear CI tests are infeasible at scale, while score-based alternatives avoid CI testing but require arbitrary thresholds to binarize continuous edge scores. We propose GRACE ( G ated R efinement for A ccurate C ausal E dge discovery), which refines constraint-based discovery using Hard Concrete gates with L 0 L_{0} regularization—each candidate edge has an independent gate whose values concentrate near 0 or 1, yielding a clean bimodal separation that makes the binary decision robust—unlike the narrow, overlapping score distributions produced by L 1 L_{1} and attention-based methods. A fast linear CI skeleton provides high-recall candidates; a single gated model then prunes false positives by learning which edges genuinely improve prediction, with automatic regularization adapted to problem dimensions and skeleton density. Systematic experiments on synthetic benchmarks—spanning diverse graph topologies (scale-free, Erdős–Rényi, small-world) and dimensionalities up to d = 100 d=100 —show that GRACE substantially improves F1 over its base CI method while maintaining high precision, and outperforms attention-based and score-based alternatives. GRACE matches or exceeds expensive nonlinear CI tests at a fraction of the cost ( 75 × 75\times faster). On a real-world river flow dataset—where rainfall confounders, variable propagation lags, and distributional shifts violate standard assumptions—a temporal bootstrap variant of GRACE recovers 9 of 11 causal edges along the Elbe River, for example, with only 1 false positive ( F 1 = 0.86 F_{1}=0.86 , AUROC = 0.99 {}=0.99 ), reducing the skeleton’s 106 false positives by 99%. 1 Introduction Inferring causal relationships from observational time series is a central challenge in climate science, neuroscience, finance, gene regulatory network reconstruction, industrial root cause analysis, and many other fields ( Peters et al. 2017 ) . Given a multivariate time series \mathbf{x}_{t}=(x_{t}^{1},\ldots,x_{t}^{d}) with T observations, the goal is to recover the lagged causal graph G , where G[c,\ell,e]=1 indicates that variable x^{c} at lag \ell is a direct cause of variable x^{e} at time t . Two dominant families of methods have emerged for time-series causal discovery, each with complementary strengths and limitations. Score-based methods —Neural Granger Causality ( Tank et al. 2021 ) , NAVAR ( Bussmann et al. 2021 ) , DYNOTEARS ( Pamfil et al. 2020 ) , CUTS+ ( Cheng et al. 2024 ) —take a global optimization view, searching for the graph that best fits the data under a scoring criterion. They can capture nonlinear dependencies and scale to moderate dimensionality, but enforce sparsity through continuous penalties ( L_{1} or Gumbel-Softmax), requiring post-hoc weight thresholding to obtain a binary graph—and model misspecification or poor scoring assumptions can silently degrade the recovered graph. Attention-based methods like TCDF ( Nauta et al. 2019 ) similarly optimize a predictive objective but use attention weights as causal proxies; however, softmax normalization creates artificial competition among candidate parents, and attention thresholds must be dataset-tuned. Constraint-based methods —PCMCI/PCMCI+ ( Runge et al. 2019 ; Runge 2020 ) , CDNOTS ( Sadeghi et al. 2025 ) , SyPI+ ( Fesanghary and Gopal 2025 ) , LPCMCI ( Gerhardus and Runge 2020 ) —build causal graphs from conditional independence (CI) tests, offering interpretable, statistically principled inference without requiring a global scoring function. However, these tests are sensitive to sample size and conditioning-set dimension: nonlinear CI tests such as CMI ( Runge 2018 ) , KCIT ( Zhang et al. 2011 ) ( O(n^{3}) ), and RCoT ( Strobl et al. 2019 ) ( O(d_{f}^{2}n) for d_{f} Fourier features) remain costly at high d , forcing practitioners to rely on fast linear tests that miss nonlinear dependencies. For broader surveys, see Assaad et al. 2022 and Gong et al. 2023 . In this work, we propose GRACE (Gated Refinement for Accurate Causal Edge discovery), a framework for improving constraint-based causal discovery at high dimensionality. GRACE operates in two stages: first, a high-recall constraint-based method such as CDNOTS ( Sadeghi et al. 2025 ) or PCMCI ( Runge et al. 2019 ) produces a candidate skeleton; then, a gated neural model refines this skeleton by assigning each candidate edge an independent Hard Concrete gate ( Louizos et al. 2018 ; Maddison et al. 2017 ) trained with L_{0} regularization, whose gate values concentrate near 0 or 1, yielding a robust binary graph at a natural 0.5 threshold. The gated model learns which skeleton edges genuinely improve prediction, pruning false positives while preserving true causal links—narrowing the gap with expensive nonlinear CI tests at a fraction of the computational cost. Although our experiments focus on lagged effects ( \tau\geq 1 ), the framework natively supports contemporaneous (lag-0) edges: enabling lag-0 gates allows the same L_{0} mechanism to select among instantaneous candidates provided by the skeleton. Our contributions are: 1. The GRACE framework: A gated refinement stage that converts a high-recall skeleton into a high-precision causal graph via Hard Concrete gates with L_{0} regularization. The gating mechanism is independent of the skeleton source: we demonstrate it with both CDNOTS and PCMCI skeletons. 2. An empirically derived regularization rule (Eq. 12 ) that adapts \lambda to problem dimensions ( d , T ) and skeleton density, paired with L_{0} normalization that decouples regularization from batch size. 3. Real-world evaluation on the Elbe River network ( Stein et al. 2025 ) , where a temporal bootstrap variant—applying GRACE to random temporal windows and retaining edges that appear consistently—handles non-stationarity, hidden confounders, and variable lags without domain-specific heuristics. 2 Methodology 2.1 Problem Formulation Consider a d -variate stationary time series \{\mathbf{x}_{t}\}_{t=1}^{T} with \mathbf{x}_{t}\in\mathbb{R}^{d} . We assume a structural causal model with maximum lag L : x_{t}^{e}=f_{e}\!\left(\{x_{t-\ell}^{c}:G[c,\ell,e]=1\}\right)+\epsilon_{t}^{e},\quad\epsilon_{t}^{e}\sim\mathcal{N}(0,\sigma_{e}^{2}), (1) where G\in\{0,1\}^{d\times(L+1)\times d} is the lagged causal graph and f_{e} is the (possibly nonlinear) causal mechanism for effect variable e . The goal is to recover G from observations \{\mathbf{x}_{t}\}_{t=1}^{T} . The gated refinement stage assumes: (i) Causal sufficiency : there are no unobserved common causes; (ii) Finite lag : all causal effects occur within lags 0,\ldots,L ; (iii) Additive structure : effects combine additively across parents, though each individual effect f_{c,\ell\to e} can be nonlinear. Additional assumptions (e.g., stationarity) are inherited from the skeleton discovery algorithm; when using CDNOTS, nonstationarity is handled natively. Constraint-based method (e.g., CDNOTS, PCMCI) skeleton S mask Stage 1 Stage 2 x^{1}_{t-1} x^{2}_{t-1} \vdots x^{d}_{t-L} \mathbf{W}_{1,1} \mathbf{W}_{2,1} \mathbf{W}_{d,L} \vdots z_{1} z_{2} z_{D} \times \times \times \vdots \Sigma \text{MLP}_{e} \mu_{e},\sigma_{e} Inputs Encoder Gates Decoder shared per effect e Hard Concrete +\;L_{0} penalty Figure 1: GRACE two-stage pipeline. Stage 1 : A constraint-based method (e.g., CDNOTS or PCMCI) identifies candidate edges. Stage 2 : A gated model refines the skeleton—only edges in S have learnable Hard Concrete gates; all others are masked to zero. The L_{0} penalty drives gates toward exact zero or one, producing a bimodal distribution that makes the 0.5 decision boundary robust. 2.2 Gated Causal Model We construct a predictive model for each effect variable e , where candidate causal inputs are individually gated. The architecture consists of three components (Figure 1 ): shared encoder, per-effect gated aggregation, and per-effect decoder.