Causal Ordering for Structure Learning From Time Series

Pedro P. Sanchez [email protected], Damian Machlanski [email protected], Steven McDonagh [email protected], Sotirios A. Tsaftaris [email protected] · 2025

Read Causal Ordering for Structure Learning From Time Series by Pedro P. Sanchez [email protected], Damian Machlanski [email protected], Steven McDonagh [email protected], Sotirios A. Tsaftaris [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-24639.txt.

Introduction

Pedro P Sanchez, Damian Machlanski, Steven McDonagh, and Sotirios A Tsaftaris study how to find cause links in data that change over time. Such links matter in the body, the brain, the weather, and markets. A common shortcut picks one time order of the parts, but that choice cuts what the final map can show.

Their method, DOTS, uses more than one valid order at once. By joining the orders, it can rebuild more of the true cause map and dodge fake links. It uses a spread based score trick to gauge curve shape fast. Broad tests back the claim and show gains over one order ways.

Catalog record

CREATORPedro P. Sanchez [email protected], Damian Machlanski [email protected], Steven McDonagh [email protected], Sotirios A. Tsaftaris [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE76 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-24639

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Causal Ordering for Structure Learning From Time Series Pedro P. Sanchez [email protected], Damian Machlanski [email protected], Steven McDonagh [email protected], Sotirios A. Tsaftaris [email protected] Abstract Predicting causal structure from time series data is crucial for understanding complex phenomena in physiology, brain connectivity, climate dynamics, and socio-economic behaviour. Causal discovery in time series is hindered by the combinatorial complexity of identifying true causal relationships, especially as the number of variables and time points grow. A common approach to simplify the task is the so-called ordering-based methods. Traditional ordering methods inherently limit the representational capacity of the resulting model. In this work, we fix this issue by leveraging multiple valid causal orderings, instead of a single one as standard practice. We propose DOTS ( D iffusion O rdered T emporal S tructure), using diffusion-based causal discovery for temporal data. By integrating multiple orderings, DOTS effectively recovers the transitive closure of the underlying directed acyclic graph, mitigating spurious artifacts inherent in single-ordering approaches. We formalise the problem under standard assumptions such as stationarity and the additive noise model, and leverage score matching with diffusion processes to enable efficient Hessian estimation. Extensive experiments validate the approach. Empirical evaluations on synthetic and real-world datasets demonstrate that DOTS outperforms state-of-the-art baselines, offering a scalable and robust approach to temporal causal discovery. On synthetic benchmarks ( d = 3 − 6 d{=}\!3-\!6 variables, T = − 5,000 T{=}200\!-\!5{,}000 samples), DOTS improves mean window-graph F ​ 1 F1 from 0.63 0.63 (best baseline) to 0.81 0.81 . On the CausalTime real-world benchmark ( d = − 36 d{=}20\!-\!36 ), while baselines remain the best on individual datasets, DOTS attains the highest average summary-graph F ​ 1 F1 while halving runtime relative to graph-optimisation methods. These results establish DOTS as a scalable and accurate solution for temporal causal discovery. 1 Introduction Understanding cause-effect relationships from time series data is essential in fields like biology ( Marbach et al. 2009 ) , neuroscience ( Friston et al. 2003 ) , climate science ( Runge et al. 2019 ) , and economics ( Pamfil et al. 2020 ) , where uncovering how one event influences another can lead to valuable insights and better predictions. A key challenge in temporal causal discovery ( Granger 1969 ; Peters et al. 2013 ; Nauta et al. 2019 ; Runge 2020 ) is the combinatorial complexity—there are many possible ways that variables can influence each other, making it difficult to identify the true causal structure. The goal is to discover a temporal Directed Acyclic Graph (DAG), {\mathcal{G}} , representing these relationships. The core problem is illustrated in Figure 1 . Causal ordering approaches ( Verma & Pearl 1990 ; Friedman & Koller 2003 ; Bühlmann et al. 2014 ; Rolland et al. 2022 ; Sanchez et al. 2023 ) offer a scalable alternative to direct graph estimation by constraining the search space, reducing it from a full adjacency matrix to a set of ordered permutations. While this reduction scales efficiently with respect to the number of variables and samples, it compromises representational power: a single causal ordering can imply extra edges, spurious artifacts, that are absent in the original DAG. In other words, committing to a single arbitrary ordering has an inherent downside: every node is deemed a potential ancestor of all subsequent nodes, creating spurious edges that must be pruned heuristically. To mitigate this, existing methods employ a two-step process, wherein a feature selection post-processing step prunes spurious artifacts introduced by the ordering. Crucially, a DAG generally admits multiple valid orderings consistent with edge directions. Each ordering contributes complementary information about the underlying causal structure. By systematically generating and aggregating information from diverse orderings, we can filter out the spurious artifacts specific to any single, arbitrary ordering choice. As we aggregate more orderings, we converge towards the transitive closure ( {\mathcal{G}}^{+} ) of the underlying temporal DAG. {\mathcal{G}}^{+} contains all true direct edges present in {\mathcal{G}} . While {\mathcal{G}}^{+} also includes edges representing indirect causal pathways, it represents the stable, necessary ancestral relationships to recover the true graph. Therefore, harnessing several orderings increases both precision and recall and does so without incurring the combinatorial cost of full graph search. Our central insight is to embrace this multiplicity rather than fight it. The benefit of multiple orderings hinges on access to a diverse collection of valid orderings. Naïve resampling or greedy heuristics tend to revisit near-duplicate permutations. We address this limitation by drawing on denoising diffusion models ( Song & Ermon 2019 ; Ho et al. 2020 ; Sanchez et al. 2023 ) . Once trained to approximate the data score, a single diffusion network delivers Hessian estimates at many noise scales ; applying a leaf-detection rule at each scale yields a fresh ordering. Because different scales emphasise different frequency bands of the data, the resulting orderings cover the search space more uniformly. Moreover, diffusion training amortises computation—after one network fit we can sample hundreds of orderings without retraining—making the approach viable for datasets that are large w.r.t. variables and samples. Finally, causal ordering approaches have not been extensively explored for temporal causal discovery, but their principles naturally extend to time-dependent data. Our focus on the temporal setting is motivated by two key advantages: (i) temporal constraints provide additional structural information that enhances ordering reliability through the temporal priority principle, and (ii) the temporal priority principle offers a natural filtering mechanism for spurious edges. The temporal dimension provides an inherent set of causal orderings, each contributing incremental insights. Input {\mathbf{x}}^{T\times d} Time ( t ) Target \mathcal{G} {\lx@inpgf@ignorespaces x_{1}^{t}} {\lx@inpgf@ignorespaces x_{1}^{t+1}} {\lx@inpgf@ignorespaces x_{1}^{t+2}} {\lx@inpgf@ignorespaces x_{2}^{t}} {\lx@inpgf@ignorespaces x_{2}^{t+1}} {\lx@inpgf@ignorespaces x_{2}^{t+2}} {\lx@inpgf@ignorespaces x_{3}^{t}} {\lx@inpgf@ignorespaces x_{3}^{t+1}} {\lx@inpgf@ignorespaces x_{3}^{t+2}} Learn structure Figure 1 : Temporal causal discovery estimates, from raw time series data ( left ), the underlying temporal causal DAG \mathcal{G} ( right ). Building on these ideas, we introduce DOTS ( D iffusion - O rdered T emporal S tructure), a theoretically motivated ensemble-based approach for temporal causal discovery that systematically aggregates multiple diffusion - generated orderings . Our contributions are three - fold: (i) We establish theoretically and empirically that aggregating multiple causal orderings to estimate the transitive closure ( {\mathcal{G}}^{+} ) provides a more robust foundation for temporal causal discovery than traditional single-ordering approaches, effectively filtering spurious edges arising from arbitrary ordering choices. (ii) We introduce DOTS, a novel algorithm leveraging multi-scale diffusion models to efficiently generate the diverse set of causal orderings required for robust aggregation in the temporal domain. (iii) We provide extensive benchmarks, adapting several static ordering methods for temporal data and demonstrating the superior performance of the multi-ordering strategy implemented by DOTS against both these adapted methods and state-of-the-art temporal causal discovery baselines on synthetic and real-world datasets. The rest of the paper is organised as follows. Section 2 reviews notation and identifiability assumptions. Section 3 establishes the theoretical foundations of multi - ordering aggregation, and Section 4 presents the DOTS algorithm in detail. Section 5 shows experimental results. Relevant literature is discussed in Section 6 . Section 7 concludes the paper. 2 Preliminaries 2.1 Notation We present in Table 1 a description of all the symbols in the manuscript. Table 1: Summary of notation used throughout the paper. Symbol Meaning / role

Read the complete text