‘Si’multaneous ‘S’patial-‘T’emporal Message Passing for Dynamic Graph Representation Learning

Shubhajit Roy [email protected], Anirban Dasgupta [email protected] · 2026

Read ‘Si’multaneous ‘S’patial-‘T’emporal Message Passing for Dynamic Graph Representation Learning by Shubhajit Roy [email protected], Anirban Dasgupta [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25548.txt.

Introduction

Shubhajit Roy and Anirban Dasgupta fuse space and time inside one graph message pass. Temporal-first and spatial-first networks force the second stage to read a compressed summary from the first, so a neighbor's past path never weights its message. SiST-GNN keeps a history state per node, pairs it with current features across a cross-time edge, and runs convolution on the augmented graph. It leads methods on link prediction and live-update sets, and beats discrete-time baselines on classification tasks.

Catalog record

CREATORShubhajit Roy [email protected], Anirban Dasgupta [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60799
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.25548

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

‘Si’multaneous ‘S’patial-‘T’emporal Message Passing for Dynamic Graph Representation Learning Shubhajit Roy [email protected], Anirban Dasgupta [email protected] Abstract Dynamic graph neural networks (DGNNs) that operate on snapshot sequences typically fall into one of two categories. Temporal-first approaches build per-node temporal embeddings and only afterwards perform spatial aggregation, whereas Spatial-first approaches invert this order, feeding the output of a graph convolution into a downstream temporal module. In either case, the rigid sequencing forces the second stage to consume an already-compressed summary produced by the first, ruling out joint reasoning over topology and evolution; concretely, the message-passing operator never gets to weight a neighbor’s contribution by that neighbor’s past trajectory. This paper introduces SiST-GNN ( Si multaneous S patial- T emporal GNN ), which fuses the two signals inside a single message-passing operation rather than chaining them. Concretely, at each snapshot we maintain a recurrent hidden state per node that summarises its history, pair it with the node’s current feature vector, and treat the pair as two nodes joined by a cross-time edge; running a standard graph convolution on this temporally augmented graph yields the updated representation. Our empirical study spans nine public baselines and fourteen model-dataset combinations, covering both fixed-split and live-update evaluation regimes. Across every public benchmark, SiST-GNN sets a new state of the art in link prediction task over the strongest prior method by 109 109 – 277 % 277\% in the fixed-split setting and by 68 68 – 194 % 194\% in the live-update setting. We additionally construct three dynamic node-classification tasks by discretising the underlying continuous-time event streams; here SiST-GNN beats the leading discrete-time (DTDG) baseline by 7 7 – 22 % 22\% and matches continuous-time (CTDG) methods that consume the raw events directly. 1 Introduction Most consequential relation systems, such as financial transaction networks, peer-to-peer trust graphs, and communication in social platforms, are inherently dynamic : their topology and node attributes co-evolve over time 11 ; 35 . Forecasting the next interaction in such a system is a canonical Dynamic Link Prediction problem, and it has been tackled by a variety of DGNNs 21 ; 2 ; 24 ; 25 ; 27 ; 36 . In an analogous setting, a subset of nodes may exhibit anomalous behavior. Consequently, detecting these anomalies is formulated as a node classification task within the graph. DGNNs 17 ; 24 ; 27 ; 30 ; 26 are frequently employed to address this challenge. When the input is discretized into a sequence of snapshots \{\mathcal{G}_{1},\dots,\mathcal{G}_{T}\} as is standard for trust networks, citation streams, and routing data, existing DGNNs almost universally adopt one of two architectural paradigms. • Temporal-First (T \to S): A recurrent or attention-based module first encodes the node feature trajectory , and the resulting temporal summary is then passed to a GNN. Representative examples include EvolveGCN 21 , where an RNN evolves the GNN’s weights . • Spatial-first (S \to T): A GNN is applied per snapshot, and the resulting structural embeddings are further processed by a temporal module such as a GRU or LSTM. This is the dominant pattern, instantiated by GCRN 26 , T-GCN 38 , ROLAND 35 and TMetaNet 18 . The Information bottleneck. What both paradigms share is a strict ordering . One modality is consumed in full before the other is allowed to look at it. The downstream module can therefore only influence the final representation via the transformed output of the upstream module, and, crucially, it cannot modulate which information the upstream module retains. A spatial-first model, for example, cannot let its message-passing operator condition the aggregation of a node v ’s feature on v ’s historical activity, because no temporal information has been computed yet. Simultaneously, a temporal-first model cannot let its recurrent cell condition on the current structural neighborhood. We argue that this rigidity is responsible for a substantial part of the gap between current DGNNs. Simultaneous fusion as a third paradigm. We propose that the two signals should interact within a single message-passing step. For every node v , we maintain a recurrent hidden state \mathbf{h}_{v}^{(t)} that summarizes its trajectory, and at every snapshot we build a temporally augmented graph with N additional vertices, where the first N carry the current spatial features \mathrm{proj}(\mathbf{X}_{t}) , and the next N carry the recurrent summaries \widetilde{\mathbf{X}}_{t} . For every original edge (u,v)\in\mathcal{E}_{t} we add a cross-time edge (u+N,v) and (u+N,u) , so that each node receives both the present-time feature and the temporal summary of every neighbor and itself, all within one graph convolution. The output of the first N vertices is the next-layer representation. This simple construction has two consequences: first, the GNN operates on a richer message pool where each node sees |\mathcal{N}(u)| structural messages and |\mathcal{N}(u)|+1 temporal messages per layer, with the feature sets distinguishable by the message-passing operator through a standard aggregation function. Second, the assignment between spatial and temporal information becomes data-dependent and paper-neighbor : a node can attend more to a neighbor’s recent history when its current features are uninformative, and conversely fall back on present structure when temporal context is stale. Contributions. We make the following contributions: • We identify an architectural bottleneck shared by all snapshot based DGNNs that imposes ordering between spatial and temporal computation, and motivate simultaneous spatial-temporal message passing as a third paradigm (Section 4 ). • We instantiate this paradigm as SiST-GNN : a stackable layer that fuses a recurrent cell with a graph convolution over a temporally augmented graph (Section 4 ). • We evaluate SiST-GNN against eight baselines, spanning static GNNs, snapshot DGNNs, evolving-weight architectures, ROLAND variants, and the meta-learner TMetaNet 18 , on six public benchmarks under fixed-split and live-update protocols. SiST-GNN attains the best MRR on every dataset and setting, improving over the baseline by 109-277\% (fixed-split) and 68-194\% (live-update). • We further demonstrate that the same architecture on dynamic node classification , discretizing the continuous-time datasets with event streams, into fixed-width snapshots, SiST-GNN improves test AUC by 7-22\% over the discrete-time baseline and achieves comparable results to continuous-time models , which operate on the native event stream (Section 5.5 ). x_{a} x_{b} x_{c} T-Layer T-Layer T-Layer x_{i} \widetilde{x}_{i} (a) Temporal \to Spatial per-neighbor x_{a} x_{b} x_{c} x_{i} T-Layer \widetilde{x}_{i} (b) Spatial \to Temporal per-target x_{a} x_{b} x_{c} \tilde{x}_{a} \tilde{x}_{b} \tilde{x}_{c} T-Layer T-Layer T-Layer x_{i} \widetilde{x}_{i} (c) Simultaneous (Ours) per-neighbor, per-modality spatial msg. temporal flow cross-time msg. ( \hat{\mathcal{E}}_{t} ) T-Layer = per-node recurrent (LSTM) cell Figure 1: Three paradigms for snapshot-based dynamic GNNs, viewed at the per-target node x_{i} with neighbors \{x_{a},x_{b},x_{c}\} . (a) Temporal-first encodes each neighbor’s feature trajectory through a temporal layer and then aggregates the temporal summaries spatially. (b) Spatial-first aggregates neighbor features spatially into x_{i} and then applies a temporal layer to the aggregated representation. (c) Our simultaneous paradigm maintains, for every node, a temporal counterpart \tilde{x}_{v} produced by a per-node T-Layer; the original neighbor features and their temporal counterparts both reach x_{i} within a single graph convolution over the temporally augmented graph \hat{\mathcal{G}}_{t} , via solid intra-time edges and dashed cross-time edges. The message-passing operator can therefore learn a per-neighbor, per-modality trade-off between present structure and historical evolution. 2 Related Work Static graph neural networks. Modern graph representation learning is built on the

Read the complete text