Spatio-Temporal Graph Convolutional Networks: Optimised Temporal Architecture
Edward Turner · 2025
Read Spatio-Temporal Graph Convolutional Networks: Optimised Temporal Architecture by Edward Turner (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-10454.txt.
Introduction
Edward Turner wrote a 2025 paper on improving the temporal half of spatio temporal graph convolutional networks. These networks model data that moves across connected places over time, like traffic or sensor webs. The original design used convolutional blocks to handle time; later work swapped in recurrent LSTM blocks with promising results.
Turner proposes an architecture that combines both block types in one temporal module. He gives theoretical arguments for what each block contributes. Then he compares the hybrid against the existing models in a battery of tests across several datasets. The empirical results are used to check the hypotheses behind the design. The paper targets practitioners who must pick a temporal design for graph time series.
Catalog record
| CREATOR | Edward Turner |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-10454
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Spatio-Temporal Graph Convolutional Networks: Optimised Temporal Architecture Edward Turner Abstract Spatio-Temporal graph convolutional networks were originally introduced with CNNs as temporal blocks for feature extraction. Since then LSTM temporal blocks have been proposed and shown to have promising results. We propose a novel architecture combining both CNN and LSTM temporal blocks and then provide an empirical comparison between our new and the pre-existing models. We provide theoretical arguments for the different temporal blocks and use a multitude of tests across different datasets to assess our hypotheses. 1 Introduction The field of graph representation learning (GRL) aims to take a feature rich graph (e.g. a social network with edges representing friendships and vertices holding information on each individual) and then in a low-dimensional vector space, the latent space, produce a feature representation embedding of the graph, the latent representation [ 16 ] . This provides a better environment for inference of the data where commonly one would be tasked with vertex prediction, the prediction of vertex labels for some or all of the vertices, or relation prediction, the prediction of whether two nodes are linked by an edge or not [ 3 ] . In this paper we primarily focus on vertex prediction. Spatio-temporal graph convolutional networks (ST-GCNs) are a specific class of GRL methods that arose in 2018 from the separate works of Yan et al. and Yu et al. [ 18 , 20 ] . The developed frameworks both attempt to model time-series node features while having a static graph structure for node interaction. They achieve this by stacking convolutional neural networks (CNNs), which the vertex features are passed through to convolve the time-series data, with graph convolutional networks (GCNs), which the graph with updated convolved features is passed through. Our Contributions We investigate the use of CNN versus long short-term memory (LSTM) models for the temporal blocks in a ST-GCN model. We also look at a combination model including both temporal block types, which, to the best of our knowledge, is a novel architecture. We then extensively compare models across a host of datasets ranging in size, complexity and noise. 2 Preliminaries 2.1 Notation We consider a vertex prediction problem for an input graph \mathcal{G}=\left(\mathcal{V},\mathcal{E},\mathcal{W},\mathbf{X}\right) , where \mathcal{V} is the vertex set with |\mathcal{V}|=N , \mathcal{E} is the edge set, \mathcal{W}\in\mathbb{R}^{N\times{N}} is the weighted adjacency matrix and \mathbf{X}\in\mathbb{R}^{N\times{T}} is the vertex feature matrix, with each vertex feature recorded across T time intervals. From \mathbf{X} a vertex feature tensor, \mathcal{X}\in\mathbb{R}^{N\times{C_{i}}\times{T}} is created by convolving the matrix features into C_{i} channels. 2.2 Graph neural networks Graph neural networks (GNNs) overcome the challenge of permutation invariant deep learning on graph data via a message passing framework with multiple layers, similar to that of a classic neural network [ 3 ] . For an input graph \mathcal{G}=\left(\mathcal{V},\mathcal{E},\mathcal{W},\mathcal{X}\right) , a GNN consists of an initial layer and then L further layers where the k th layer contains N nodes and may be represented as a tensor, \mathbf{H}^{(k)}=\left(\mathbf{h}^{(k)}_{1},...,\mathbf{h}^{(k)}_{N}\right)^{T}\in\mathbb{R}^{N\times{C_{k}}\times{T}} . Here \mathbf{h}^{(k)}_{i} represents the i th node in the k th layer which corresponds to the i th vertex of \mathcal{G} . A (self-loop) approach GNN is initialised by the following iteration: \mathbf{H}^{(0)}=\mathcal{X}\,, (1) \mathbf{h}^{(k+1)}_{i}=\mathrm{Aggregate}^{(k)}({\{\mathbf{h}^{(k)}_{i}}\}\cup\{\mathbf{h}^{(k)}_{j}:e_{i,j}\in\mathcal{E}\})\,,\hskip 5.69054pt0\leq k\leq L-1,\hskip 2.84526pt1\leq i\leq N, (2) where the \mathrm{Aggregate} functions are differentiable and may depend on \mathcal{W} [ 3 ] . 1 1 1 The self-loop approach alleviates overfitting in the more general framework which has \mathrm{Update}^{(k)} and \mathrm{Aggregate}^{(k)} functions by combining the pair into a single \mathrm{Aggregate}^{(k)} function [ 3 ] . The first layer is set to be the vertex features and then for each following layer a vertex’s embedding is based on its previous embedding updated with an aggregation of its neighbouring vertices’ previous embeddings. We then take \mathbf{H}^{(L)} to be our final low-dimension embedding of the graph (the latent representation). 2.2.1 Graph convolutional networks GCNs take inspiration for their \mathrm{Aggregate} functions from Fourier transformations in the spectral domain [ 20 ] . GCNs have seen many recent applications as in 2016 Defferrard et al. provided graph convolution methods using a layer-wise propagation rule which has computational complexity \mathcal{O}(N) rather than \mathcal{O}(N^{2}) [ 2 ] . Kipf et al. subsequently simplified the GCN architecture, motivated by a first-order approximation of spectral graph convolutions [ 8 ] . Their model is able to encode both the local graph structure and the vertex features [ 8 , 9 ] . In a number of experiments on citation networks and a knowledge dataset, it was shown that the model outperforms recent related methods such as DeepWalk and Planetoid [ 8 ] . Defferrard et al. introduced the generalised K th order Chebyshev convolution method, where a graph convolutional operator, *_{\mathcal{G}} , is used [ 2 ] . Let us define the normalised graph Laplacian \mathcal{L}:=I_{N}-\mathcal{D}^{-\frac{1}{2}}\mathcal{W}\mathcal{D}^{-\frac{1}{2}} , where \mathcal{D}\in\mathbb{R}^{N\times{N}} is the diagonal matrix with \mathcal{D}_{ii}=\Sigma_{j}\mathcal{W}_{ij} , so that \mathcal{D}^{-\frac{1}{2}}\mathcal{W}\mathcal{D}^{-\frac{1}{2}} is the symmetric normalisation of \mathcal{W} . By spectral decomposition \mathcal{L}=U\Lambda U^{T} , where \Lambda\in\mathbb{R}^{N\times{N}} is the diagonal matrix of eigenvalues of \mathcal{L} and U\in\mathbb{R}^{N\times{N}} is the matrix of eigenvectors of \mathcal{L} , known as the graph Fourier basis [ 13 ] . First we define \Theta*_{\mathcal{G}}x:=\Theta(\mathcal{L})x=\Theta(U\Lambda U^{T})x=U\Theta(\Lambda)U^{T}x , for a singular graph signal x\in\mathbb{R}^{N} . Here the filter \Theta(\Lambda) is also a diagonal matrix. By this definition, a graph signal x is filtered by a kernel \Theta with multiplication between \Theta and U^{T}x , the graph Fourier transform [ 13 ] . To define \Theta*_{\mathcal{G}}\mathcal{X}\in\mathbb{R}^{N\times{C_{o}}\times{T}} , the output of the GCN, the vertex feature tensor, \mathcal{X} , is first decomposed into one signal per time dimension, X^{(t)}=\left(x_{1}^{(t)},...,{{x_{C}}_{h}}^{(t)}\right)\in\mathbb{R}^{N\times{C_{h}}} . Each are then passed in parallel through the GCN with a shared kernel, \Theta\in\mathbb{R}^{N\times{C_{h}}\times{C_{o}}} , according to: \left(\Theta*_{\mathcal{G}}X^{(t)}\right)_{j}:=\sum_{i=1}^{C_{h}}\Theta^{(ij)}(\mathcal{L})x_{i}^{(t)}\,,\hskip 5.69054pt1\leq j\leq C_{o}, (3) where \left(\Theta*_{\mathcal{G}}X^{(t)}\right)_{j} is the j th column of \Theta*_{\mathcal{G}}X^{(t)}\in\mathbb{R}^{N\times{C_{o}}} [ 20 ] . Similar to classic CNNs to localise the filter, reduce the number of parameters and reduce computational complexity Hammond et al. now proposed truncating the Chebyshev polynomial expansion of \Theta(\Lambda) up to the K th order [ 4 ] . This results in: \left(\Theta*_{\mathcal{G}}X^{(t)}\right)_{j}\approx\sum_{k=0}^{K}\sum_{i=1}^{C_{h}}\Theta_{k}^{(ij)}T_{k}(\tilde{\mathcal{L}})x_{i}^{(t)}\,, (4) with a rescaled \tilde{\mathcal{L}}=\frac{2}{\lambda_{\text{max}}}\mathcal{L}-I_{N} where \lambda_{\text{max}} denotes the largest eigenvalue of \mathcal{L} and \Theta_{k}^{(ij)} is a matrix of trainable Chebyshev coefficients [ 5 , 20 ] . The Chebyshev polynomials are recursively defined as T_{0}(x)=1 , T_{1}(x)=x and T_{k}(x)=2xT_{k-1}(x)-T_{k-2}(x)\hskip 4.2679pt\forall k\geq 2 [ 4 ] . Note, Equation 4 is now K-localized since it is a K th -order polynomial in the Laplacian, that is it only depends on vertices that are at maximum K steps away from the central vertex. In the case of K =1 Equation 4 reduces to the GCN used by Kipf et al. [ 8 , 9 ] . Letting \tilde{\mathcal{W}}=\mathcal{W}+I_{N} and \tilde{\mathcal{D}}_{ii}=\Sigma_{j}\tilde{\mathcal{W}}_{ij} this can be succinctly written as: \Theta*_{\mathcal{G}}X^{(t)}=\Theta_{1}(\tilde{D}^{-\frac{1}{2}}\tilde{W}\tilde{D}^{-\frac{1}{2}})X^{(t)} , where \Theta_{1} is now the trainable weight matrix [ 8 ] . Iteratively applying K first-order approximations achieves a similar effect as one passing of the K-order convolution, both methods drawing information from the K-step neighbourhood of each vertex. The layer-wise linear structure is parameter-economic and highly efficient for large-scale graphs, since the order of the approximation is limited to one [ 20 ] . 2.3 Spatio-temporal graph convolutional networks ST-GCNs are formed of temporal blocks to