Robust and Noise-resilient Long-Term Prediction of Spatiotemporal Data Using Variational Mode Graph Neural Networks with 3D Attention

Osama Ahmad, Zubair Khalid · 2025

Read Robust and Noise-resilient Long-Term Prediction of Spatiotemporal Data Using Variational Mode Graph Neural Networks with 3D Attention by Osama Ahmad, Zubair Khalid (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-06660.txt.

Introduction

Forecasting traffic or weather far ahead is hard enough with clean sensors; real sensors hiss with noise that grows over the horizon. Osama Ahmad and Zubair Khalid harden a graph neural network against that hiss in this 2025 paper. Their pipeline first splits the corrupted signal into clean modes, then lets a three-way attention system judge which modes and moments matter.

Spatial, temporal, and channel attention work together, while a learnable threshold discards junk modes and a signal-to-noise filter trims features. On a large traffic dataset with added noise, the method beat baselines on long-range accuracy and held up better as noise rose. The authors release their code.

Catalog record

CREATOROsama Ahmad, Zubair Khalid
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-06660

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Robust and Noise-resilient Long-Term Prediction of Spatiotemporal Data Using Variational Mode Graph Neural Networks with 3D Attention Osama Ahmad, Zubair Khalid Abstract This paper focuses on improving the robustness of spatiotemporal long-term prediction using a variational mode graph convolutional network (VMGCN) by introducing 3D channel attention. The deep learning network for this task relies on historical data inputs, yet real-time data can be corrupted by sensor noise, altering its distribution. We model this noise as independent and identically distributed (i.i.d.) Gaussian noise and incorporate it into the LargeST traffic volume dataset, resulting in data with both inherent and additive noise components. Our approach involves decomposing the corrupted signal into modes using variational mode decomposition, followed by feeding the data into a learning pipeline for prediction. We integrate a 3D attention mechanism encompassing spatial, temporal, and channel attention. The spatial and temporal attention modules learn their respective correlations, while the channel attention mechanism is used to suppress noise and highlight the significant modes in the spatiotemporal signals. Additionally, a learnable soft thresholding method is implemented to exclude unimportant modes from the feature vector, and a feature reduction method based on the signal-to-noise ratio (SNR) is applied. We compare the performance of our approach against baseline models, demonstrating that our method achieves superior long-term prediction accuracy, robustness to noise, and improved performance with mode truncation compared to the baseline models. The code of the paper is available at https://github.com/OsamaAhmad369/VMGCN . I Introduction Time series analysis involving spatial data has rapidly expanded across various fields, including arrhythmia detection using electrocardiogram (ECG) [ 1 ] , traffic accident prediction [ 2 ] , traffic flow prediction [ 3 ] , flood forecasting [ 4 ] , and air quality prediction [ 5 ] . In forecasting applications, historical data is fed into deep learning algorithms to learn complex patterns. This historical data is gathered from the sensors, which can sometimes be corrupted, potentially affecting the prediction accuracy of the neural networks. This work examines the robustness of models against noise in real-time traffic data and aims to improve long-term prediction accuracy. Recent research has proposed state-of-the-art modeling techniques for better understanding and modeling complex spatial patterns and temporal dynamics. Graph neural networks (GNNs) are frequently used in learning models to capture the spatial correlation within the graph networks [ 6 ] , [ 7 ] . The gated recurrent units (GRUs) [ 8 ] and transformers [ 9 ] are powerful tools for dynamically mapping the time-sequential events. An adaptive graph is generated from dynamic node attributes and integrated with a static graph to explore the topology of the graph network [ 10 ] . External factors such as time, point of interest (POI), and weather information, are used to extract valuable insights. Signal processing-based noise removal methods are also employed in spatiotemporal forecasting problems. One study applied complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) to time series data, followed by a stacked autoencoder for feature extraction and long short-term memory (LSTM) for temporal modeling [ 11 ] . To reduce the effect of the noise in time series, Li et al. implemented the bi-directional long short-term memory (BILSTM) in combination with distinct decomposition methods such as wavelet (WL), empirical mode decomposition (EMD), and ensemble empirical mode decomposition (EEMD) [ 12 ] . Variational mode decomposition (VMD) and LSTM have also been employed for short-term traffic flow prediction, though these methods primarily focus on temporal data, neglecting spatial relationships [ 13 ] . However, since these methods primarily focus on temporal aspects, they neglect spatial relationships essential to accurate forecasting. In air quality prediction, an EEMD-CEEMDAN-GCN (graph convolutional network) framework was proposed to capture spatial features, though it struggles with learning sequential dynamic trends and introduces high computational complexity due to iterative algorithms [ 14 ] . Sun et al. proposed ModWaveMLP, where noise from traffic data is removed using a wavelet decomposition module [ 15 ] . Fuzzy clustering has also been applied to residual time series, combined with a convolutional-LSTM for long-term spatial pattern identification, though this model does not account for traffic network topology [ 16 ] . Another method, referred to as the variational mode graph convolution network (VMGCN), has been developed to decompose temporal graph data into distinct modes for future state prediction using a neural network [ 17 ] . Although the model claims to differentiate between modes based on noise levels, substantial evidence for effective noise handling is lacking, and its performance diminishes for long-term predictions compared to short-term forecasts. Existing decomposition methods, such as EMD, EEMD, and CEEMDAN-based approaches suffer from mode-mixing, while VMD overcomes these challenges by ensuring better frequency separation and adaptability and therefore, offers improved forecasting performance [ 18 ] . In this work, we make the following novel contributions to address the aforementioned challenges: • We propose a framework that decomposes the noise-corrupted data into modes and applies 3-D attention, graph convolution, and time convolution to estimate future time events. The 3-D attention mechanism consists of three types of attention: spatial, temporal, and channel. To the best of our knowledge, this is the first time channel attention has been applied to distinguish between modes containing valuable information and those containing noise. • We conduct experiments using LargeST, a benchmark dataset for traffic flow prediction, which encompasses a wide range of spatial and time data to demonstrate the better prediction performance of the proposed architecture. We use additive noise in spatio-temporal data to train the model and analyze the impact of noise on the prediction accuracy. We also analyze various case scenarios to assess the impact of different hyper-parameters on the performance of our network. Through different experiments, we demonstrate our approach delivers better long-term prediction accuracy, enhanced noise robustness, and superior performance with mode truncation compared to the baselines. II Problem Formulation In graph theory, a graph network is defined by the interconnection between distinct nodes. A directed weighted graph is denoted as \mathcal{G}=(V,\boldsymbol{E},\boldsymbol{A}) , where V represents the set of nodes with \lvert V\rvert=N , \boldsymbol{E} represents the connection between these nodes and \boldsymbol{A}\in\mathbb{R}^{N\times N} is the weighted adjacency matrix. The graph features within a time window T_{w} are defined as \boldsymbol{\mathcal{X}}=[\boldsymbol{X}_{1},\boldsymbol{X}_{2},\dots,\boldsymbol{X}_{T}]\in\mathbb{R}^{N\times d\times T_{w}} , where \boldsymbol{X}_{t}\in\mathbb{R}^{d\times T_{w}} is the feature matrix for the graph at the time sample t and d denotes the number of feature channels. The Laplacian matrix is defined as \boldsymbol{L}=\boldsymbol{D}-\boldsymbol{A} , where \boldsymbol{D}\in\mathbb{R}^{N\times N} is the diagonal matrix containing the degree of each node \boldsymbol{D}_{ii}=\sum_{j}\boldsymbol{A}_{(i,j)} . The normalized Laplacian matrix is expressed as \boldsymbol{L}=\boldsymbol{I}_{N}-\boldsymbol{D}^{-\frac{1}{2}}\boldsymbol{A}\boldsymbol{D}^{-\frac{1}{2}} , where \boldsymbol{I}_{N} is an identity matrix of order N . We validate our model on the LargeST benchmark dataset [ 19 ] , consisting of the real-time traffic volume collected from a total of 8600 sensor nodes, each containing five years of data from three distinct sub-regions, offers significant diversity in spatial and temporal patterns. The nodes cover the region of the Greater Bay Area (GBA: 2,352 nodes), Greater Los Angeles (GLA: 3,834 nodes), and San Diego (SD: 716 nodes). This diversity tests the ability of the model to generalize across varying distributions and highlights its scalability. In this work, we assume that the real-time data obtained from the

Read the complete text