MillGNN: Learning Multi-Scale Lead-Lag Dependencies for Multi-Variate Time Series Forecasting

Binqing Wu, Zongjiang Shang, Jianlong Huang, Ling Chen · 2025

Read MillGNN: Learning Multi-Scale Lead-Lag Dependencies for Multi-Variate Time Series Forecasting by Binqing Wu, Zongjiang Shang, Jianlong Huang, Ling Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-03852.txt.

Introduction

Binqing Wu and three co-authors examine MillGNN, a graph neural network for forecasting several time series at once, in a 2025 research paper. Multivariate forecasting predicts many related quantities together, like traffic at many sensors, and series often lead or lag each other. Earlier methods capture dependencies within and between series, yet miss how lead-lag effects operate at several grouping scales at once.

MillGNN learns those multi-scale lead-lag dependencies. One module builds a lead-lag graph specific to each grouping level, mixing cross-correlation statistics with decaying features drawn from live inputs and time lags. That design keeps the learned relationships statistically interpretable while staying flexible. A second module passes messages hierarchically across scales, propagating lead-lag effects within and between groups. Experiments on eleven datasets, against sixteen leading methods, show MillGNN ahead for both long-term and short-term forecasting, balancing comprehensiveness with efficiency.

Catalog record

CREATORBinqing Wu, Zongjiang Shang, Jianlong Huang, Ling Chen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-03852

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MillGNN: Learning Multi-Scale Lead-Lag Dependencies for Multi-Variate Time Series Forecasting Binqing Wu, Zongjiang Shang, Jianlong Huang, Ling Chen Abstract . Multi-variate time series (MTS) forecasting is crucial for various applications. Existing methods have shown promising results owing to their strong ability to capture intra- and inter-variate dependencies. However, these methods often overlook lead-lag dependencies at multiple grouping scales, failing to capture hierarchical lead-lag effects in complex systems. To this end, we propose MillGNN, a novel g raph n eural n etwork-based method that learns m ult i ple grouping scale l ead- l ag dependencies for MTS forecasting, which can comprehensively capture lead-lag effects considering variate-wise and group-wise dynamics and decays. Specifically, MillGNN introduces two key innovations: (1) a scale-specific lead-lag graph learning module that integrates cross-correlation coefficients and dynamic decaying features derived from real-time inputs and time lags to learn lead-lag dependencies for each scale, which can model evolving lead-lag dependencies with statistical interpretability and data-driven flexibility; (2) a hierarchical lead-lag message passing module that passes lead-lag messages at multiple grouping scales in a structured way to simultaneously propagate intra- and inter-scale lead-lag effects, which can capture multi-scale lead-lag effects with a balance of comprehensiveness and efficiency. Experimental results on 11 datasets demonstrate the superiority of MillGNN for long-term and short-term MTS forecasting, compared with 16 state-of-the-art methods. 1. Introduction Figure 1. Illustration of lead-lag dependencies at different grouping scales. Multi-variate time series (MTS) forecasting, one of the most popular research topics, is a fundamental task in various domains, e.g., traffic management ( Sun et al. 2024 ) and weather prediction ( Wu et al. 2024 ) . Due to the intricate intra-variate and inter-variate dependencies inherent in MTS, accurate MTS forecasting poses a significant challenge ( Chen et al. 2023a ) . Recently, many deep learning methods have emerged for MTS forecasting, demonstrating remarkable performance. These methods can be mainly categorized into two groups: Variate-independent and variate-dependent. Variate-independent methods forecast each time series based on its historical values. They commonly employ Recurrent Neural Networks (RNNs) ( Huang et al. 2024a ) , Convolutional Neural Networks (CNNs) ( Wu et al. 2023 ) , attention mechanisms ( Chen et al. 2024 ) , and Multi-layer Perceptrons (MLPs) ( Wang et al. 2024 ) to capture intra-variate dependencies. Nevertheless, these methods disregard information from other variates. In contrast, variate-dependent methods forecast MTS by considering the historical values of each variate and those of other variates. They adopt attention mechanisms ( Liu et al. 2024 ) , MLPs ( Ekambaram et al. 2023 ) , and Graph Neural Networks (GNNs) ( Cai et al. 2024 ; Wu and Chen 2023 ) to incorporate features from multiple variates through implicit or explicit inter-variate dependencies. Nevertheless, these methods only capture inter-variate dependencies at the same time steps, often overlooking lead-lag dependencies, where segments of one time series (leading variate) affect another time series (lagging variate) with time lags ( Brooks et al. 2001 ) . Some deep learning methods have attempted to model lead-lag dependencies via pre-calculated cross-correlation coefficients ( Zhao and Shen 2024 ) and learnable methods, e.g., attentions ( Jiang et al. 2023 ) and GNNs ( Long et al. 2024 ) . However, existing methods only capture lead-lag dependencies at the level of individual variates. They overlook a critical aspect: lead-lag dependencies often emerge at multiple grouping scales, i.e., between individual variates and between variate groups with different sizes, where each reflects distinct propagation dynamics in complex systems. For example, in power grid monitoring, a voltage drop at a specific transformer (a single sensor reading) might immediately affect the current readings at a directly connected substation, indicating a fine-grained lead-lag dependency between individual variates. A regional blackout in one part of the grid (e.g., a city district) may lead to load transfer and voltage instability across other distant regions over tens of minutes or hours, implying a coarse-grained lead-lag dependency between large variate groups. Consequently, capturing lead-lag dependencies at multiple grouping scales (abbr. multi-scale) is essential for accurately modeling system-wide hierarchical propagation behaviors that cannot be explained by single-scale interactions alone. Despite their importance, learning and leveraging multi-scale lead-lag dependencies remains a non-trivial task due to two fundamental difficulties: (1) Scale variability : Lead-lag dependencies are different at different levels of variate groups. As shown in Fig. 1 , at coarser grouping scales, fine-grained fluctuations tend to be smoothed out, resulting in more stable and robust lead-lag patterns. In contrast, at finer scales, lead-lag dependencies become highly sensitive to local variations and are often dynamic, requiring models to adapt to fast-changing signals. This variability poses a challenge for unified modeling and calls for scale-specific dependency learning mechanisms. (2) Scale interaction : Lead-lag effects, driven by lead-lag dependencies, propagate not only within but also across grouping scales. For example, traffic control in one area may affect neighboring areas and trigger cascading effects at smaller scales, e.g., causing road congestion in nearby areas. However, naive fusion across scales often results in redundant representations and incurs a high computational cost. This highlights the need for structured interaction mechanisms. To this end, we propose MillGNN, a GNN -based method to learn m ult i ple grouping scale l ead- l ag dependencies for MTS forecasting. To the best of our knowledge, MillGNN is the first work to learn and utilize multi-scale lead-lag dependencies for MTS forecasting, which can comprehensively capture lead-lag effects considering variate-wise and group-wise dynamics and decays. The main contributions are as follows: • For scale variability, we introduce a s cale-specif i c l ead- l ag g raph l earning ( SiLL-GL ) module to learn lead-lag dependencies on each grouping scale. This module first identifies initial lead-lag dependencies based on fast Fourier transform (FFT)-based cross-correlation calculation, and then models the evolution of these dependencies by integrating time-varying inputs and time lags via a decay-aware attention mechanism. The SiLL-GL module can model evolving lead-lag dependencies for each scale, adapting to their inherent scale-specific dynamics and decaying nature, while maintaining statistical interpretability and data-driven flexibility. • For scale interaction, we introduce a hi erarchical l ead- l ag m essage p assing ( HiLL-MP ) module to propagate intra- and inter-scale lead-lag effects in a structure way. This module directly passes fined-grained lead-lag messages between similar variates/variate groups within each scale, and progressively passes coarsen-grained lead-lag messages between dissimilar variates/variate groups across scales. The HiLL-MP module can capture lead-lag effects with mixed granularities, achieving a balance between comprehensiveness and efficiency. • We evaluate MillGNN on 11 real-world datasets, and the extensive experimental results demonstrate the superiority of MillGNN for long-term and short-term MTS forecasting, compared with 16 state-of-the-art (SOTA) methods. 2. Related Works 2.1. Multi-Variate Time Series Forecasting Many methods have emerged for MTS forecasting, ranging from statistics methods ( Williams and Hoel 2003 ; Wu et al. 2004 ) to deep learning methods ( Wu et al. 2020 ; Zhou et al. 2021 ; Shang et al. 2024 ; Shang and Chen 2024 ) . Due to the strong representation ability, deep learning methods have become mainstream and can be mainly categorized into two groups: Variate-independent and variate-dependent. Variate-independent methods forecast each time series based on its historical values. They

Read the complete text