FaST: Efficient and Effective Long-Horizon Forecasting for Large-Scale Spatial-Temporal Graphs via Mixture-of-Experts Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1; August 09–13, 2026; Jeju Island, Republic of Korea CCS: Information systems Spat

Yiji Zhao, Zihao Zhong, Ao Wang, Haomin Wen, Ming Jin, Yuxuan Liang, Huaiyu Wan, Hao Wu · 2026

Read FaST: Efficient and Effective Long-Horizon Forecasting for Large-Scale Spatial-Temporal Graphs via Mixture-of-Experts Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1; August 09–13, 2026; Jeju Island, Republic of Korea CCS: Information systems Spat by Yiji Zhao, Zihao Zhong, Ao Wang, Haomin Wen, Ming Jin, Yuxuan Liang, Huaiyu Wan, Hao Wu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-05174.txt.

Introduction

Yiji Zhao and 7 co-authors present FaST, a forecasting framework for huge spatial-temporal graphs, in a 2026 paper. These graphs model networks such as traffic sensors or power grids evolving over time. Existing models mostly predict short horizons, and scaling them to long horizons over large graphs brings notorious computational and memory costs that block practical use.

FaST uses a heterogeneity-aware mixture-of-experts design, routing different parts of the problem to specialised sub-models. The authors report it unlocks week-ahead prediction at fine time granularity across thousands of nodes. Long-horizon forecasts on large networks support planning in transport and energy systems, where operators need next week's picture, not only the next hour's, to schedule resources.

Catalog record

CREATORYiji Zhao, Zihao Zhong, Ao Wang, Haomin Wen, Ming Jin, Yuxuan Liang, Huaiyu Wan, Hao Wu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-05174

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FaST: Efficient and Effective Long-Horizon Forecasting for Large-Scale Spatial-Temporal Graphs via Mixture-of-Experts Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1; August 09–13, 2026; Jeju Island, Republic of Korea CCS: Information systems Spatial-temporal systems Yiji Zhao, Zihao Zhong, Ao Wang, Haomin Wen, Ming Jin, Yuxuan Liang, Huaiyu Wan, Hao Wu Abstract . Spatial-Temporal Graph (STG) forecasting on large-scale networks has garnered significant attention. However, existing models predominantly focus on short-horizon predictions and suffer from notorious computational costs and memory consumption when scaling to long-horizon predictions and large graphs. Targeting the above challenges, we present FaST , an effective and efficient framework based on heterogeneity-aware Mixture-of-Experts (MoEs) for long-horizon and large-scale STG forecasting, which unlocks one-week-ahead (672 steps at a 15-minute granularity) prediction with thousands of nodes. FaST is underpinned by two key innovations. First, an adaptive graph agent attention mechanism is proposed to alleviate the computational burden inherent in conventional graph convolution and self-attention modules when applied to large-scale graphs. Second, we propose a new parallel MoE module that replaces traditional feed-forward networks with Gated Linear Units (GLUs), enabling an efficient and scalable parallel structure. Extensive experiments on real-world datasets demonstrate that FaST not only delivers superior long-horizon predictive accuracy but also achieves remarkable computational efficiency compared to state-of-the-art baselines. Source code is publicly available at: https://github.com/yijizhao/FaST . 1. Introduction Spatial-Temporal Graph (STG) serves as a powerful data schema for modeling complex dependencies in urban sensing systems, where nodes represent sensors (e.g., traffic detectors, energy meters) and edges capture spatial relationships ( 35 ; 21 ) . Accurate long-horizon STG forecasting (e.g., days ahead) can shift urban management from reactive responses to proactive planning. For example, a seven-day electricity demand outlook allows renewable generation and storage to be scheduled ahead of peak loads. Such scenarios are typically coupled with two features: 1) a long forecasting horizon (e.g., 672 steps at 15-minute granularity covers one week) and 2) a large-scale graph (e.g., over thousands of nodes). Extensive efforts have been made in STG forecasting, where most works focus on short-term forecasting (i.e., 12-step) in graphs with fewer than hundreds of nodes. Representative models build a Spatial-Temporal Graph Neural Networks (STGNNs), such as DCRNN ( 26 ) and STGCN ( 46 ) , coupling Graph Neural Networks (GNNs) with sequence models to capture both the spatial and temporal dependencies. Later improvements incorporate graph attention ( 14 ; 50 ; 15 ) , temporal transformers ( 15 ; 27 ) , and neural graph ODEs ( 12 ) to boost short-term accuracy. However, those STGNNs suffer from quadratic complexity hidden in both spatial and temporal modules: GNNs and spatial/temporal attention incur O(N^{2}) and O(T^{2}) pairwise node/time-step interactions over N nodes and sequence length T , respectively. When N and T scale jointly, resource demands increase exponentially. To give a concrete example, we report the training cost vs. performance on a large-scale STG benchmark ( 32 ) in Figure 1 , when confronted with 8,600 nodes and a 672-step prediction horizon (a practical setting in CA dataset), most representative STGNNs exhaust 48 GB of GPU memory, making them impractical to train and deploy in most GPU devices. To elevate the STGNNs for large-scale and long-horizon forecasting, a critical challenge is to achieve linear computational complexity while retaining the rich spatial and temporal semantics required for long-horizon forecasting. Recent studies have explored two complementary directions to reduce pairwise node/time-step interactions, though promising, they still face major limitations in both performance and efficiency. Spatially , existing efficient methods can be broadly categorized into structure-aware and structure-free approaches. Structure-aware methods leverage the explicit graph topology to reduce spatial interactions through techniques such as sparse aggregation (e.g., SGP ( 7 ) ), neighbor sampling (e.g., SAGDFN ( 20 ) ), and graph partitioning (e.g., PatchSTG ( 11 ) ). However, these approaches often discard long-range dependencies and heavily rely on an accurate graph structure (which may not always be available in real-world scenarios). To circumvent this, structure-free methods avoid using graph structure and instead rely on node embeddings and feature-mixing mechanisms. For example, BigST ( 17 ) adopts linear attention to bypass pairwise node computation; RPMixer ( 45 ) employs random projection and MLPs to facilitate efficient spatial fusion; and STID ( 37 ) eliminates spatial interactions by encoding spatial identity with positional embeddings. While these techniques reduce the complexity from O(N^{2}) to O(N\cdot\phi) , where \phi\textless N is a tunable factor depending on the implementation and hyperparameters (e.g., sampled neighbors, feature dimension, or partition granularity), they often oversimplify the interaction operation, which can dilute meaningful relationships, introduce irrelevant noise, and therefore lead to significant loss of spatial semantics. Figure 1. Efficiency–effectiveness comparison on large-scale STG benchmark (CA dataset; 8,600 nodes; 672-step prediction horizon). Smaller bubble means faster inference speed. The proposed FaST achieves the best performance and speed (both in training and inference). Temporally , two main strategies have emerged: sparse/linear attention mechanisms and temporal pattern compression methods . The former, adopted in models like Airformer ( 27 ) , SAGDFN ( 20 ) , and BigST ( 17 ) , aims to alleviate the quadratic cost of temporal attention by approximating it with lower-complexity variants. The latter strategy, employed in methods such as CycleNet ( 28 ) and STID ( 37 ) , compresses long historical sequences into a compact low-dimensional embedding per node, effectively removing explicit pairwise interactions across time steps. For example, STID directly compresses the T -step history into a dense embedding via a simple linear projection, while CycleNet encodes periodicity by learning a fixed-length recurrent cycle template, both avoiding explicit token-wise temporal interactions. However, due to sharing a single compression module across both spatial units and temporal segments, these methods effectively impose a one-size-fits-all scheme, often homogenizing temporal representations and ignoring heterogeneous temporal patterns across nodes and time periods, risking the loss of temporal diversity and fine-grained dynamics and thus compromising expressiveness and generalization, especially for long-range forecasting tasks. To address the above limitations, we propose FaST , a Fa st long-horizon forecasting framework for large-scale S patial- T emporal graphs. FaST is a heterogeneity-aware parallelized Mixture-of-Experts (MoE) networks. Firstly, an MoE-based temporal compression input module projects historical sequences into a low-dimensional dense embedding, improving computational efficiency and preventing memory explosion concerning the historical input length. To mitigate the information loss and representation homogenization induced by compression, we introduce a heterogeneity-aware router that dynamically selects expert-specific compression pathways across nodes and time periods, thereby extracting diversified temporal features. Furthermore, an expert-concurrent mechanism based on Gated Linear Units (GLUs) is proposed to achieve efficient feature extraction. Secondly, an adaptive graph agent attention module is introduced, where a agent tokens ( a\ll N ) are learned to reduce the long-range spatial interaction complexity from O(N^{2}) to O(Na) . Finally, a multi-layer MoE network is built to extract diverse spatial features. The main contributions are summarized as follows: • Framework: We propose FaST, the first framework for long-horizon and large-scale STG forecasting that unlocks the prediction span to one week and node size to tens of thousands within a tolerable time. • Parallelized Mixture-of-Experts: A novel heterogeneity-aware router and a parallel GLU-MoE module are proposed, which can efficiently and

Read the complete text