Improving Internet Traffic Matrix Prediction via Time Series Clustering

Martha Cash, Alexander Wyglinski · 2025

Read Improving Internet Traffic Matrix Prediction via Time Series Clustering by Martha Cash, Alexander Wyglinski (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-15072.txt.

Introduction

Martha Cash and Alexander Wyglinski cluster internet traffic flows before predicting them in a 2025 networking paper. A traffic matrix records flows between network points over time, and operators forecast it to plan routing. Flows behave very differently from each other, which drags down a single deep learning model trained on all of them at once.

Two clustering strategies group flows with similar time patterns: one clusters by source, the other by histogram shape. Separate models then train on each homogeneous group. On the Abilene and GÉANT networks, prediction error falls dramatically compared with earlier methods. When the forecasts feed routing decisions, bias in maximum link utilization also drops substantially. Grouping first, the authors argue, lets each model actually learn the pattern in front of it.

Catalog record

CREATORMartha Cash, Alexander Wyglinski
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-15072

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Improving Internet Traffic Matrix Prediction via Time Series Clustering Martha Cash, Alexander Wyglinski Abstract We present a novel framework that leverages time series clustering to improve internet traffic matrix (TM) prediction using deep learning (DL) models. Traffic flows within a TM often exhibit diverse temporal behaviors, which can hinder prediction accuracy when training a single model across all flows. To address this, we propose two clustering strategies —source clustering and histogram clustering —that group flows with similar temporal patterns prior to model training. Clustering creates more homogeneous data subsets, enabling models to capture underlying patterns more effectively and generalize better than global prediction approaches that fit a single model to the entire TM. Compared to existing TM prediction methods, our method reduces RMSE by up to 92% for Abilene and 75% for GÉANT. In routing scenarios, our clustered predictions also reduce maximum link utilization (MLU) bias by 18% and 21%, respectively, demonstrating the practical benefits of clustering when TMs are used for network optimization. I Introduction A TM quantifies traffic demand between source-destination (SD) node pairs in a network, and are essential for network planning, serving as critical input for many traffic engineering (TE) tasks, such as routing optimization and network resource allocation [ 19 ] . However, TMs are challenging to measure and collect in real time [ 19 ] , motivating the need for accurate TM prediction to support TE tasks [ 5 ] . Recent research trends in TM prediction focus on deep learning (DL) models [ 5 , 11 , 12 ] , which exploit the ability of DL to model complex nonlinear relationships in traffic data. These models demonstrate strong performance, as indicated by error metrics such as Root Mean Squared Error (RMSE) and Mean Absolute Error (MAE). Most approaches adopt a global forecasting paradigm, training a single model to predict all traffic demands in a TM simultaneously. As shown by [ 25 ] , global models can outperform local models—which predict each traffic demand independently—when the dataset features exhibit similar patterns. However, [ 21 ] argues that heterogeneous features can lead to decreased accuracy in global models. Fig. 1 : Traffic flows from different source destination pairs in the Abilene [ 16 ] dataset displaying varying behavior. Referring to Fig. 1 , we observe that traffic demands within a TM often differ significantly in behavior. Some demands, SD pairs (0,3)~\&~(0,4) , exhibit similar trends, while others, SD pairs (0,4)~\&~(0,7) , deviate markedly. The heterogeneity among traffic flows has led to the development of complex DL architectures, such as Attention-based Convolutional Recurrent Neural Networks (ARCNN) [ 8 ] and Convolutional Long Short-Term Memory Networks (CNN-LSTM) [ 26 ] , designed to capture the diverse flow dynamics in TMs. In this work, we challenge the growing trend of designing complex global models for TM prediction. Instead, we propose exploiting the inherent similarities among subsets of traffic flows through clustering. Clustering is an unsupervised learning technique that partitions time series into groups with high intra-group similarity and low inter-group similarity [ 27 ] . Rather than fitting a single model to predict the entire TM, we train separate models for each cluster of flows. The main contributions of this paper are: • Two novel clustering methods for TMs: source-based clustering and histogram-based clustering. • A comparison of the clustering-based models against three state-of-the-art (SOTA) TM prediction baselines. • TM prediction performance evaluation of both clustering approaches with quantitative error metrics (RMSE and MAE) and in an applied routing context. The remainder of the paper is organized as follows. Section II reviews related work in TM prediction and time series clustering. Section III overviews TMs and TM prediction. Section IV details our proposed clustering approaches. Section V outlines the datasets and experimental setup. Section VI presents the evaluation results. Finally, Section Acknowledgments concludes the paper and outlines directions for future work. II Related Work Internet traffic prediction is a time series forecasting problem. A wide range of models, spanning from classical statistical methods to DL approaches, have been employed in this context. Otoshi et al. decompose traffic into long-term and short-term components and apply the seasonal autoregressive integrated moving average model for prediction [ 9 ] . However, this method requires repeatedly differencing the data to achieve stationarity, which limits its practical use. Valadarsky et al. explore Feedforward Neural Networks, Convolutional Neural Networks (CNNs), and nonlinear autoregressive models for traffic prediction, but these fail to capture temporal dependencies, leading to poor predictive performance for TM [ 2 ] . To better model temporal dynamics, recent work [ 10 , 13 , 15 ] has turned to Recurrent Neural Networks (RNNs), such as Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU) models, to predict entire TMs. Other approaches, such as [ 6 , 7 ] , treat each TM element as an independent time series and train separate models for each. Liu et al. propose a hybrid approach that predicts total traffic volume and distributes it across TM elements using precomputed ratios, while correcting for high-volume flows with specialized models [ 14 ] . However, several studies [ 4 , 8 ] have demonstrated that modeling TM elements independently overlooks their correlations, which can potentially compromise overall prediction performance. TMs can be interpreted as a structured collection of interrelated time series. In this broader context, several works have explored clustered time series forecasting. Bandara et al. address the challenge of forecasting across heterogeneous time series by first clustering series based on statistical properties (e.g., mean, variance, autocorrelation), and then fitting RNN models per cluster [ 21 ] . Martinez et al. use geometric distances to cluster time series and apply k -nearest neighbors for forecasting [ 22 ] . Zhang et al. propose clustering traffic flows in transportation networks using flow probability distributions, and Zou et al. apply hierarchical clustering and CNNs to predict lane traffic volumes in transportation systems [ 23 , 24 ] . No prior work has applied time series clustering to internet TMs. This paper aims to bridge that gap by clustering similar traffic flows in TMs and training dedicated models for each cluster, thus exploring the potential to improve prediction accuracy while reducing model complexity. III Traffic Matrix Prediction Overview For a network with N nodes, a TM is an N\times N matrix where each entry (i,j) represents the traffic volume from source node i to destination node j , typically in bytes. At time interval \Delta t , the TM is denoted \mathrm{TM}_{t} , where t\in[t,t+\Delta t]\subset T and T is the full measurement period. A TM at time t is: \mathrm{TM_{t}}=\begin{bmatrix}T_{1,1}^{t}&T_{1,2}^{t}&\cdots&T_{1,n}^{t}\\ T_{2,1}^{t}&T_{2,2}^{t}&\cdots&T_{2,n}^{t}\\ \vdots&\vdots&\ddots&\vdots\\ T_{n,1}^{t}&T_{n,2}^{t}&\cdots&T_{n,n}^{t}\\ \end{bmatrix} (1) Over the full interval T , each TM entry \mathrm{TM}[i,j] becomes a time series of length T capturing traffic from node i to j , referred to as a traffic flow, and each (i,j) pair is called a source-destination (SD) pair. The goal of TM prediction is to forecast \mathrm{TM}_{t+1} given a history of k previous matrices: (\mathrm{TM}_{t-k},\dots,\mathrm{TM}_{t}) . TMs exhibit nonlinear, nonstationary, and periodic behavior, making prediction challenging. DL models are well-suited for this task due to their ability to capture such complex patterns. We formulate prediction as a supervised learning problem, following the

Read the complete text