Sim-MSTNet: sim2real based Multi-task SpatioTemporal Network Traffic Forecasting

Hui Ma, Qingzhong Li, Jin Wang, Jie Wu, Shaoyu Dou, Li Feng, Xinjun Pei · 2026

Read Sim-MSTNet: sim2real based Multi-task SpatioTemporal Network Traffic Forecasting by Hui Ma, Qingzhong Li, Jin Wang, Jie Wu, Shaoyu Dou, Li Feng, Xinjun Pei (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21384.txt.

Introduction

Hui Ma, Qingzhong Li, Jin Wang, Jie Wu, Shaoyu Dou, Li Feng, and Xinjun Pei forecast network traffic with little real data to learn from. Traffic forecasts guide smart network operations, but new services often lack long records. Models that juggle several traffic types at once also suffer when tasks clash.

Their model learns first in simulation, then transfers to the real network. It handles space and time patterns for many service types together. The design fights task imbalance so common services do not swamp rare ones. Better forecasts help operators plan capacity and catch strain before users feel it.

Catalog record

CREATORHui Ma, Qingzhong Li, Jin Wang, Jie Wu, Shaoyu Dou, Li Feng, Xinjun Pei
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-21384

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Sim-MSTNet: sim2real based Multi-task SpatioTemporal Network Traffic Forecasting Hui Ma, Qingzhong Li, Jin Wang, Jie Wu, Shaoyu Dou, Li Feng, Xinjun Pei Abstract Network traffic forecasting plays a crucial role in intelligent network operations, but existing techniques often perform poorly when faced with limited data. Additionally, multi-task learning methods struggle with task imbalance and negative transfer, especially when modeling various service types. To overcome these challenges, we propose Sim-MSTNet, a multi-task spatiotemporal network traffic forecasting model based on the sim2real approach. Our method leverages a simulator to generate synthetic data, effectively addressing the issue of poor generalization caused by data scarcity. By employing a domain randomization technique, we reduce the distributional gap between synthetic and real data through bi-level optimization of both sample weighting and model training. Moreover, Sim-MSTNet incorporates attention-based mechanisms to selectively share knowledge between tasks and applies dynamic loss weighting to balance task objectives. Extensive experiments on two open-source datasets show that Sim-MSTNet consistently outperforms state-of-the-art baselines, achieving enhanced accuracy and generalization. † † address: 1 Xinjiang Key Laboratory of Intelligent Computing and Smart Applications, School of Software, Xinjiang University, Urumqi, 830046, China 2 Department of Computer Science and Technology, Tongji University, Shanghai,China 3 Bielefeld University of Applied Sciences and Arts, Bielefeld, Germany 1 Introduction With the rapid development of Sixth-Generation (6G) network planning [ 18 ] , cellular communication systems are expanding both in scale and complexity, leading to an unprecedented growth in device connectivity and data volume [ 21 ] . The increasing number and diversity of connected devices introduce significant heterogeneity and dynamic variations in network topology and traffic patterns [ 3 ] . Moreover, the exponential surge in traffic exacerbates network uncertainty, often resulting in bursty loads and anomalous fluctuations [ 1 ] . These challenges make it increasingly difficult to maintain efficient and intelligent network operations, highlighting the need for adaptive management solutions for next-generation communication infrastructure [ 7 ] . Accurate network traffic forecasting is crucial for enabling intelligent network decision-making. Mobile network traffic, however, inherently exhibits complex spatiotemporal correlations, which has driven the development of advanced deep learning models capable of capturing both temporal dynamics and spatial dependencies. Despite their effectiveness, the performance of these models is heavily dependent on large-scale, high-quality data [ 6 ] . In scenarios with limited data, such as newly deployed base stations, remote areas, or emergency communication networks, the severe lack of training data significantly hampers model generalization, resulting in considerable degradation in prediction accuracy [ 14 ] . To address these limitations, previous research has primarily focused on two categories of solutions. The first category involves data generation techniques, such as Generative Adversarial Networks (GANs) [ 8 ] and diffusion models [ 11 , 2 ] . However, these models often struggle to capture the complex spatiotemporal structures of real-world traffic, leading to a significant distribution gap between generated synthetic data and authentic data. The second category is the sim2real technique [ 13 ] , which uses physical simulators to generate large amounts of training data. However, it faces the ”reality gap,” as simulation environments cannot accurately replicate the complexity and dynamics of real-world wireless propagation. As a result, models trained on simulated data often fail to generalize effectively to real-world scenarios [ 15 , 4 ] . Another core challenge lies in effectively addressing conflicts and imbalance in Multi-Task Learning (MTL). In network traffic forecasting, tasks are often heterogeneous (e.g., Call, SMS, and Net traffic), and traditional single-task learning models fail to exploit the potential correlations among them. MTL, by contrast, improves model generalization and efficiency through learning shared representations [ 17 ] . However, most existing traffic MTL approaches rely on hard parameter-sharing mechanisms [ 12 ] , which are particularly vulnerable to task conflicts: Certain tasks may dominate the optimization process while others are suppressed, ultimately causing negative transfer and degrading overall performance. To effectively address the aforementioned challenges, this paper proposes Sim-MSTNet, a unified framework that simultaneously tackles both data scarcity and task conflict issues. Specifically , we model wireless communication environments and generate extensive simulated data under multiple configurations. To narrow the reality gap, domain randomization is employed to train the model on reweighted simulated samples. Subsequently , the joint optimization of model parameters and sample weights is formulated as a bi-level optimization problem. Then , we develop a cutting-plane-based optimization algorithm to enhance the generalization performance of network traffic time series forecasting models. Besides , to accurately model the complex spatiotemporal dependencies in network traffic, we incorporate a dynamic multi-task network, which leverages an attention mechanism to achieve soft parameter sharing and information replenishment among different tasks (e.g., Call, SMS, and Net). Furthermore , a dynamic loss weighting strategy is adopted to adaptively balance tasks, which helps mitigate task imbalance and reduce negative transfer. The main contributions of this paper are summarized as follows. Firstly , we propose a deep learning model with sim2real technique and leverage the domain randomization based method to solve the ”reality gap” issue. In fact, we are the first to employ a sim2real technique with a domain randomization strategy for cellular network traffic prediction. Besides , we introduce a multi-task spatiotemporal approach with a dynamic loss weighting strategy. It is the first work to explore dynamic loss weighting strategy specifically for cellular network traffic prediction. Furthermore , extensive experiments on two open-sourced datasets demonstrated that Sim-MSTNet outperforms state-of-the-art baselines. Figure 1: Structure of Sim-MSTNet model. 2 METHOD 2.1 Problem Formulation We formulate sim2realtransfer as a bilevel optimization problem and employ domain randomization through sample reweighting, \displaystyle\min_{\boldsymbol{w}} \displaystyle G(\boldsymbol{w},\boldsymbol{\phi})=\frac{1}{|\mathcal{D}_{v}|}\sum_{(\boldsymbol{x}_{i},y_{i})\in\mathcal{D}_{v}}\mathcal{L}(\boldsymbol{x}_{i},y_{i},\boldsymbol{\phi}^{*}(\boldsymbol{w})), (1) \displaystyle\text{s.t.} \displaystyle\boldsymbol{\phi}^{*}(\boldsymbol{w})=\arg\min_{\boldsymbol{\phi}}\frac{1}{|\mathcal{D}_{s}|}\sum_{(\boldsymbol{x}_{i},y_{i})\in\mathcal{D}_{s}}\sigma(w_{j})\mathcal{L}(\boldsymbol{x}_{i},y_{i},\boldsymbol{\phi}), where \boldsymbol{w} are sample weights, \boldsymbol{\phi} are model parameters, \mathcal{D}_{v} is the real validation dataset, \mathcal{D}_{s} is the simulated dataset, and \sigma(\cdot) is the sigmoid function. Problem ( 1 ) is extremely difficult to solve due to its non-smooth and non-convex nature. To address this challenge, we employ a K-step gradient descent approximation to replace the intractable lower-level optimization. Specifically, we approximate \boldsymbol{\phi}^{*}(\boldsymbol{w}) through the following iterative process, \boldsymbol{\phi}_{k+1}=\boldsymbol{\phi}_{k}-\eta\nabla_{\boldsymbol{\phi}}g(\boldsymbol{w},\boldsymbol{\phi}_{k}),\quad k=0,1,\ldots,K-1, (2) where g(\boldsymbol{w},\boldsymbol{\phi})=\frac{1}{|\mathcal{D}_{s}|}\sum_{(\boldsymbol{x}_{i},y_{i})\in\mathcal{D}_{s}}\sigma(w_{j})\mathcal{L}(\boldsymbol{x}_{i},y_{i},\boldsymbol{\phi}) is the weighted loss on simulated data. The approximate solution is then given by: \psi(\boldsymbol{w})=\boldsymbol{\phi}_{0}-\eta\sum_{k=0}^{K-1}\nabla_{\boldsymbol{\phi}}g(\boldsymbol{w},\boldsymbol{\phi}_{k}). (3) This approximation transforms the bilevel optimization into a single-level constrained problem where the constraint becomes h(\boldsymbol{w},\boldsymbol{\phi})=\|\boldsymbol{\phi}-\psi(\boldsymbol{w})\|_{1}\leq\epsilon , making the problem computationally tractable while preserving the essential structure of the original formulation. 2.2 Cutting-Plane-based Optimization Algorithm To solve the constrained optimization problem efficiently, we develop a two-phase algorithm that dynamically manages the polyhedral approximation. The algorithm alternates between updating optimization variables and refining the polyhedron by adding/removing cutting planes. The algorithm operates in two phases with different update strategies, Phase 1 ( t<T_{1} ): Dynamic polyhedron updates \displaystyle\boldsymbol{w}^{t+1} \displaystyle=\boldsymbol{w}^{t}-\eta_{\boldsymbol{w}}\nabla_{\boldsymbol{w}}L_{q},\quad\boldsymbol{\phi}^{t+1}=\boldsymbol{\phi}^{t}-\eta_{\boldsymbol{\phi}}\nabla_{\boldsymbol{\phi}}L_{q}, (4) \displaystyle\mu_{l}^{t+1} \displaystyle=\mu_{l}^{t}+\eta_{\mu_{l}}\nabla_{\mu_{l}}L_{q}. (5) Every \delta iterations: remove inactive planes ( \mu_{l}=0 ) and add new planes when h(\boldsymbol{w}^{t+1},\boldsymbol{\phi}^{t+1})>\epsilon . New cutting plane coefficients are derived from the gradient of h , \displaystyle\boldsymbol{a}_{l} \displaystyle=\frac{\partial h(\boldsymbol{w}^{t+1},\boldsymbol{\phi}^{t+1})}{\partial\boldsymbol{w}},\quad\boldsymbol{b}_{l}=\frac{\partial h(\boldsymbol{w}^{t+1},\boldsymbol{\phi}^{t+1})}{\partial\boldsymbol{\phi}}, (6) \displaystyle c_{l} \displaystyle=h(\boldsymbol{w}^{t+1},\boldsymbol{\phi}^{t+1})-\left[\frac{\partial h}{\partial\boldsymbol{w}},\frac{\partial h}{\partial\boldsymbol{\phi}}\right]^{\top}\left[\boldsymbol{w}^{t+1},\boldsymbol{\phi}^{t+1}\right]^{\top}. (7) Phase 2 ( t\geq T_{1} ): Fixed polyhedron with penalty method \displaystyle\boldsymbol{w}^{t+1} \displaystyle=\boldsymbol{w}^{t}-\eta_{\boldsymbol{w}}\nabla_{\boldsymbol{w}}\hat{L}_{q},\quad\boldsymbol{\phi}^{t+1}=\boldsymbol{\phi}^{t}-\eta_{\boldsymbol{\phi}}\nabla_{\boldsymbol{\phi}}\hat{L}_{q}, (8) where \hat{L}_{q}=G(\boldsymbol{w},\boldsymbol{\phi})+\sum_{l}\mu_{l}(\max\{0,\boldsymbol{a}_{l}^{\top}\boldsymbol{w}+\boldsymbol{b}_{l}^{\top}\boldsymbol{\phi}+c_{l}\})^{2} . The two-phase design balances exploration (Phase 1) and exploitation (Phase 2), ensuring both adaptive constraint refinement and stable convergence. Algorithm 1 Cutting-Plane Sample Reweighting 1: Input : \boldsymbol{w}^{0},\boldsymbol{\phi}^{0},\mathcal{P}^{0},\boldsymbol{\mu}^{0} 2: t=0 3: while not converged

Read the complete text