Analyzing homogenous and heterogeneous multi-server queues via neural networks

Eliran Sherzer · 2025

Read Analyzing homogenous and heterogeneous multi-server queues via neural networks by Eliran Sherzer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-01052.txt.

Introduction

Sherzer predicts queue behaviour with neural networks in twenty twenty-five. Queues with several servers are hard to analyse when arrival and service times are general. Exact stationary distributions are rarely available in closed form. He trains networks to predict how many customers occupy the system.

Two systems are covered: identical servers, and a pair of unlike servers. Inputs are just the first four moments of arrival and service times. Adding a fifth moment did not improve accuracy. Errors stayed under five percent in most tests. The identical server results match or beat the best existing methods. The mixed server case had no prior predictor at all. Inference is fast, with thousands of predictions in a fraction of a second.

Catalog record

CREATOREliran Sherzer
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-01052

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Analyzing homogenous and heterogeneous multi-server queues via neural networks Eliran Sherzer Abstract In this paper, we use a machine learning approach to predict the stationary distributions of the number of customers in a single-staiton multi server system. We consider two systems, the first is c c homogeneous servers, namely the G ​ I / G ​ I / c GI/GI/c queue. The second is a two-heterogeneous server system, namely the G ​ I / G ​ I i / 2 GI/GI_{i}/2 queue. We train a neural network for these queueing models, using the first four inter-arrival and service time moments. We demonstrate empirically that using the fifth moment and beyond does not increase accuracy. Compared to existing methods, we show that in terms of the stationary distribution and the mean value of the number of customers in a G ​ I / G ​ I / c GI/GI/c queue, we are state-of-the-art. Further, we are the only ones to predict the stationary distribution of the number of customers in the system in a G ​ I / G ​ I i / 2 GI/GI_{i}/2 queue. We conduct a thorough performance evaluation to assert that our model is accurate. In most cases, we demonstrate that our error is less than 5%. Finally, we show that making inferences is very fast, where 5000 inferences can be made in parallel within a fraction of a second. keywords GI/GI/c queues, Heterogeneous servers queues, neural network 1 Introduction Multi-server queues are commonly found in systems like airports, factories, and hospitals, making them a subject of considerable research interest for analyzing their dynamics and quantifying their performance. Exact results for the multi-server queueing systems are known only for Markovian systems (e.g., Seelen (1986) ; Li and Stanford (2016) ; Calvo and Arteaga (2024) ). When the Markovian assumptions are relaxed, researchers move to approximation methods. For example, the GI/GI/c queue has several approximation methods WHITT (1993) ; Chaves and Gosavi (2022) ; Shore (1988) . However, most approximation methods are based only on the first two moments of the inter-arrival and service time distributions. According to Gupta et al. (2010) , no approximation based on only the first two moments can be accurate for all job size distributions for the M/GI/c queue. Therefore, the results in Gupta et al. (2010) are likely applicable to the GI/GI/c system studied in this paper, as it represents a more general and complex case compared to the M/GI/c queue. A common method for analyzing the performance of complex queueing models is through computer simulation (e.g., see Sinreich and Marmor (2005) ; Zeltyn et al. (2011) ). However, as noted by Dieker et al. (2017) , a significant limitation of simulation-based optimization methods is the substantial computational effort required to obtain optimal solutions for service operation problems in multidimensional stochastic networks. Thus, a new approach is warranted. This paper proposes a steady-state analysis of a multi-server system using machine learning (ML). In past years, there has been a growing number of queueing models which approximate queueing measures Baron et al. (2022) ; Baron et al. (2024) ; Sherzer (2024) ; Nii et al. (2020) ; Efrosinin et al. (2025) ; Sherzer et al. (2024) ; Tan and Khayyati (2022) . These models attack different queueing problems, such as transient single-server queues or tandem queueing systems. However, all these studies except two ( Nii et al. (2020) ; Efrosinin et al. (2025) ) consider only single-server stations. While Nii et al. (2020) ; Efrosinin et al. (2025) considers a G/G/c , they are also based on a two-moment approximation which yields large errors. The majority of papers use neural networks (NNs) as their ML framework Baron et al. (2022) ; Sherzer et al. (2024) ; Baron et al. (2024) ; Sherzer (2024) ; Nii et al. (2020) ; Efrosinin et al. (2025) , with one exception where Tan and Khayyati (2022) uses Gaussian process. This paper examines two queueing models. The first is the GI/GI/c model, where both inter-arrival and service times follow general renewal processes, and the system comprises c identical servers. We aim to approximate the stationary distribution of the number of customers in the system. To demonstrate the robustness of our approach, we also consider a GI/GI_{i}/2 model with two heterogeneous servers, again focusing on approximating the stationary distribution. We adopt a supervised learning approach, selecting NNs as the ML framework for both models. Applying supervised learning with NNs to analyze a queueing system presents three main challenges. First, generating a sufficiently diverse set of training input instances, i.e., inter-arrival and service time distributions, is necessary. The resulting dataset must provide broad coverage of the distribution space—ideally representing all possible positive-valued distributions. Second, obtaining the output labels for a given input instance is challenging. In this context, labels correspond to the system distribution values (i.e., the steady-state distribution of the number of customers in the system). Constructing the training set requires accurately generating distributions for numerous instances of intractable queueing models. Third, representing continuous distributions, such as inter-arrival and service time distributions, discretely, as required by NN inputs. The input must be converted into a tensor format, which can lead to information loss. These challenges were previously raised in Baron et al. (2024) , necessitating the development of a suitable distribution-to-tensor mapping. To address the first challenge, we utilize the Phase-Type (PH) family of distributions. This family is known to be dense within the class of all non-negative distribution functions; a PH distribution with a sufficient number of phases can approximate any non-negative distribution to arbitrary precision, see ( Asmussen, 2003 , Theorem 4.2, Chapter III) . This property enables the construction of a diverse training set by sampling from the space of PH distributions. However, sampling from the PH space is non-trivial, as the parameters describing a PH distribution are interdependent and must satisfy multiple constraints. To overcome this, we employ a flexible sampling method capable of generating a diverse set of distributions, which was developed in Baron et al. (2024) . For the second challenge, labeling the input data requires discrete event simulations. While simulation is computationally expensive, and this may seem counterproductive—given that ML is intended to reduce dependence on simulations—this limitation is mitigated because labeling occurs offline. During this phase, substantial computational resources can be temporarily allocated without the need for real-time response. Once trained, the ML model enables near real-time inference, in contrast to simulations, which can take minutes to hours. Furthermore, the ML approach only requires a finite training dataset. After training, the model can make predictions for an infinite number of instances. To tackle the third challenge—efficiently encoding inter-arrival and service time distributions for the NN—we use the first n moments of the input distributions. These moments can be computed analytically when expressions for the distributions are available or estimated from observed data. The value of n is determined through hyperparameter tuning during training. For the heterogeneous GI/GI_{i}/2 model, the network is provided with the first n moments of the service time distributions for both servers. Investigating the impact of the choice of n on the model’s accuracy is of particular interest. Similar studies in Baron et al. (2022) ; Baron et

Read the complete text