SHARP-QoS: Sparsely-gated Hierarchical Adaptive Routing for joint Prediction of QoS

Suraj Kumar, Arvind Kumar, Soumi Chattopadhyay · 2025

Read SHARP-QoS: Sparsely-gated Hierarchical Adaptive Routing for joint Prediction of QoS by Suraj Kumar, Arvind Kumar, Soumi Chattopadhyay (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-17262.txt.

Introduction

Suraj Kumar, Arvind Kumar, and Soumi Chattopadhyay address a practical guessing game: how well will a web service perform before anyone calls it? Quality-of-service numbers, such as speed and failure rate, guide that choice, but real records are sparse, noisy, and tangled with place and network effects. Older tools predict each number with a separate model.

Their model, SHARP-QoS, predicts all the numbers together. It reads layered structure with a curved-space method, lets related signals share what they learn through a gate, and balances the training losses so one number cannot swamp the rest. On three data sets it beat both single-task and joint rivals. It also held up under missing data, odd outliers, and brand-new services.

Catalog record

CREATORSuraj Kumar, Arvind Kumar, Soumi Chattopadhyay
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-17262

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SHARP-QoS: Sparsely-gated Hierarchical Adaptive Routing for joint Prediction of QoS Suraj Kumar, Arvind Kumar, Soumi Chattopadhyay Abstract Dependable service-oriented computing relies on multiple Quality-of-Service (QoS) parameters that are essential to measure service optimality. However, real-world QoS data are extremely sparse, noisy, and shaped by hierarchical dependencies arising from QoS interactions, geographical constraints, and network-level factors, making accurate QoS prediction challenging. Existing deep learning–based methods often predict each QoS parameter separately, requiring multiple similar models, which increases computational overhead and leads to poor generalization. Although recent joint QoS prediction studies have explored shared architectures, they suffer from negative transfer due to loss-scaling issues caused by inconsistent numerical ranges across QoS parameters and further struggle with inadequate representation learning and suboptimal joint optimization, resulting in degraded accuracy. In this paper, we present a data-driven strategy for joint QoS prediction, called SHARP-QoS, that addresses these limitations through three complementary components. First, we introduce a dual mechanism to extract the hierarchical features from both QoS and contextual structures using hyperbolic convolution formulated in the Poincaré ball. Second, we propose an adaptive feature-sharing mechanism that allows feature exchange across informative QoS and contextual signals. A gated feature fusion module is introduced to support dynamic feature selection among structural and shared representations. Third, we design an EMA-based loss balancing strategy that enables stable joint QoS-optimization, thereby mitigating the negative transfer. Evaluations on three datasets with two, three, and four QoS parameters demonstrate that our framework outperforms both single- and multi-task baselines. Extensive study on the module, and hyperparameters sensitivity shows that our model effectively addresses major challenges, including sparsity resilience, robustness to outliers, and strong cold-start handling, while maintaining moderate computational overhead, underscoring its capability for reliable joint QoS prediction. I Introduction Service-oriented architectures (SoA) utilize independent, reusable, and loosely coupled services to build web/cloud applications [ 34 , 10 ] . However, with the rapid advancement of networking/cloud-based AI technologies, numerous service providers offer functionally similar services, making it increasingly difficult for users or businesses to select the optimal service. Existing studies show that a service’s non-functional parameters (e.g. response time, throughput, and reliability), collectively known as Quality of Service (QoS) parameters, can be effectively used to assess both service optimality and runtime performance. Thus, QoS parameters have been widely utilize for the service selection, composition, and recommendation. Nevertheless, in real-world service ecosystems, obtaining QoS values for all available services is a non-trivial task, leading to high resource and time consumption when monitored manually. Hence, QoS prediction has emerged as a challenging task, often resembling the problem of missing value prediction [ 32 , 30 , 36 ] . Traditional QoS prediction methods primarily rely on collaborative filtering (CF), often using user/service similarity [ 1 , 23 , 32 ] . However, they continue to struggle with data sparsity, cold-start cases, and outliers. To address these challenges, reconstruction-based predictive models have emerged. These include matrix factorization (MF) [ 22 , 30 ] , exploiting first-order (linear) features, factorization machines (FM) [ 29 ] extend this to second-order interactions, and deep architectures (e.g. multilayer perceptrons (MLP) [ 36 , 31 ] and graph convolutional networks (GCNs)), capture nonlinear, higher-order features/graph structure [ 18 , 17 ] . Hybrid methods, combining these approaches, further enhance QoS prediction performance [ 4 , 36 , 13 ] . While effective, these methods struggle when multiple QoS parameters must be jointly considered for optimal service performance. For instance, the ideal functioning of autonomous vehicles (AVs) relies on precise decision-making based on multiple QoS parameters that dictate service performance. However, designing separate models for each QoS parameter leads to increased computational costs (e.g., more parameters and floating-point operations), poor generalization, and longer inference times. Hence, there is a need for a unified framework that enables joint QoS modeling, allowing the simultaneous prediction of all QoS parameters [ 28 , 15 ] . First proposed by [ 2 ] , multi-task learning (MTL) enables simultaneous prediction across multiple tasks by sharing knowledge, improving generalization, and capturing task interdependencies. However, MTL for QoS prediction is challenging due to several underlying issues, including data sparsity, cold start, and outliers, which essentially require attentive multi-task representation learning. Recent studies have formulated MTL approaches for QoS prediction. DNM [ 28 ] introduced additive and multiplicative cross-context interactions, followed by an MLP to capture higher-order dependencies. JQSP [ 8 ] employed a graph attention network (GAT) to ID-based features and used an outlier-sensitive loss. MGEN [ 20 ] utilized a gated expert network to capture context-specific and QoS-specific latent features. HTG [ 5 ] adopted a GAT for cold-start-aware MTL but heavily relies on sensitive topology information. Although competitive, they often encounter a task dominance problem during training due to the numerical range difference of QoS parameters, leading to negative transfer. To address this issue, PMT [ 15 ] optimized task losses using a Gaussian likelihood with homoscedastic uncertainty via a multi-expert architecture with an attention mechanism. Besides this, WAMTL [ 25 ] adopted dynamic weight averaging (DWA) to adjust loss weights based on past loss reduction rates, and used a multi-gate mixture-of-experts (MoE) framework. However, this approach suffers from overfitting due to the over- or under-utilization of experts. Despite these advances, existing methods still overlook implicit hierarchical dependencies and shared contextual correlations across QoS parameters. Moreover, task-balancing strategies used in works such as [ 25 , 15 ] often exhibit numerical instability and oscillatory convergence, resulting in suboptimal multi-task performance. To address these limitations, we propose a unified framework for joint QoS prediction, called SHARP-QoS, which allows adaptive multi-task representation learning by leveraging contextual data and complementary QoS signals. The framework comprises three key components: (i) We introduce a Hierarchical Feature Extraction Block (HFEB) to capture implicit hierarchical dependencies across QoS and contextual features, enabling richer representations while preserving user/service privacy. (ii) Inspired by Sub-Network Routing (SNR) [ 21 ] , a dual feature exchange mechanism is designed to share across both QoS- and contextual-features, while maintaining computational efficiency, unlike previous approaches. Besides this, a gated feature fusion module is employed, which selectively integrates relevant representations from shared and structure-aware features. (iii) The Exponential Moving Average (EMA) is introduced to smooth short-term fluctuations in training due to loss scale, ensuring robust optimization for joint QoS prediction. The key contributions are summarized below: • We propose a data-driven joint QoS prediction framework that leverages implicit hierarchical features from both QoS and context data. A feature-sharing and fusion layer is introduced that enables effective parameter sharing through QoS and contextual features, and dynamically selects task-specific features among structural and shared representations, resulting in enhanced QoS prediction performance. • We introduce an EMA-based loss balancing strategy that reduces short-term oscillation and resolves inter-attribute conflicts across multiple QoS tasks, mitigating the negative transfer problem caused by numerical range discrepancies among QoS parameters, leading to faster convergence and improved generalization across tasks. • Extensive experiments are conducted on three datasets: WS-DREAM-2T [ 33 ] , small-3T [ 15 ] , and a gRPC-4T dataset [ 13 ] , covering two, three, and four QoS parameters, respectively. To ensure the reliability of our results, we include ablation studies, hyperparameter analysis, impact of outliers and cold-start, and statistical significance tests, demonstrating the effectiveness

Read the complete text