Hardware-Level QoS Enforcement Features: Technologies, Use Cases, and Research Challenges
Oliver Larsson, Thijs Metsch, Cristian Klein, Erik Elmroth · 2025
Read Hardware-Level QoS Enforcement Features: Technologies, Use Cases, and Research Challenges by Oliver Larsson, Thijs Metsch, Cristian Klein, Erik Elmroth (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-15542.txt.
Introduction
Oliver Larsson, Thijs Metsch, Cristian Klein, and Erik Elmroth survey hardware tools that enforce quality of service in servers in a 2025 paper. Modern chips can split shared resources, such as memory bandwidth, between jobs and shift those shares on the fly. Scholars have rushed to use these features, but the field lacked a map of what has been tried.
The authors gather the relevant papers, sort the methods into a new taxonomy, and note strengths, gaps, and trends. They spot a chance to use hardware enforcement in service-based cloud systems, where many small services share one machine. The paper closes with open problems, giving newcomers a guide to where the research stands.
Catalog record
| CREATOR | Oliver Larsson, Thijs Metsch, Cristian Klein, Erik Elmroth |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 107 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-15542
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Hardware-Level QoS Enforcement Features: Technologies, Use Cases, and Research Challenges Oliver Larsson, Thijs Metsch, Cristian Klein, Erik Elmroth Abstract . Recent advancements in commodity server processors have enabled dynamic hardware-based quality-of-service (QoS) enforcement. These features have gathered increasing interest in research communities due to their versatility and wide range of applications. Thus, there exists a need to understand how scholars leverage hardware QoS enforcement in research, understand strengths and shortcomings, and identify gaps in current state-of-the-art research. This paper observes relevant publications, presents a novel taxonomy, discusses the approaches used, and identifies trends. Furthermore, an opportunity is recognized for QoS enforcement utilization in service-based cloud computing environments, and open challenges are presented. CCS: Computer systems organization Cloud computing CCS: Computer systems organization Real-time systems CCS: Software and its engineering Memory management CCS: Hardware Semiconductor memory † † cc-license: by ©2025 Copyright held by the owner/author(s). This is the author accepted manuscript of a paper published in ACM Computing Surveys (CSUR) , open access under the Creative Commons Attribution (CC BY 4.0) license. The final version is available at the ACM Digital Library: https://doi.org/10.1145/3774317 . 1. Introduction Support for management and partitioning of shared system resources such as shared cache and memory bandwidth has recently become available in commercial off-the-shelf x86 server processors. The features, which we refer to as hardware-based quality-of-service (QoS) enforcement features , may be dynamically controlled at runtime using processor model-specific registers or an operating system-level interface. They enable systems to enforce availability guarantees and mitigate the interference caused by shared resource congestion. The benefits of intelligently tuning such features have been shown in previous work to include increased system performance Lo et al., 2015 , improved system utilization Patel & Tiwari, 2020 , and reduced power consumption Nejat et al., 2022 . However, to the best of our knowledge, there has been no previous attempt at surveying the academic and industrial landscapes to understand the applicability of these new features in different contexts. One such context of interest is that of general-purpose cloud computing. The cloud-connected nature of day-to-day applications implies that performance issues of cloud-based web services now have a prevalent impact on the daily lives of the general population in a way that was unthinkable a few decades ago. In fact, a 2023 US-based survey indicated that 48\% of companies use industry-tailored clouds with another 20\% intending to make the transition to cloud-based solutions within 12 months Ballard, 2023 . Latency-sensitive web services are often referred to as latency critical (LC) tasks, which is one of two broad categories cloud-based workloads may be classified into. The response times of LC services often directly affect the end-user experience and are therefore monitored and kept to performance targets specified by service level objectives (SLOs). Best-effort (BE) jobs on the other hand are time non-critical, predictable workloads that may run whenever sufficient resources become available, commonly using a batch-format scheduling system. Thus, such jobs are well suited to improve server utilization by consuming resources left unused by LC services based on current loads, a technique leveraged by several previous works Lo et al., 2015 ; Chen et al., 2019a ; Nikas et al., 2019 ; Patel & Tiwari, 2020 ; Papadakis et al., 2017 ; Qin, 2017 ; Qiu et al., 2021 ; Zhao et al., 2020 ; Li et al., 2020 ; Zhu & Erez, 2016 ; Chen et al., 2019 . BE tasks such as machine learning training or big data analysis jobs are often data intensive and consequently disproportionately “noisy” users of shared system resources. Unless mitigated, this congestion may negatively affect the performance of LC services Dasari et al., 2013 . The congestion of shared resources such as last-level cache (LLC) and memory bandwidth (MB) caused by the co-location of workloads on multicore systems has been shown in previous studies to reduce system performance Dasari et al., 2013 ; Löfwenmark & Nadjm-Tehrani, 2016 ; Zhuravlev et al., 2010 . The importance of this becomes evident when considering the SLOs that web services often are required to meet. Not reaching performance targets due to resource congestion may end up costly as BE jobs may need to be canceled and re-queued. Alternatively, additional computing resources may need to be provisioned if permitted by the underlying infrastructure platform. Hardware-based QoS enforcement features are designed to mitigate the issues of shared resource congestion. However, hardware-based QoS enforcement is indirect in nature (see Section 2 ) and thus, intelligent tuning is required to achieve predictable and performant service operations in cloud environments. Although intelligent management of shared resources has been shown to improve workload performance and energy efficiency, popular hypervisors and container orchestration engines still lack support for autonomous management of QoS enforcement on supported platforms. We thus identify an opportunity for further performance improvements in general-purpose cloud computing environments, but also question why the adoption of QoS enforcement has not yet been made widespread despite the promises of improved performance. Consequently, there exists a need to review the approaches proposed by researchers that utilize hardware-based QoS enforcement features. We review published research and map how the features provide value and the problems they help solve. Furthermore, we propose a novel taxonomy and investigate the contexts in which such features are discussed such that gaps in current state-of-the-art research and areas of feature application may be identified. Additionally, a discussion of the reasons behind the lack of autonomous QoS enforcement management solutions available in widespread workload management systems is presented. 1.1. Our Contributions In this survey, we perform a thorough review of published research that integrates hardware-based QoS enforcement features as an integral part of their proposals. Thus, a complete scope of the currently identified applicability of features may be outlined. In summary, we make the following contributions: (1) We survey a search space of 3685 articles and identify 78 papers that fit the inclusion criteria defined for our review. (2) We present a novel taxonomy of the included state-of-the-art research that details approaches and techniques that leverage hardware QoS enforcement. (3) We discuss the ways hardware QoS enforcement features are utilized and identify reasons why they have not reached widespread adoption in autonomous cloud computing environments. (4) We detail gaps in current state-of-the-art research and present opportunities for future investigations. Our proposed taxonomy addresses a significant gap in the current literature. It serves as a foundation for understanding the state-of-the-art research and provides a novel overview of the applicability of hardware-based QoS enforcement features across various contexts. Additionally, we identify a lack of adoption of QoS enforcement in general-purpose cloud computing. By analyzing the literature, we aim to understand the common limitations and challenges that hinder the practicality and widespread adoption of QoS enforcement in the cloud. To this end, we present trends in the research landscape and identify challenges that need to be addressed to facilitate wider adoption of QoS enforcement in autonomous cloud computing environments. 2. Hardware-based QoS Enforcement Features and their Origins The rapidly increasing number of cores available on a single multi-core processor has enabled larger numbers of workloads to be co-located on a single machine. While this has its advantages, it puts increasing pressure on the resources shared among the cores of