Benchmarking Dynamic SLO Compliance in Distributed Computing Continuum Systems
Alfreds Lapkovskis 1 , Boris Sedlak 2 , Sindri Magnússon 1 , Schahram Dustdar 2 3 , and Praveen Kumar Donta 1 · 2025
Read Benchmarking Dynamic SLO Compliance in Distributed Computing Continuum Systems by Alfreds Lapkovskis 1 , Boris Sedlak 2 , Sindri Magnússon 1 , Schahram Dustdar 2 3 , and Praveen Kumar Donta 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-03274.txt.
Introduction
Alfreds Lapkovskis and four co-authors test ways to keep service goals in spread-out computing systems, in a 2025 benchmark study. Such systems mix edge gear, servers, and cloud parts with unlike traits. Loads swing and parts run short, so service goals often slip. Machine learning can help, but design choices pile up.
The team pits a brain-inspired method, called active inference, against three known learning methods. The test rig runs video calls on an edge device next to a video server. Each method tunes stream count, frame rate, and sharpness as goals shift and networks clog. The brain-inspired method used less memory, held steady chip use, and settled fast.
Catalog record
| CREATOR | Alfreds Lapkovskis 1 , Boris Sedlak 2 , Sindri Magnússon 1 , Schahram Dustdar 2 3 , and Praveen Kumar Donta 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-03274
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Benchmarking Dynamic SLO Compliance in Distributed Computing Continuum Systems Alfreds Lapkovskis 1 , Boris Sedlak 2 , Sindri Magnússon 1 , Schahram Dustdar 2 3 , and Praveen Kumar Donta 1 Abstract Ensuring Service Level Objectives (SLOs) in large-scale architectures, such as Distributed Computing Continuum Systems (DCCS), is challenging due to their heterogeneous nature and varying service requirements across different devices and applications. Additionally, unpredictable workloads and resource limitations lead to fluctuating performance and violated SLOs. To improve SLO compliance in DCCS, one possibility is to apply machine learning; however, the design choices are often left to the developer. To that extent, we provide a benchmark of Active Inference—an emerging method from neuroscience—against three established reinforcement learning algorithms (Deep Q-Network, Advantage Actor-Critic, and Proximal Policy Optimization). We consider a realistic DCCS use case: an edge device running a video conferencing application alongside a WebSocket server streaming videos. Using one of the respective algorithms, we continuously monitor key performance metrics, such as latency and bandwidth usage, to dynamically adjust parameters—including the number of streams, frame rate, and resolution—to optimize service quality and user experience. To test algorithms’ adaptability to constant system changes, we simulate dynamically changing SLOs and both instant and gradual data-shift scenarios, such as network bandwidth limitations and fluctuating device thermal states. Although the evaluated algorithms all showed advantages and limitations, our findings demonstrate that Active Inference is a promising approach for ensuring SLO compliance in DCCS, offering lower memory usage, stable CPU utilization, and fast convergence. I Introduction Over the decades, computing environments have evolved cyclically, shifting between centralized, decentralized, and distributed models based on technological advancements and organizational needs [ 1 , 2 , 3 ] . Recently, distributed environments, particularly those incorporating edge computing and IoT, have gained prominence due to their advantages, such as low latency and enhanced privacy [ 4 , 5 ] . In this ongoing evolution, Distributed Computing Continuum Systems (DCCS) have emerged as a powerful approach, efficiently integrating multiple computational tiers into a cohesive ecosystem that ensures trade-off between cost, Quality of Service (QoS), and resource utilization at scale [ 6 ] . In DCCS, tasks are allocated dynamically based on multiple criteria, including proximity, capacity, cost, and priority, enhancing real-time processing and minimizing latency. Unlike traditional edge computing, they offer fault tolerance by reallocating tasks to other available servers in case of device failure, ensuring uninterrupted computation [ 7 , 8 ] . Additionally, DCCS prioritize resource efficiency, enabling scalable and adaptive computing across the continuum. They maintain a high Quality of Experience (QoE) despite changing system requirements and environmental uncertainties by effectively managing resources [ 9 , 10 ] . Simultaneously, DCCS are complex, open systems, vulnerable to workload spikes, evolving requirements, and dynamic infrastructure changes [ 6 ] . These challenges necessitate adaptive capabilities to maintain optimal performance and resilience. However, anticipating all possible system configurations and environmental conditions is often impractical. Therefore, DCCS require pervasive intelligence across the entire continuum to ensure seamless integration, optimal performance, and robust management. This intelligence enables the system to respond to fluctuations in workload and changing conditions dynamically, ensuring reliability and efficiency in real-time processing and resource allocation [ 11 ] . Thus, Service Level Objectives (SLOs) [ 12 , 13 , 14 , 15 ] are introduced to provide a structured approach for monitoring, predicting, and managing or adapting system behavior across diverse computing environments. By establishing clear performance targets, SLOs enable adaptive mechanisms that respond dynamically to fluctuations in workload and changing conditions, ensuring that the system meets predefined performance standards. In the literature, various mechanisms have been explored for the dynamic adaptation of workloads through effective orchestration strategies [ 16 ] . While these topics are gradually addressed by applying different machine learning (ML) mechanisms, e.g., [ 17 , 18 ] , these works fail to provide a fundamental understanding of which ML techniques to apply to ensure SLOs. For example, with Octopus [ 18 ] , the authors created an SLO-aware inference scheduler based on Advantage Actor-Critic (A2C). For evaluation, the common scheme here is to use baselines designed for a different use case or have a completely different architecture. Within Octopus , the open question is whether other ML techniques, e.g., Proximal Policy Optimization (PPO), would have performed superiorly. To provide a profound understanding of how different ML techniques rank for ensuring SLOs in a DCCS application, this paper provides benchmarks that target various aspects of the techniques. While there exist benchmarking solutions for pure Edge computing [ 19 ] , the evaluated solutions were not intended for the DCCS. Also, runtime adaptations for stream processing [ 20 ] have a long history, but they are designed for static requirements, while SLOs, derived from a business context, are an evolving system property. Meanwhile, Active Inference (AIF) [ 21 ] —a concept from neuroscience—is gaining significant attention due to its ability to efficiently predict and adapt to changing conditions. AIF attempts to explain the behavior and learning of sentient creatures; to raise the level of intelligence in DCCS, AIF is also increasingly adopted in computer science. Recent literature [ 22 , 23 ] has shown that AIF agents can effectively ensure SLO compliance, maintain high QoS and QoE, and continuously learn and adapt to dynamically changing environments and requirements. The promising results of AIF in DCCS inspire further exploration and also draw our curiosity to evaluate its performance against Reinforcement Learning (RL)-based algorithms (Deep Q-Network (DQN) [ 24 ] , A2C [ 25 ] , and PPO [ 26 ] ), which have recently gained popularity and demonstrated significant benefits across various applications. To the best of our knowledge, we are thus the first to provide a benchmarking solution for dynamic SLO compliance. During our study, we found that many existing works are conducted under simplified assumptions, lacking the complexity of real-world application scenarios. Hence, we simulate realistic video conferencing applications to rigorously test the aforementioned algorithms, ensuring a comprehensive evaluation of their performance and adaptability. In this context, our contributions are threefold, as outlined below: 1. To evaluate algorithms in a realistic environment, we implement a custom DCCS use case that contains (i) an edge device running a video conferencing application and (ii) a WebSocket server streaming videos to the edge device. To ensure device SLOs, the server hosts an intelligent agent that optimizes the number of video streams, frames per second (FPS), and video resolution. 2. We provide a benchmark for dynamic QoS and QoE fulfillment in DCCS. This simplifies the design choice for stakeholders by providing insights into the different capabilities of AIF and common RL algorithms. 3. To further compare the algorithms’ robustness against dynamic changes in environment or system requirements, we perform a series of experiments, where: (a) We introduce an instant distribution shift by significantly limiting network bandwidth. (b) We introduce a gradual distribution shift by simulating an overheating device. This shows if algorithms can differentiate between dynamic system evolution and environmental noise. (c) We change SLO thresholds to see whether algorithms can dynamically adapt to new objectives. The remaining sections of this paper are organized as follows: Section II provides an overview of AIF and common RL algorithms. Section III