Automating Multi-Tenancy Performance Evaluation on Edge Compute Nodes
Joanna Georgiou, Moysis Symeonides, George Pallis, Marios D. Dikaiakos · 2025
Read Automating Multi-Tenancy Performance Evaluation on Edge Compute Nodes by Joanna Georgiou, Moysis Symeonides, George Pallis, Marios D. Dikaiakos (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-10461.txt.
Introduction
Joanna Georgiou, Moysis Symeonides, George Pallis, and Marios Dikaiakos automate the testing of shared edge computers, in a 2025 paper. Edge nodes sit between devices and the cloud, and owners rent them to several tenants at once through virtualization. Tenants sharing hardware can slow each other down, so administrators must test which workloads coexist well. Doing that by hand means endless cycles of configuring, deploying, and measuring.
Their auto-benchmarking framework streamlines the whole loop. It runs co-location scenarios systematically and analyzes the results for performance and energy. The goal is practical: pack edge infrastructure tightly without letting one tenant's workload wreck another's. As edge deployments multiply, such tooling separates a rentable platform from an unreliable one.
Catalog record
| CREATOR | Joanna Georgiou, Moysis Symeonides, George Pallis, Marios D. Dikaiakos |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-10461
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Automating Multi-Tenancy Performance Evaluation on Edge Compute Nodes Joanna Georgiou, Moysis Symeonides, George Pallis, Marios D. Dikaiakos Abstract Edge Computing emerges as a promising alternative of Cloud Computing, with scalable compute resources and services deployed in the path between IoT devices and Cloud. Since virtualization techniques can be applied on Edge compute nodes, administrators can share their Edge infrastructures among multiple users, providing the so-called multi-tenancy. Even though multi-tenancy is unavoidable, it raises concerns about security and performance degradation due to resource contention in Edge Computing. For that, administrators need to deploy services with non-antagonizing profiles and explore workload co-location scenarios to enhance performance and energy consumption. Achieving this, however, requires extensive configuration, deployment, iterative testing, and analysis, an effort-intensive and time-consuming process. To address this challenge, we introduce an auto-benchmarking framework designed to streamline the analysis of multi-tenancy performance in Edge environments. Our framework includes a built-in monitoring stack and integrates with widely used benchmarking workloads, such as streaming analytics, database operations, machine learning applications, and component-based stress testing. We perform a case-driven analysis and provide valuable insights into the impact of multi-tenancy on Edge environments with different hardware configurations and diverse workloads. Finally, the implementation of our framework, along with the containerized workloads used for experimentation, is publicly available. I Introduction The rapid expansion of interconnected embedded devices, collectively known as the Internet of Things (IoT), is transforming our daily lives. The number of IoT devices is expected to reach 500 billion by 2030 [ 1 ] , with each device generating vast amounts of data that require analysis. However, processing data on an IoT device is often impractical due to its limited computational capacity and reliability [ 2 ] . Meanwhile, continuously offloading data to centralized cloud infrastructures introduces challenges, including bandwidth constraints [ 3 ] . To bridge this gap, Multi-access Edge Computing (MEC) has emerged as a standardized architecture that, like traditional edge computing, brings processing closer to the IoT devices to enhance efficiency and reduce latency. What distinguishes MEC, however, is its tight integration with the Radio Access Network (RAN), enabling more effective utilization of network resources and further optimizing performance. [ 4 ] . Building on top of this, the 5th/6th generations of mobile networks (5G and 6G) advance the concept of Network Slicing, enabling the creation of multiple isolated virtual networks over a shared physical infrastructure. This allows operators to support multi-tenancy by leasing tailored “slices” of their networks, similarly to how Cloud providers rent out compute resources [ 5 ] .With multi-tenancy, high-speed and performance applications like autonomous driving, drone-based surveillance, agentic workflows and LLM integration can be supported more effectively, as these types of workloads often require multiple machine learning, deep learning and LLM tasks to be executed in parallel [ 6 , 7 , 8 , 9 ] . Multi-tenancy refers to a system’s ability to simultaneously serve multiple tenants (users or applications), while ensuring strict isolation of their data and resources [ 10 ] . A key enabler technology for multi-tenancy on Edge nodes is a lightweight virtualization (containerization) which bundles services into artifacts and runs them as isolated processes with negligible computational overhead [ 11 ] . Generally, service consolidation reduces the operational and maintenance costs of the infrastructure, while it also decreases energy consumption [ 12 ] . Unfortunately, even in cloud infrastructures, multi-tenancy raises concerns about security and performance deterioration of co-located services. Workloads that share the same resources may suffer quality-of-service degradation due to contention for CPU, memory, and network bandwidth. The constrained and heterogeneous nature of Edge devices, along with the diverse profiles of the deployed services, worsens these challenges. For instance, running a set of services on an edge server can deliver high performance, but executing the same services on a resource-constrained device, such as a Raspberry Pi, may significantly increase service latency. This can be problematic for applications that require real-time responsiveness while performing multiple deep learning tasks simultaneously, such as object detection and face recognition for visually impaired users [ 6 ] . To maintain efficiency, edge infrastructure administrators and cluster orchestrators must co-locate services with compatible resource profiles on the same machine. This enables them to (i) assess whether local resources can sustain the workload and (ii) analyze trade-offs associated with multi-tenancy. These considerations are central to informed orchestration decisions. Therefore, it is essential to identify which deployment scenarios or configurations enhance the performance of new or existing services and how to achieve objectives, such as minimizing energy consumption. Addressing this challenge requires the repeated deployment of diverse workloads across a range of configurations, to explore the full spectrum of co-location scenarios, and the continuous collection of performance metrics and infrastructure utilization data, followed by rigorous analysis to identify optimal deployment strategies [ 13 ] . However, as the number of potential configurations grows exponentially with the number of target workloads [ 14 ] , the process quickly becomes intractable. Even though there are many benchmarks that prototype workloads like big data streaming [ 15 ] and machine learning (ML) inference [ 16 ] , very few studies [ 17 , 6 ] actually examine the effects of multi-tenancy in edge environments. Moreover, although tools for automating repeatable performance evaluations are available [ 13 , 18 ] , they lack support for executing concurrent workloads. This paper addresses the critical gap: the absence of a low-cost, scalable and reproducible approach for evaluating performance trade-offs introduced by workload co-location in real-world edge environments. The main contributions of this paper are: • An open-source benchmarking framework [ 19 ] , that facilitates the automated deployment of benchmarking experiments and ensures reproducible performance evaluation of co-located workloads on top of real edge infrastructures. It incorporates comprehensive monitoring for both performance and infrastructure metrics, supports detailed post-experiment analysis, and addresses common challenges in performance evaluation. Our framework leverages cloud-native technologies, including continuous deployment and containerization, to streamline benchmark configuration and deployment, whilst abstracting the hardware heterogeneity across the edge continuum. • A set of publicly accessible containerized workloads [ 20 ] , integrated with our framework to evaluate the performance of edge nodes. These workloads are derived from widely adopted benchmarks [ 15 , 16 , 21 ] and component-based stressors, and each has been modified to support parameterization and easy configuration. As the workloads are independent of the framework, researchers can utilize, extend, or adapt them to their requirements. • A comprehensive, use-case-driven analysis of workload co-location on various edge compute nodes (from Raspberry Pi to edge Servers). Our analysis allows users to assess: (i) ML service performance across various compute nodes, showing that larger Edge servers offer better performance at higher power costs, while smaller devices like Raspberry Pi are more energy-efficient but slower; (ii) the impact of workload co-location, revealing that memory-intensive workloads increase cold start duration of ML services by 1.5x, and CPU or disk I/O stressors reduce CPU availability, degrading performance; (iii) the effects of different co-location configurations, comparing ML inference in two scenarios: (a) processing images locally vs streaming them, with performance varying by up to 3x, and (b) using different execution backends, where ONNX (Open Neural Network Exchange) outperforms NCNN (inference framework optimized for mobile platforms)