Accurate Performance Predictors for Edge Computing Applications
Panagiotis Giannakopoulos, Bart van Knippenberg, Kishor Chandra Joshi, Nicola Calabretta, George Exarchakos · 2025
Read Accurate Performance Predictors for Edge Computing Applications by Panagiotis Giannakopoulos, Bart van Knippenberg, Kishor Chandra Joshi, Nicola Calabretta, George Exarchakos (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-20495.txt.
Introduction
Panagiotis Giannakopoulos and four co-authors set out a way to build and grade app speed gauges for edge sites by rote. True speed calls are key for task plans and stock use at the edge. But apps share nodes, and nodes clash in type, so speed is hard to call. Their way picks the gauge that wins on both truth and call speed.
Gauges train on past logs of the checks most tied to app speed. They are graded on more than one host in live mixed states. Truth tops near 90 in 100, while calls take less than one part in a hundred of trip time. Their test case is electron microscopy work, with strict live needs and mixed stock wants.
Catalog record
| CREATOR | Panagiotis Giannakopoulos, Bart van Knippenberg, Kishor Chandra Joshi, Nicola Calabretta, George Exarchakos |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-20495
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Accurate Performance Predictors for Edge Computing Applications Thanks: This manuscript is a preprint and has been submitted for possible publication. It has not undergone peer review. Panagiotis Giannakopoulos, Bart van Knippenberg, Kishor Chandra Joshi, Nicola Calabretta, George Exarchakos Abstract Accurate prediction of application performance is critical for enabling effective scheduling and resource management in resource-constrained dynamic edge environments. However, achieving predictable performance in such environments remains challenging due to the co-location of multiple applications and the node heterogeneity. To address this, we propose a methodology that automatically builds and assesses various performance predictors. This approach prioritizes both accuracy and inference time to identify the most efficient model. Our predictors achieve up to 90% accuracy while maintaining an inference time of less than 1% of the Round Trip Time. These predictors are trained on the historical state of the most correlated monitoring metrics to application performance and evaluated across multiple servers in dynamic co-location scenarios. As usecase we consider electron microscopy (EM) workflows, which have stringent real-time demands and diverse resource requirements. Our findings emphasize the need for a systematic methodology that selects server-specific predictors by jointly optimizing accuracy and inference latency in dynamic co-location scenarios. Integrating such predictors into edge environments can improve resource utilization and result in predictable performance. K eywords edge computing \cdot real-time systems \cdot performance variability \cdot performance predictability \cdot monitoring metrics \cdot round-trip time \cdot Kubernetes \cdot Prometheus 1 Introduction As computing environments evolve to support increasingly diverse and time-sensitive applications, the limitations of centralized data centers have become more pronounced. These architectures often struggle to satisfy the stringent latency, reliability, and privacy requirements of real-time workloads. To overcome these challenges, edge computing has emerged as a promising alternative [ 1 ] . By moving computational resources closer to data sources and end users, edge computing reduces communication distances, thereby enhancing responsiveness and lowering latency. However, this architectural shift introduces new complexities in resource management and makes performance less predictable. Edge environments are composed of smaller geographically distributed infrastructures, in contrast to the centralized nature of traditional data centers. While co-locating multiple applications at the edge can improve resource utilization and lower operational costs, it also leads to resource contention and race conditions. This competition over limited computational and network resources results in variability in execution times, which undermines the predictability of performance [ 2 ] . The situation is further complicated by the heterogeneous nature of edge nodes, which may differ in hardware configurations and software stacks [ 3 , 4 ] . Consequently, effective planning and management of compute and network resources are essential to achieve predictable performance [ 5 ] , maximize resource efficiency [ 6 ] , and enable automated orchestration across edge infrastructures. To address the challenges of system heterogeneity, co-located workloads, high-dimensional monitoring data, and the dynamic conditions of edge environments, predictive models capable of forecasting application execution times based on historical monitoring data have become increasingly important [ 7 ] . These predictors support proactive orchestration and adaptive scheduling, allowing time-sensitive applications to meet performance requirements despite fluctuating conditions [ 7 , 8 ] . For deployment in edge environments, such models must strike a balance between accuracy and overhead. They must be accurate enough to deliver reliable predictions and lightweight enough to operate on resource-constrained nodes [ 8 ] . Developing prediction models, however, is non-trivial. System heterogeneity and co-located workloads introduce complex interdependencies that affect application behavior. Furthermore, monitoring systems typically collect hundreds of metrics at fine-grained intervals, resulting in high-dimensional data. Selecting the most relevant subset of monitoring metrics for prediction models is important to prevent overfitting and reduce inference time. Advanced filtering and feature selection techniques have been shown to improve both prediction accuracy and efficiency [ 9 , 8 ] . However, the dynamic nature of edge environments complicates the development of models that are accurate and generalizable over time [ 7 , 9 ] . We investigate performance predictability using an electron microscopy (EM) workflow. We explore the Single Particle Analysis (SPA) acquisition and processing workflow which is crucial for near-real-time (i.e. sub-second timescales) instrument control. While EM is a unique domain, SPA allows us to study applications with various task types through its wide range of resource requirements (i.e. CPU, GPU, network). We conduct experiments on a Kubernetes-managed cluster with GPUs, monitored every 200 milliseconds by Prometheus. Our methodology automatically trains and evaluates multiple models, choosing the best according to accuracy and inference time. Predictors use historical monitoring data (e.g., CPU usage, memory status, network activity) to estimate Round-Trip Time (RTT) under changing conditions. We select input features with perfCorrelate [ 10 ] , a framework that identifies the metrics most related to RTT variability. Unlike methods that rely on a fixed set of metrics or access to application code stages, our approach trains predictors using a reduced, highly correlated set of metrics to RTT fluctuations. This ensures accuracy while minimizing overhead. Our results demonstrate how the models generalize under varying co-location scenarios and across different servers in the cluster. Furthermore, we demonstrate that factors such as the size of the historical state of the monitoring data affect the accuracy of the model, which in turn influences the decisions made by the proposed methodology. The achievements of this research are summarized as follows: • We propose a comprehensive methodology that automatically generates efficient performance predictors tailored to edge environments, balancing accuracy with low-latency inference. Our predictors achieve up to 90% accuracy in predicting application RTT prior to submission. • We evaluate the trade-offs between prediction accuracy and inference time across multiple machine learning models to predict application performance in near-real-time scenarios. The inference time of the predictors remains within 1% of the RTT, ensuring minimal overhead. • The developed predictors are tailored for each server in the cluster and adjust dynamically to changes in co-located applications, accounting for new sources of performance variability. The remainder of the paper is structured as follows. Section 2 presents the related work. Section 3 elaborates on the methodology for correlating monitoring metrics with performance. Section 4 outlines the experimental setup. Section 5 presents the experimental results. Section 6 summarizes the conclusions and discusses future work. 2 Related work Scheduling mechanisms in cloud and edge environments are critical for efficiently allocating computational and network resources to meet application-specific requirements, such as bounded execution times. However, making optimal scheduling decisions is complex due to performance variability, which is influenced by multiple factors including the operating system (OS), hardware specifications, and application behavior [ 11 ] . Inconsistencies in disk, memory, network [ 3 ] , and CPU performance [ 4 ] have been observed even during isolated, repeated executions. Performance fluctuations increase further when applications are co-located on the same host due to resource sharing [ 2 ] . Furthermore, structural changes in applications can alter performance due to variations in dependency efficiency [ 12 ] . Modification in the application code (i.e., refactoring) also has an impact on execution time [ 13 ] . While most prior work aimed to reduce variability by eliminating its sources, our approach instead treats performance variability as an inherent system characteristic and focuses on modeling it through predictive performance models.