Risk-Aware and Stable Edge Server Selection Under Network Latency SLOs
2026
Read Risk-Aware and Stable Edge Server Selection Under Network Latency SLOs (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-21483.txt.
Introduction
Mohan Liyanage and three colleagues offer a lightweight framework for choosing edge servers in latency-critical applications, weighing tail risk and switching stability. Each candidate's predicted latency mean and uncertainty feed SLO-violation risk estimates. They are scored with a tight Normal approximation plus a conservative Cantelli bound, while percentile scoring with hysteresis damps oscillatory switching. On a testbed with an SLO of 0.5 seconds, the approach cuts deadline misses from 39 to 34 percent versus a mean-only baseline, and switching from 46 to about 6 percent, while holding average latency under the SLO.
Catalog record
| YEAR | 2026 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28546 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.21483
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Risk-Aware and Stable Edge Server Selection Under Network Latency SLOs Abstract We present a lightweight and interpretable decision framework for dynamic edge server selection in latency-critical applications that explicitly accounts for tail risk and switching stability. Each candidate server is characterised by predictive mean and uncertainty summaries of network latency, which are used to estimate the risk of service-level objective (SLO) violations and to guide selection. Risk is evaluated using a tight Normal approximation complemented by a conservative Cantelli bound, while percentile-based scoring coupled with hysteresis stabilizes decisions and suppresses oscillatory switching under short-lived network fluctuations. Experimental results on a multi-server edge testbed with a strict SLO of τ = 0.5 \tau=0.5 s show that the proposed approach reduces the deadline-miss rate from 39% to 34% compared to a mean-only baseline, while reducing switching frequency from 46% to 5.5% (88% reduction) and maintaining sub-SLO average latency (0.429 s). These results demonstrate that explicit risk evaluation combined with stability-preserving control enables practical and robust adaptive server selection in dynamic edge environments. This paper is accepted for presentation at the IWCMC 2026 Conference, June 1–6, 2026, Shanghai, China. I Introduction Edge computing is a key paradigm for latency-sensitive applications that require real-time processing close to data sources, such as intelligent transportation systems, cooperative perception, and roadside video analytics. In these applications, strict end-to-end (E2E) latency constraints must be satisfied to maintain Quality of Service (QoS), safety, and user experience, making dynamic edge server selection a critical challenge. Recent work has proposed lightweight models for predicting network latency in edge environments. However, selecting the server with the lowest predicted mean latency alone is often insufficient in practice. Mean-only selection ignores latency variability and predictive uncertainty in shared and time-varying networks, and thus may underestimate the risk of service-level objective (SLO) violations. Moreover, naive reactive policies are highly sensitive to short-lived fluctuations, causing oscillatory switching between servers and incurring handover overheads such as connection resets, transient packet loss, and warm-up delays. These effects can increase tail latency and undermine reliability even when average delay remains acceptable. Our earlier work showed that E2E latency in edge networks exhibits nonlinear growth near saturation and proposed a rational delay model to capture this behavior [ 1 ] . We later introduced reliability scoring to improve robustness in server selection [ 2 ] . However, mean-driven selection can still remain overly reactive and may fail to capture variance-driven tail risk. This motivates the need for a decision layer that converts uncertain latency predictions into reliable and stable server-selection actions under strict SLOs. In this paper, we formulate dynamic edge server selection as a risk-aware and stability-preserving decision problem . Each candidate server is characterized by predictive summaries of network latency, namely a mean and an uncertainty estimate derived from recent observations. We propose a lightweight two-stage framework. First, SLO-violation risk is evaluated using a Normal surrogate for interpretability together with a Cantelli bound as a conservative safeguard against distributional mismatch. Second, server selection is stabilized using percentile-based scoring with hysteresis, so that switching occurs only when a candidate provides sustained and meaningful improvement over the current server. The proposed approach is designed for practical edge environments where only end-to-end observable performance metrics are available and internal server states may be inaccessible. Thus, unlike queue-aware or learning-based methods, it does not rely on detailed infrastructure visibility, offline training, or complex online optimization. This makes the framework lightweight, interpretable, and suitable for black-box deployment settings. The novelty of this work lies not in introducing a new latency predictor, but in designing a lightweight decision layer that transforms uncertain delay summaries into explicit SLO-risk estimates and stable server-selection actions. The main contributions are: 1) a hybrid Normal–Cantelli risk evaluation mechanism for SLO-aware server ranking; 2) a percentile-based hysteresis policy to suppress oscillatory switching; and 3) an experimental validation on a multi-server edge testbed showing lower deadline-miss rate and substantially reduced switching compared with a mean-only baseline. II Related Work II-A Risk Evaluation in Networking and Real-Time Systems Evaluating the risk of delay violations is a long-standing problem in network performance analysis and real-time systems. Normal approximations are commonly used to derive interpretable percentile-based guarantees [ 3 ] , but empirical network delays often exhibit burstiness and heavy-tailed behavior, which can limit the reliability of purely Gaussian models. To address such uncertainty, distribution-free concentration inequalities, including Chebyshev’s and Cantelli’s bounds, are widely used to provide conservative tail guarantees [ 4 , 5 , 6 , 7 ] . These tools are especially useful in safety-critical settings, where optimistic statistical estimates are often complemented by conservative safeguards. II-B Risk-Aware MEC and Edge Server Selection In Mobile Edge Computing (MEC) systems, dynamic server selection under uncertain network conditions has received increasing attention. Traditional heuristics, such as nearest-server or least-load selection, expose the trade-off between latency and resource utilization under dynamic workloads [ 8 ] . More recent work has explored reliability-aware server selection using predictive summaries and heuristic rules to improve robustness under fluctuating network conditions [ 2 ] . Learning-based approaches have also been proposed for adaptive edge selection, task offloading, and SLO-aware resource management in dynamic MEC environments [ 9 , 10 ] . Probabilistic bounds, including Cantelli-type inequalities, have further been used in wireless and edge networking for risk-aware decision making, such as resource allocation and access control [ 11 ] . However, existing approaches typically emphasize either risk estimation or adaptive control, while paying limited attention to switching stability. As a result, server selection may remain vulnerable to oscillatory behavior under short-lived fluctuations. In contrast, our work focuses on a lightweight decision layer that explicitly transforms mean and uncertainty summaries into SLO-risk estimates and combines them with percentile-based hysteresis. This enables risk-aware and stability-preserving edge server selection using only end-to-end observable network metrics, without requiring internal queue states, infrastructure-level coordination, or training-based control. II-C Qualitative Comparison with Existing Approaches Table I contrasts our framework with representative classes of server selection methods. Our contribution complements existing approaches by providing an interpretable, low-overhead decision layer that explicitly evaluates tail risk and suppresses oscillatory switching under partial observability. TABLE I: Qualitative comparison of server selection approaches Method Risk Stability Observability Training Mean-only No No End-to-end only No Queue-aware / Lyapunov Partial No Internal state No RL-based offloading Implicit Implicit Often extensive Yes This work Yes Yes End-to-end only No Unlike learning-based or queue-aware approaches, this work focuses on risk-aware decision control using only end-to-end observable latency statistics, explicitly addressing switching stability, which is largely overlooked in prior server selection frameworks. III Methodology and System Model This section formalizes the network-centric server-selection problem and the risk-evaluation framework used to compare candidate edge servers. The goal is to estimate the risk of violating a strict latency service-level objective (SLO) under uncertainty, prior to applying the stability control introduced in Section IV . III-A System Model and Predictive Summaries We consider an edge-assisted application in which a client continuously offloads data frames to one of K candidate edge servers \mathcal{S}=\{S_{1},S_{2},\ldots,S_{K}\} . The dominant performance bottleneck is the network-induced delay along the client-to-server path, including transmission, propagation, and queueing effects. Let d_{i}(t) denote the observed network latency associated with server S_{i} at decision step t . For