Rethinking Telemetry Design for Fine-Grained Anomaly Detection in 5G User Planes
Niloy Saha 1, Noura Limam 1, Yang Xiao 1, Raouf Boutaba 1 · 2025
Read Rethinking Telemetry Design for Fine-Grained Anomaly Detection in 5G User Planes by Niloy Saha 1, Noura Limam 1, Yang Xiao 1, Raouf Boutaba 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-27664.txt.
Introduction
Niloy Saha, Noura Limam, Yang Xiao, and Raouf Boutaba present Kestrel in 2025, a lean telemetry system for 5G user planes. Telemetry means the live gauges a network keeps on its own traffic. Coarse counts are cheap but hide brief, per-flow faults. Full per-packet notes catch all faults, yet their cost grows with line speed and soon swamps the system.
Kestrel packs per-packet gauges into compact sketches, which are small summaries that keep key patterns. Buckets gain small charts and are split by queue to guard tail delays and gap times. Math bounds that count sketch clashes guide size and bin choices. The design aims for fine views of faults at a small share of full cost.
Catalog record
| CREATOR | Niloy Saha 1, Noura Limam 1, Yang Xiao 1, Raouf Boutaba 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-27664
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Rethinking Telemetry Design for Fine-Grained Anomaly Detection in 5G User Planes Niloy Saha 1, Noura Limam 1, Yang Xiao 1, Raouf Boutaba 1 Abstract Detecting QoS anomalies in 5G user planes requires fine-grained per-flow visibility, but existing telemetry approaches face a fundamental trade-off. Coarse per-class counters are lightweight but mask transient and per-flow anomalies, while per-packet telemetry postcards provide full visibility at prohibitive cost that grows linearly with line rate. Selective postcard schemes reduce overhead but miss anomalies that fall below configured thresholds or occur during brief intervals. We present Kestrel , a sketch-based telemetry system for 5G user planes that provides fine-grained visibility into key metric distributions such as latency tails and inter-arrival times at a fraction of the cost of per-packet postcards. Kestrel extends Count-Min Sketch with histogram-augmented buckets and per-queue partitioning, which compress per-packet measurements into compact summaries while preserving anomaly-relevant signals. We develop formal detectability guarantees that account for sketch collisions, yielding principled sizing rules and binning strategies that maximize anomaly separability. Our evaluations on a 5G testbed with Intel Tofino switches show that Kestrel achieves 10 % 10\% better detection accuracy than existing selective postcard schemes while reducing export bandwidth by 10 × 10\times . I Introduction Modern 5G and beyond networks leverage network slicing to provide dedicated logical networks for diverse applications, each with strict SLA requirements [ 1 , 2 , 3 ] . Data-plane components such as the User Plane Function (UPF) and O-RAN Centralized Unit (CU) aggregate traffic from multiple such slices onto hardware-accelerated platforms (e.g., P4 switches, SmartNICs, FPGAs). This makes them critical points for detecting QoS degradations that threaten slice SLAs. The monitoring dilemma. Detecting QoS degradations in these data planes requires fine-grained, real-time telemetry. However, because thousands of flows share limited queues and on-chip memory, these systems typically only expose coarse per-class counters [ 4 ] , or selective reports based on sampling or threshold triggers [ 5 ] , which obscure transient or per-flow anomalies. Programmable hardware can, in principle, support full per-packet visibility through postcard telemetry that records queue depth, latency, and QoS identifiers for each packet. However, postcard export is prohibitively expensive: even at a modest 10 Gbps with 200 B packets, line-rate export would generate over 3 Gbps of telemetry (>30% overhead), and production systems operate at hundreds of Gbps. To make this challenge concrete, we focus on the UPF – a critical 5G data plane function that forwards user traffic over GTP-U tunnels identified by tunnel endpoint identifiers (TEIDs) . Each tunnel may carry multiple QoS flows (QFIs) mapped to standardized service classes and enforced by a small set of shared hardware queues. When multiple TEIDs share a queue, standard 3GPP per-QFI counters [ 4 , 6 ] collapse fine-grained behavior into QFI-level averages. For example, counters polled every 1 s may report a healthy 2 ms average delay at QFI-level, yet per-TEID histograms can reveal a brief spike in TEID A, with 6% of packets delayed > 20 ms. Postcards would expose this, but at unsustainable export cost. This illustrates the fundamental challenge: how to obtain fine-grained (e.g., TEID-level) visibility under strict memory and bandwidth constraints? Our approach. Our key insight is that data plane anomalies at the UPF manifest as distributional signatures (§ II-B ): latency tails, sub-second spikes, per-TEID throughput violations, and oscillatory inter-arrival patterns. However, maintaining explicit per-TEID histograms is infeasible: each histogram requires multiple bins of state, which can quickly exhaust the limited memory available on hardware-accelerated data planes. We present Kestrel , a telemetry system that provides per-TEID distributional visibility through a principled extension of Count-Min Sketch tailored to UPF anomaly detection. Unlike prior sketch-based systems [ 7 , 8 ] that focus on volume metrics (packet counts, heavy hitters), Kestrel augments sketch buckets to capture compact histograms of latency and inter-arrival times – the distributional signals that distinguish different anomalies. To make distribution tracking robust, we develop a formal detectability framework that quantifies how sketch collisions and normal-traffic variation affect anomaly visibility. This analysis yields three practical design principles: (1) per-QID sketch partitioning to limit cross-class interference, (2) adaptive binning that preserves sensitivity to rare events under normal load, and (3) principled sizing rules derived from anomaly detection requirements. Our analysis shows that modest sketch dimensions ( w{=}512 , d{=}3 ) are sufficient to effectively detect diverse anomalies, including transient events as short as 50 ms. Kestrel exports compact summaries ( {\approx}0.15\% of user-plane traffic), achieving over 10\times lower telemetry volume than existing selective-postcard schemes [ 9 ] while improving anomaly detection accuracy by 10\% on mixed workloads. Contributions. We make the following contributions: • We characterize the telemetry requirements for UPF anomaly detection, showing that representative anomalies require per-TEID distributional visibility such as latency tails, inter-arrival patterns, and sub-second resolution (§ II ). • We design a histogram-augmented sketch data structure that tracks per-TEID distributions using shared buckets rather than per-flow state, enabling operation within the memory constraints of programmable switches (§ III ). • We develop formal detectability guarantees for sketch-based anomaly detection, and derive principled sizing rules for sketch dimensions and bin placement that ensure weak anomalies remain visible despite measurement noise (§ IV ). • We implement Kestrel on Intel Tofino switches, and demonstrate that it achieves 10\% better anomaly detection accuracy than selective postcard sampling while reducing export bandwidth by 10\times (§ VI ). II Characterizing the Fine-Grained Telemetry Problem in 5G Data Planes Modern 5G networks increasingly implement key data plane functions, including the User Plane Function (UPF) and O-RAN Centralized Unit (CU), on hardware-accelerated platforms [ 10 , 11 , 12 , 13 ] . These functions aggregate traffic from multiple network slices, which makes them critical points for detecting QoS degradations that threaten SLA compliance. We define any data plane event that threatens SLA compliance as an anomaly , whether it stems from malicious activity, misconfiguration, or disruptive traffic patterns. The central challenge in detecting such anomalies is a fundamental visibility gap : these systems typically expose only coarse-grained counters or heavily sampled telemetry, which fail to capture the fine-grained, transient signals required for reliable detection. In UPFs, this arises from aggregation of per-session statistics; in CUs, it manifests as coarse event reports that obscure per-UE dynamics [ 14 ] . We focus on the UPF as a representative case, developing and evaluating our approach on a UPF testbed. However, the visibility gap and resulting telemetry requirements apply broadly across 5G data plane components. We first characterize the architectural and resource constraints that create this gap (§ II-A ), then demonstrate empirically what telemetry granularity is required for reliable anomaly detection (§ II-B ). II-A The Visibility Gap in UPF Telemetry The visibility gap stems from a fundamental mismatch between QoS enforcement requirements and hardware constraints. UPFs forward traffic using GTP-U tunnels identified by TEIDs, with service classes distinguished by QFI and enforced by QERs. To sustain line-rate throughput, UPFs are increasingly offloaded to programmable hardware (e.g., P4 switches, SmartNICs) that provide typically 8-100 egress queues per port [ 10 , 12 , 13 ] . Thousands of active TEIDs must therefore multiplex onto these shared queues, creating QoS interdependencies: a single aggressive TEID can degrade performance for