eBeeMetrics: An eBPF-based Library Framework for Feedback-free Observability of QoS Metrics 1 Both authors made equal contributions to this work.

Muntaka Ibnath 1 , Mohammadreza Rezvani 1, Daniel Wong · 2026

Read eBeeMetrics: An eBPF-based Library Framework for Feedback-free Observability of QoS Metrics 1 Both authors made equal contributions to this work. by Muntaka Ibnath 1 , Mohammadreza Rezvani 1, Daniel Wong (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25067.txt.

Introduction

Ibnath, Rezvani, and Wong watch service quality in running programs without asking the programs to report it. Managers need tail latency and throughput as feedback, but kernels and hardware counters cannot see those numbers. Their library, eBeeMetrics, infers them from events that eBPF can observe, like system calls. It can stand in for direct reporting or add a second view of server behavior. Across latency-sensitive workloads, its estimates track measured throughput and delay closely. The tool is open source, so others can adopt it.

Catalog record

CREATORMuntaka Ibnath 1 , Mohammadreza Rezvani 1, Daniel Wong
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54709
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.25067

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

eBeeMetrics: An eBPF-based Library Framework for Feedback-free Observability of QoS Metrics 1 Both authors made equal contributions to this work. Muntaka Ibnath 1 , Mohammadreza Rezvani 1, Daniel Wong Abstract Many system management runtimes (SMRs), such as resource management and power management techniques, rely on quality-of-service (QoS) metrics , such as tail latency or throughput, as feedback. These QoS metrics are generally neither observable with hardware performance counters nor directly observable within the OS kernel. This introduces complexity and overhead in instrumenting the application and integrating QoS performance metric feedback with many management runtimes. To bridge this gap, we introduced eBeeMetrics, an eBPF-based library framework to accurately observe application-level metrics derived from only eBPF-observable events, such as system calls. eBeeMetrics can be used as a drop-in replacement to decouple system management runtimes from QoS metric feedback reporting, or can supplement existing QoS metrics to better identify server-side dynamics. eBeeMetrics achieves a strong correlation with real-world measured throughput and latency metrics across various latency-sensitive workloads. The eBeeMetrics tool is open-source; the source code is available at: https://github.com/Ibnathism/eBeeMetrics . I Introduction Modern data centers require significant amounts of profiling, tracing, measurement, and observability to maintain performance, reliability, and efficiency. These telemetries are then used to guide system management runtime (SMR) frameworks for resource management, scheduling, power management, etc. Application performance is directly influenced by these runtimes. For instance, by adjusting core frequency or reallocating cores, we can trade off between performance, dynamic power consumption, and utilization [ 6 , 27 , 63 , 4 , 41 , 48 ] . Many existing system management runtime frameworks require quality-of-service (QoS) feedback to guide management decisions, such as tail latency or throughput. This can be problematic as applications may need to be instrumented to report QoS metrics, and client-provided QoS metrics may incur overheads. Furthermore, depending on where the system management runtime operates (userspace or kernel space), it may be intrusive to provide QoS metrics. For example, we cannot readily pass feedback metrics directly to in-kernel dynamic power management drivers or Linux schedulers. This would require passing through sysfs , which incurs frequent and significant syscall overheads that make timely reporting of feedback metrics unfeasible. Recently, eBPF [ 11 ] has emerged as a major kernel technology framework used to build many tools for observability, monitoring, security, etc. eBPF (extended Berkeley Packet Filter) is a Linux subsystem that enables custom user-space programs to run within a sandboxed in-kernel virtual machine. Specifically, eBPF programs are event-driven and are triggered by certain system events , such as network events, system calls, function entry/exit, etc. Furthermore, eBPF programs are extremely lightweight. For example, Facebook actively runs 40 eBPF programs per server, with 100s of additional on-demand eBPF programs, and Netflix runs 14 active eBPF programs per server instance [ 53 ] . By being able to safely extend the Linux kernel, eBPF has been the foundation of numerous frameworks that aim to provide unobtrusive observability, security, monitoring, and tracing functionality for many distributed systems, such as microservices and cloud-native systems [ 12 , 13 , 16 , 17 ] . Prior work [ 47 ] has shown that from eBPF-derived traces of syscalls and offline analysis, it is possible to accurately estimate a proxy throughput metric (requests per second) that is highly correlated with the actual RPS, demonstrating the potential for eBPF observability into application-level metrics. However, several limitations of this work limit its real-world usefulness. First, the estimated RPS is not 1:1 with the real RPS; rather, it serves as a well-correlated proxy. Second, only throughput-based metrics can be estimated, and not latency-based metrics, which are crucial for resource management of latency-sensitive workloads. Third, the proxy metrics were derived offline through eBPF traces of syscalls, which limits utility since system management runtimes require real-time streaming QoS feedback. Fig. 1 : (a) Prior work [ 47 ] demonstrates observability of throughput-based proxy metrics through offline analysis of eBPF-provided traces. (b) eBeeMetrics enables a fully online solution for observability of both throughput and latency metrics. In this work, we overcome these limitations with eBeeMetrics, a fully online eBPF-based library solution that transparently analyzes real-time streaming eBPF events of target workloads to accurately estimate throughput and latency metrics. The key contributions of this paper are: • We present eBeeMetrics, an online eBPF-based library that enables observability into QoS metrics (such as tail latency, throughput, etc.) without any application instrumentation or direct feedback. eBeeMetrics presents an API interface for system management runtimes to obtain QoS telemetry without direct reporting from applications. • The key to enabling accurate observability of application QoS metrics is in disambiguating request boundaries and identifiers from streaming eBPF events. In this work, we target HTTP/1.1/REST and gRPC/HTTP/2, and more broadly assume that a workload exposes either reliable syscall-level request lifecycles or stable user-space request start/end hooks that can be probed with eBPF. • We demonstrate the efficacy of eBeeMetrics across a range of real-world latency-critical workloads. eBeeMetrics can accurately obtain QoS metrics with minimal overhead, effectively decoupling QoS feedback from the applications. II Background and Motivation II-A QoS Metric Challenges for System Management Runtimes Many system management frameworks (such as resource management, power management, or performance debugging) need to be aware of quality-of-service (QoS). Thus, these resource management frameworks often require feedback of QoS metrics (such as latency or throughput) in order to guide management decisions. This often requires client-provided metrics, or application instrumentation, which limits the practicality of system management runtimes [ 48 , 27 , 36 , 56 , 49 , 15 , 28 , 64 , 59 , 9 , 21 , 58 , 37 , 26 , 51 , 33 , 7 , 35 , 45 , 60 , 61 , 57 ] . For example, in many environments, QoS metrics are not directly available, or a cloud provider doesn’t have visibility into client workloads. Prior works, such as PACT [ 25 ] , assign applications to multiple classes (latency-critical vs. best-effort) and then allocate different resources to those classes. Latency-critical workloads are still satisfied by avoiding reducing the frequency of such workloads and only applying power savings techniques to best-effort workloads, which significantly limits the potential power-saving benefits. Other studies [ 42 , 43 , 30 , 31 , 63 , 62 , 5 ] have demonstrated the ability to predict workload types and estimate QoS requirements through workload characterization and performance models. However, these techniques are not generalizable and require significant instrumentation or pre-training of predictive models. Therefore, there has been recent interest in providing better observability into application QoS metrics while avoiding the need for direct QoS feedback from applications. II-B eBPF Overview eBPF enables sandboxed programs to execute within the Linux kernel, allowing developers to extend kernel functionality without modifying kernel source code or loading kernel modules. eBPF is flexible and incurs minimal overhead, as demonstrated by widespread adoption in industry and emerging use cases [ 11 , 34 , 23 , 46 , 32 , 10 , 55 , 38 ] . eBPF programs are executed when triggered by specific system events within the kernel, such as system calls, interrupts, or network events. The programs are attached to pre-defined hooks inside the kernel, and a specific set

Read the complete text