Offloading L7 Policies to the Kernel Conference: ; 2026

Laurin Brandner, Ayush Mishra, Sebastiano Miano, Aurojit Panda, Gianni Antichi, Laurent Vanbever · 2026

Read Offloading L7 Policies to the Kernel Conference: ; 2026 by Laurin Brandner, Ayush Mishra, Sebastiano Miano, Aurojit Panda, Gianni Antichi, Laurent Vanbever (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-31084.txt.

Introduction

Brandner and colleagues present Beeline, a fast path for service meshes enforcing application-layer policies in kernel space. Service meshes provide a uniform abstraction for communication, implementing encryption, routing, and balancing, but proxies on data paths cost performance. Beeline synthesizes an eBPF-based data plane from policies, enforcing most application-layer policies directly in the kernel. It accelerates microservices without modification, falling back to proxies for unsupported policies. With TLS and HTTP/2 support, Beeline cuts latency by up to six times versus meshes while sustaining three times more throughput.

Catalog record

CREATORLaurin Brandner, Ayush Mishra, Sebastiano Miano, Aurojit Panda, Gianni Antichi, Laurent Vanbever
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57984
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.31084

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Offloading L7 Policies to the Kernel Conference: ; 2026 Laurin Brandner, Ayush Mishra, Sebastiano Miano, Aurojit Panda, Gianni Antichi, Laurent Vanbever Abstract . Service meshes have recently emerged as the de-facto standard for deploying microservices. Conceptually, they provide a uniform abstraction for inter-process communication (IPC) between services by implementing common networking mechanisms—such as encryption, routing, and load balancing—and by allowing these mechanisms to be configured and composed through high-level policies. Supporting these policies, however, comes with a significant performance cost, since service meshes interpose proxies (“sidecars”) on the data path, leading to numerous context switches. This paper presents L7FP, a fast path for service meshes which can enforce the vast majority of application-layer policies seen in the wild directly in kernel space. Given high-level policies, L7FP automatically synthesizes an eBPF-based data plane which enforces them in the kernel. L7FP accelerates existing microservices without any code modification, and transparently falls back to existing service proxies (the slow path) for the few unsupported policies. We fully implemented L7FP, with support for both TLS and HTTP/2. Compared to state-of-the-art service meshes, L7FP reduces the median request latency of realistic applications by up to 6 × 6\times while sustaining 3 × 3\times more throughput. 1. Introduction Modern data center applications are no longer monolithic: they are assembled from swarms of microservices ( 8 ; 32 ; 24 ; 35 ) or “pods”, stitched together by service meshes ( 56 ; 40 ) . Service meshes simplify development by abstracting away the networking layer, making applications easier to deploy and manage. This approach has fueled the widespread adoption of platforms such as Istio ( 31 ) and Linkerd ( 42 ) . A key component of these service meshes is the service proxy, also known as “ sidecar ”. A service proxy acts as the data plane of the service mesh: it processes all the inter-pod traffic and enforces policies defined at the transport (L4) and/or application layer (L7). For example, Istio relies upon Envoy ( 22 ) —a popular service proxy—to enforce L4 load balancing or L7 request authorization. User Sp. Kernel Space Service Proxy Web Server Socket Socket Socket Network Stack NIC Loopback eBPF Data Plane IPC Acceleration Full Acceleration No Acceleration Figure 1 . By default, service proxies route inter-pod traffic through the loopback device (blue line). State-of-the-art service meshes optimize IPC by rerouting the traffic using eBPF (orange line). L7FP offloads L7 policy enforcement to the kernel, eliminating the service proxy from the critical path (green line). While convenient, service proxies can slow down a service mesh significantly: previous studies have shown that they can increase request latency by up to 185% ( 68 ) , and increase CPU utilization by 41%–92%. This overhead can be traced back to two main sources: (1) Service proxies execute highly general code and can enforce any conceivable policy. This generality simplifies deployment but carries substantial performance overheads. As we show (c.f. Section 2 ), these bloated processing times can contribute to more than half of the overhead of proxies like Envoy. (2) Service proxies increase the amount of inter-process communication (IPC), which in turn increases both CPU requirements and processing time. We visualize this extra cost in Figure 1 (see the blue line): each message that the web server receives is routed through the loopback device, traversing the network stack and crossing the user-kernel-boundary three times. To reduce this overhead, state-of-the-art service meshes such as Cilium ( 17 ) and Calico ( 12 ) have mainly relied upon two techniques. The first technique aims at minimizing the IPC cost by bypassing the network stack using eBPF ( 21 ) (see the orange line in Figure 1 ). In practice, though, such bypasses tend to yield limited performance improvements because the bottleneck tends to be—as we show in this paper—the message processing time in the service proxy. Acknowledging this limitation, the second technique (illustrated in green ) aims at removing the service proxy entirely from the critical path by offloading L4 policies to the kernel ( 17 ; 12 ) . While extremely effective, this technique only applies to L4 policies, meaning the user space service proxy still needs to enforce L7 policies. Unfortunately, L7 policies also constitute the bulk of the policies in modern deployments. As an illustration, Alibaba reports that the vast majority of their customers (between 80% to 95%) use L7 policies in their service mesh ( 65 ) . A natural, yet still open, question is therefore: Is it practical to offload L7 policies to the kernel? We answer this question in the affirmative and show that offloading L7 policies is both practical and dramatically improves the performance of realistic workloads. More specifically, we describe a kernel-based fast path—named L7FP —that can transparently accelerate the most common L7 policies (e.g., HTTP-based). It achieves this by jointly addressing both main sources of overhead: generality and IPC cost. We implement our fast path in eBPF. Despite eBPF-based facilities to process application-layer traffic in the kernel ( 36 ; 38 ) , and previous work demonstrating eBPF’s potential to do so ( 39 ) , this approach has remained impractical for HTTP-based policies due to eBPF’s stringent limitations. In this paper, we present eBPF-compliant techniques that enable the enforcement of complex L7 policies in the kernel. Given a description of an L7 policy, L7FP first automatically synthesizes a highly optimized and policy-specific data plane in eBPF and loads it into the kernel. As we show, L7FP-synthesized code is able to process in the kernel the vast majority (89%) of the use cases found in 2417 open-source projects. In doing so, L7FP completely eliminates all IPC overhead that would typically arise, similarly to L4 offloads. In the unlikely case a policy cannot be enforced in the kernel, L7FP transparently falls back to the user space service proxy. We stress that existing service proxies do not need to be modified to benefit from L7FP. We implemented L7FP and demonstrate its practicality by speeding up state-of-the-art service proxies such as Envoy, and show that L7FP significantly improves performance. Under realistic conditions, L7FP reduces the median request latency of state-of-the-art service meshes by up to 6\times , and the 99^{th} -percentile by 4\times , while serving up to 3\times more traffic. To sum up, we make the following contributions: (1) We make the case for processing L7 policies in kernel space and demonstrate that eBPF is mature enough to implement the most commonly used L7 policies observed in the wild. (2) We introduce L7FP, an eBPF-based fast path for any service proxy that processes L7 policies in user space. It overcomes the drawbacks of state-of-the-art solutions by significantly improving request latency and throughput. (3) We implement L7FP with support for HTTP/1.1, HTTP/2, TLS and six popular policies. We evaluate its performance on synthetic and realistic workloads and share the code to foster reproducibility. 2. The Case for an L7 Fast Path In this section, we make the case for enforcing L7 policies directly in the kernel. We begin with a brief background on how popular service proxies such as Envoy ( 22 ) operate before quantifying their main sources of overhead. We show that, with or without IPC

Read the complete text