Network-accelerated Active Messages
Md Ashfaqur Rahaman, Alireza Sanaee, Todd Thornley, Sebastiano Miano, Gianni Antichi, Brent E. Stephens, Ryan Stutsman · 2025
Read Network-accelerated Active Messages by Md Ashfaqur Rahaman, Alireza Sanaee, Todd Thornley, Sebastiano Miano, Gianni Antichi, Brent E. Stephens, Ryan Stutsman (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-07431.txt.
Introduction
Moving data between servers usually forces a choice between fast but rigid hardware tricks and flexible but slower software. Md Ashfaqur Rahaman and 6 co-authors present NAAM in a 2025 research paper. NAAM stands for network-accelerated active messages. Each message carries a small portable program, written in eBPF, that says what to do with its data.
Because eBPF programs run almost anywhere, the system can steer each message to a client, a server, or a smart network card. It can shift that choice within tens of milliseconds when a server gets busy. Tests with a hash table and a B-tree show NAAM offloading millions of operations per second from server processors. It also supports hundreds of application offloads where an earlier framework managed only eight, with little added delay.
Catalog record
| CREATOR | Md Ashfaqur Rahaman, Alireza Sanaee, Todd Thornley, Sebastiano Miano, Gianni Antichi, Brent E. Stephens, Ryan Stutsman |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-07431
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Network-accelerated Active Messages Md Ashfaqur Rahaman, Alireza Sanaee, Todd Thornley, Sebastiano Miano, Gianni Antichi, Brent E. Stephens, Ryan Stutsman Abstract Remote Direct Memory Access (RDMA) improves host networking performance by eliminating software and server CPU involvement. However, RDMA has a limited set of operations, is difficult to program, and often requires multiple round trips to perform simple application operations (e.g., hash table lookup). Programmable SmartNICs provide a different means to offload work from host CPUs to a NIC while supporting application logic. This leaves applications with the complex choice of embedding logic as RPC handlers at servers, using RDMA’s limited interface to access server structures via client-side logic, or running some logic on SmartNICs. The best choice varies between workloads and over time. To solve this dilemma, we present NAAM, network-accelerated active messages . NAAM applications specify small, portable eBPF functions associated with messages. Each message specifies what data it accesses using an RDMA-like interface. NAAM runs at various places in the network, including at clients, on server-attached SmartNICs, and server host CPU cores. Due to eBPF’s portability, the code associated with a message can be run at any location. Hence, the NAAM runtime can dynamically steer any message to execute its associated logic wherever it makes the most sense based on the data it accesses or current network or CPU load. To demonstrate NAAM’s flexibility, we built several applications, including the MICA hash table and lookups from a Cell-style B-tree. With an NVIDIA BlueField-2 SmartNIC and integrating its NIC-embedded switch, NAAM can run any of these operations on client, server, and NIC cores, shifting load in tens of milliseconds on server compute congestion. NAAM dynamically offloads up to 1.8 million MICA ops/s for YCSB-B and 750,000 Cell lookups/s from server CPUs. Finally, whereas iPipe, the state-of-the-art SmartNIC offload framework, only scales to 8 application offloads on BlueField-2, NAAM scales to hundreds of application offloads with minimal impact on tail latency due to eBPF’s low overhead. 1 Introduction Remote Direct Memory Access (RDMA) can significantly improve the performance of end-host networking by bypassing software networking stacks and offloading server CPUs [ 12 , 18 , 20 , 19 , 55 ] . This can dramatically reduce tail latency and CPU usage by avoiding packet processing costs, which consume a large fraction of CPU cycles [ 22 , 41 ] . However, RDMA verbs are notoriously difficult to program, and multiple round trips are typically required for complex operations on server structures (e.g., looking up a key-value pair in a hash table) or they require careful RDMA-specific re-engineering of data structures [ 20 , 12 ] . Historically, remote procedure call (RPC) has been the solution to this problem since it runs application-defined logic at servers in response to network messages; however, this comes at the cost of server CPU load. Recently, SmartNICs have been employed to help solve this by allowing custom operations to be defined and run on NICs [ 37 , 27 , 8 ] , generally at server SmartNIC CPUs. The result is that developers are faced with the complex choice of using RDMA and client-side logic, using RPC and server-side logic, or using custom SmartNIC offloads. Each model has different trade-offs and bottlenecks, and the best configuration can vary between workloads and even over time. For example, during normal operation, it is often faster to use a server SmartNIC core or CPU core to walk a remote data structure like a hash table or a B-tree to avoid multiple network round trips. However, if the remote server cores are overloaded, then it can be better to run the logic at the client. Building applications that can monitor network and server load and dynamically move logic to optimize performance is difficult. To solve this, we propose NAAM, network-accelerated active messages, a new framework for remote memory access and function offloading. NAAM avoids the need to re-implement the same logic for multiple different platforms because NAAM replaces RDMA with active messages that execute small, portable eBPF functions [ 2 , 30 ] . Instead of writing multiple functions with different RDMA verbs for the same logic (e.g., using both one-sided and two-sided logic), applications can specify a single RPC-like function that can be associated with network messages. This function can access state stored on servers, and it can run custom code; NAAM decides how best to schedule and run these messages’ functions on the available compute in the network. NAAM runs as a software switch at various places in the network, including at clients, on server-attached SmartNICs, and on server host CPU cores. eBPF’s portability ensures that each message’s code can run at any of these locations, so the NAAM runtime can dynamically steer any message to execute its associated logic wherever it makes the most sense (e.g., based on load). In addition to being able to dynamically and incrementally scale workloads to span both SmartNIC and host CPU cores, NAAM can also route around transitory CPU contention at sub-second timescales to improve tail latency. Although some prior SmartNIC programming frameworks have helped address the problems associated with mapping some work to SmartNIC resources while mapping other work to server host CPUs, they all have important limitations. For example, Floem pipelines are mapped to SmartNIC and CPU resources, and they do not adapt the placement of work when workloads change [ 37 ] , creating bottlenecks. iPipe uses an actor-based model to dynamically move work between SmartNIC and host CPU resources within a server [ 27 ] . However, iPipe depends on a special “on-path” SmartNIC that integrates compute elements directly into its packet processing pipeline and exposes an exotic software-managed TLB. Without this special hardware, iPipe’s approach breaks down on commodity “off-path” SmartNICs like the NVIDIA BlueField-2 that we use, where SmartNIC cores must access packets over a bus (PCIExpress). When running just nine actors on BlueField-2, iPipe’s tail response latency increases by three orders of magnitude, and its efficiency breaks down. This is a significant limitation in a multi-tenant data center, where numerous applications are co-located. NAAM’s eBPF runtime is small and has a low cost to enter/exit without specialized hardware, so it efficiently scales to hundreds of inter-isolated user-defined operations with tail response times of tens-of-microseconds, even with popular off-path SmartNICs. Overall, we show that by reactively shifting active message processing to the ARM cores of a BlueField-2 SmartNIC, NAAM can reduce tail latency by 400 \times when host x86 CPUs are contended. Furthermore, when the NIC ARM cores become overloaded, NAAM automatically reconfigures the integrated BlueField-2 hardware switch to allow the host x86 CPUs to help out, avoiding the bottleneck due to CPU saturation when under heavy load. We show in the evaluation that this allows NAAM to transparently scale request processing for a disaggregated MICA-based [ 26 ] in-memory hash table from the ARM CPUs’ limit of 1.8 Mop/s to 6 Mop/s with assistance from host CPU cores. Finally, as a full application benchmark, we evaluate the lookup path of a re-implementation of the Cell B-tree [ 32 ] . At 1 million requests/s, SmartNIC cores using NAAM achieve comparable performance to using client-driven RDMAs while moving 4.3\times less data. In sum, this