Fast Userspace Networking for the Rest of Us
Alireza Sanaee 1, Vahab Jabrayilov 2 * {}^{\textrm{{\color[rgb]{1,0,0}*}}}, Ilias Marinos 3, Anuj Kalia 4 † {}^{\textrm{{\color[rgb]{1,0,0}\textdagger}}}, Divyanshu Saxena 5, Prateesh Goyal 6, Kostis Kaffes 2, Gianni Antichi 7 1 University of Cambridge, 2 Columbia University, 3 NVIDIA, 4 OpenAI 5 Th · 2025
Read Fast Userspace Networking for the Rest of Us by Alireza Sanaee 1, Vahab Jabrayilov 2 * {}^{\textrm{{\color[rgb]{1,0,0}*}}}, Ilias Marinos 3, Anuj Kalia 4 † {}^{\textrm{{\color[rgb]{1,0,0}\textdagger}}}, Divyanshu Saxena 5, Prateesh Goyal 6, Kostis Kaffes 2, Gianni Antichi 7 1 University of Cambridge, 2 Columbia University, 3 NVIDIA, 4 OpenAI 5 Th (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-09281.txt.
Introduction
Alireza Sanaee and co-authors argue that fast network code stays out of reach because it was built for gear the cloud does not give. Their 2025 paper deals with userspace network stacks, which skip the operating system's slow path. A decade of such tools leans on fancy card features and tight run rules that cloud machines lack or cannot bend to.
Their stack, Machnet, rests on a least-common-denominator model of the network card: only the traits every cloud card shares. A microkernel shape then gives apps more freedom than the usual library shape. Critics would expect the message hops of that shape to cost dearly; the team shows the cost is a rounding error on big cloud networks. Speed stays near the best stacks.
Catalog record
| CREATOR | Alireza Sanaee 1, Vahab Jabrayilov 2 * {}^{\textrm{{\color[rgb]{1,0,0}*}}}, Ilias Marinos 3, Anuj Kalia 4 † {}^{\textrm{{\color[rgb]{1,0,0}\textdagger}}}, Divyanshu Saxena 5, Prateesh Goyal 6, Kostis Kaffes 2, Gianni Antichi 7 1 University of Cambridge, 2 Columbia University, 3 NVIDIA, 4 OpenAI 5 Th |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-09281
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Fast Userspace Networking for the Rest of Us Alireza Sanaee 1, Vahab Jabrayilov 2 * {}^{\textrm{{\color[rgb]{1,0,0}*}}}, Ilias Marinos 3, Anuj Kalia 4 † {}^{\textrm{{\color[rgb]{1,0,0}\textdagger}}}, Divyanshu Saxena 5, Prateesh Goyal 6, Kostis Kaffes 2, Gianni Antichi 7 1 University of Cambridge, 2 Columbia University, 3 NVIDIA, 4 OpenAI 5 The University of Texas at Austin, 6 Microsoft Research, 7 Politecnico di Milano Abstract After a decade of research in userspace network stacks, why do new solutions remain inaccessible to most developers? We argue that this is because they ignored (1) the hardware constraints of public cloud NICs (vNICs) and (2) the flexibility required by applications. Concerning the former, state-of-the-art proposals rely on specific NIC features (e.g., flow steering, deep buffers) that are not broadly available in vNICs. As for the latter, most of these stacks enforce a restrictive execution model that does not align well with cloud application requirements. We propose a new userspace network stack, Machnet, built for public cloud VMs. Central to Machnet is a new “Least Common Denominator” model, a conceptual NIC with a minimal feature set supported by all kernel-bypass vNICs. The challenge is to build a new solution with performance comparable to existing stacks while relying only on basic features (e.g., no flow steering, no RSS reconfiguration). Machnet uses a microkernel design to provide higher flexibility in application execution compared to a library OS design; we show that microkernels’ inter-process communication overhead is negligible on large cloud networks. Our experiments show that Machnet works on today’s three largest public clouds. We also demonstrate the latency and throughput benefits of Machnet for two real-world applications: a key-value store and state-machine replication. For the key-value store application, Machnet achieves 80% lower latency and 75% lower CPU utilization compared to the best-existing cloud solution. 1 Introduction Distributed applications running in data centers (e.g., distributed data stores, stream processing engines, caching systems, backends of productivity software) are hungry for fast inter-server communication [ 29 , 41 , 40 , 67 ] . When the developers of these applications look into kernel-bypass ("userspace") networking, a well-studied approach to reduce intra-machine networking latency, they often surprisingly realize that existing systems fail to meet their needs. While userspace networking has been successful in large real-world deployments (e.g., with userspace TCP at Alibaba [ 86 ] , Remote Direct Memory Access in Microsoft [ 43 ] , and Pony Express RPCs at Google [ 70 ] ), the successes have been limited to specialized internal services. These systems require privileged access to specific hardware features and careful integration with target applications, such as hypervisors, remote storage, and bare-metal applications. However, they are not generally compatible with the most common deployment model—virtual machines (VMs) in public clouds. Even internal workloads at large companies like Amazon and Microsoft often run as guests on the public cloud (with a few exceptions) and, thus, cannot use these networking services [ 71 ] . Even though many userspace networking systems (called "stacks" in this paper) have been made publicly available, such as mTCP [ 58 ] , libvma [ 4 ] , eRPC [ 60 ] , TAS [ 62 ] , and Demikernel [ 85 ] , they have not seen widespread adoption. What discourages application developers from using one of the many open-source userspace stacks? NIC feature Description Approximate year of introduction Network stacks that used the feature Flow steering Redirect matching packets to a specific receive queue 2009 (Intel 82599ES) eRPC [ 60 ] , Snap [ 70 ] , R2P2 [ 63 ] RSS reconfiguration Query/modify the RSS key or redirection table 2009 (Intel 82599ES) TAS [ 62 ] , RSS++ [ 25 ] , mTCP [ 58 ] TX DMA from app memory Transmit packets directly from DMA-registered user memory 2009 (Mellanox ConnextX2) Cornflakes [ 80 ] , eRPC [ 60 ] Remote DMA Access remote server memory without involving remote CPU 2009 (Mellanox ConnextX2) SocksDirect [ 68 ] , mRPC [ 33 ] Deep RX queues RX queues with thousands of entries, to prevent host-side packet drops 2009 (Mellanox ConnectX2) eRPC [ 60 ] ) Multi-packet RQs Receive multiple packets with one RX queue descriptor 2014 (Mellanox ConnectX4) eRPC [ 60 ] , Virtuoso [ 81 ] Table 1: LCD model has not changed in the past 15 years, long slack between hardware support and Cloud adoption. Examples of NIC features that are not exposed to MVs created in public clouds of major providers. Existing solutions heavily rely on them since some of these features have been available for more than a decade to this date. First, we find that virtual network interfaces (vNICs) used by cloud VMs, the standard environment for deploying modern applications, lack many features these stacks need. Their restricted feature set stems from the public clouds’ need to support (a) network virtualization and (b) a consistent interface across a decade of deployed NIC generations. Notably, we find that no vNIC offered by leading cloud providers supports "flow steering," crucial for mapping network flows to CPU cores, a standard feature in bare-metal interfaces since 2009 [ 3 ] . Other missing functionalities in vNICs include configurable support for receive-side scaling (RSS), RDMA, and multi-packet receive queues (Table 1 ). Although newer NIC models may support all these features, the financial impracticality of replacing older, widely deployed models prevents their universal availability in the near future [ 6 ] . Second, we identify that the architectural complexity of userspace stacks is also a limiting factor. These stacks are based on either the library operating system (libOS) [ 60 , 58 ] or sidecar [ 62 , 70 ] model. The libOS model integrates the network stack directly into applications, leading to challenges such as the inability to enforce congestion control policies [ 59 ] and the need for applications to be written in low-level systems languages [ 27 , 85 ] . The sidecar model addresses some of these issues by running the stack as a separate process, allowing greater flexibility. Existing sidecars, though, co-design the components like CPU scheduler, queue management, and networking stack to squeeze the last drops of performance out of CPUs [ 76 , 70 , 47 ] . The complexities of these models and their extreme performance objectives—processing tens of millions of packets per second—are not only overkill for typical public cloud environments [ 84 ] but also increase the deployment challenges for users who are not cloud infrastructure experts. For instance, these bespoke systems often optimize using knowledge of application service time [ 85 , 76 , 63 ] . It is challenging to apply such configuration in a cloud environment by non-expert developers, and misconfiguration may result in wasted computing resources. To work on the VMs across the major cloud providers and to enable easy adoption by non-expert cloud users, we have created a novel userspace network stack called Machnet, built explicitly for cloud VMs. We started by modeling a common vNIC to understand the features Machnet can rely upon. We created the Least Common Denominator (LCD) NIC model, the minimal feature set supported by all kernel-bypass vNICs. Developers of userspace stacks who want to target broad applicability should use this model. Our experiments