Swift : Rethinking RDMA Control Plane for Elastic Computing
Junxue Zhang, Han Tian, Xinyang Huang, Wenxue Li, Kaiqiang Xu, Dian Shen, Yong Wang, Kai Chen · 2025
Read Swift : Rethinking RDMA Control Plane for Elastic Computing by Junxue Zhang, Han Tian, Xinyang Huang, Wenxue Li, Kaiqiang Xu, Dian Shen, Yong Wang, Kai Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-19051.txt.
Introduction
Junxue Zhang and seven co-authors presented Swift in 2025, a design for fast network links in elastic computing. Elastic systems grow and shrink with demand, and a direct memory access method gives them fast, low-delay links. Setting up those links, though, can slow the system down. Past work chased microsecond-level gains in that setup step.
The authors argue such extreme gains are often not needed. They show that caching can speed up setup a lot, and that link resources can be shared between processes with a standard fork step. Swift pairs these ideas with a serverless framework and sorts cold, warm, and forked requests in its own way. In tests it raised throughput and cut delay against prior systems, with modest setup cost.
Catalog record
| CREATOR | Junxue Zhang, Han Tian, Xinyang Huang, Wenxue Li, Kaiqiang Xu, Dian Shen, Yong Wang, Kai Chen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-19051
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Swift : Rethinking RDMA Control Plane for Elastic Computing Junxue Zhang, Han Tian, Xinyang Huang, Wenxue Li, Kaiqiang Xu, Dian Shen, Yong Wang, Kai Chen Abstract Elastic computing enables dynamic scaling to meet workload demands, and Remote Direct Memory Access (RDMA) enhances this by providing high-throughput, low-latency network communication. However, integrating RDMA into elastic computing remains a challenge, particularly in control plane operations for RDMA connection setup. This paper revisits the assumptions of prior work on high-performance RDMA for elastic computing, and reveals that extreme microsecond-level control plane optimizations are often unnecessary. By challenging the conventional beliefs on the slowness of user-space RDMA control plane and the difficulty of user-space RDMA resource sharing, we uncover new design opportunities. Our key insight is that user-space RDMA connection setup can be significantly improved with caching, while RDMA resources can be efficiently shared among processes using fork. In light of this, we propose Swift , a simple yet effective solution that co-designs RDMA with a serverless framework to optimize performance for elastic computing. At its very core, Swift handles cold and warm serverless requests by swiftly initializing the RDMA control plane with cache-optimized libibverbs , and manages fork requests by leveraging the RDMA’s fork capability. Implemented with OpenWhisk, Swift delivers 30.56 − 46.50 % 30.56-46.50\% higher average throughput and 18.55 − 37.21 % 18.55-37.21\% lower latency, at a cost of 6.5 % 6.5\% control plane overhead, compared to prior solutions. 1 Introduction Elastic computing has revolutionized how computing resources are allocated and utilized, allowing for dynamic scaling to meet varying workload demands [ 7 , 13 , 31 , 34 , 5 , 10 ] . This paradigm, particularly in serverless computing, offers significant advantages in performance and cost efficiency by scaling resources up or down as needed. Serverless platforms like AWS Lambda [ 3 ] enable developers to deploy and run code without managing the underlying infrastructure, providing automatic scaling in response to incoming requests or events. Remote Direct Memory Access (RDMA) is a key technology for enhancing applications running on elastic computing platforms by providing high-throughput, low-latency network communication [ 12 , 25 ] . By allowing direct memory access between servers without involving the operating system, RDMA reduces CPU overhead and achieves ultra-fast data transfer speeds. These features make RDMA an ideal choice for applications requiring efficient data exchange, such as key-value stores, transaction processing, and large-scale AI training. However, adopting RDMA in the elastic computing environments poses challenges, particularly in the control plane operations involved in setting up and maintaining RDMA connections [ 30 , 13 ] . For long-lived applications, RDMA control plane overhead is amortized over extended periods. However, in elastic computing, where tasks are short-lived and frequently started or stopped, control plane setup becomes a critical performance bottleneck because the control plane needs to be reinitialized each time a task restarts . Previous solutions, like KRCore [ 30 ] , have introduced kernel-space mechanisms to mitigate these issues. KRCore’s approach maintains a pool of pre-established queue pairs in kernel space, allowing tasks to share these connections and eliminate the need for time-consuming setup procedures. While this method is effective, it comes with drawbacks: the interaction between user-space and kernel-space through system calls leads to significant data plane performance loss, and the reliance on kernel-space introduces compatibility issues and security risks In this paper, we revisit the assumptions and design spaces of previous works on high-performance RDMA for elastic computing. We begin by analyzing the time scales required for various task startup scenarios—cold start, warm start, and fork start—and demonstrate that extreme microsecond-level control plane optimizations are often unnecessary. We then challenge two key assumptions from earlier research: (1) user-space RDMA control plane is slow and typically takes 16-34 milliseconds for connection setup [ 30 , 13 ] and (2) it is difficult to share RDMA resources in the user-space [ 30 ] . Our analysis reveals that user-space RDMA connection setup times can be drastically reduced through optimizations. By implementing caching mechanisms for frequently accessed internal functions for libibverbs , we achieve substantial performance improvements. For instance, our optimizations reduce the ibv_open_device API call time from 22.9 milliseconds to 2.18 milliseconds—a more than 10\times improvement. Furthermore, we demonstrate that user-space RDMA resources can be efficiently shared among processes using the fork feature, aligning with the fork-based design of elastic computing for ultra-fast task startup. Breaking these conventional beliefs opens new opportunities of leveraging user-space RDMA to design high-performance RDMA for elastic computing. To this end, we propose Swift , a simple yet effective system that co-designs RDMA with a serverless framework to meet the performance demands of elastic computing. For cold and warm task startup scenarios, Swift leverages the optimized libibverbs to swiftly initialize the RDMA control plane with minimal overhead. For fork-based task startup scenarios, Swift utilizes RDMA’s fork capability with pre-connected RC queue pairs to achieve low-latency communication. Moreover, Swift delivers compelling performance for different use cases in elastic computing while not comprising security requirements and achieving robust compatibility. We implement Swift with OpenWhisk [ 4 ] and evaluate the performance of Swift in terms of Swift ’ libibverbs , control plane, and data plane. The evaluation results show that: (1) Compared to unmodified libibverbs , Swift ’s optimized libibverbs achieves a 10\times performance improvement in the RDMA control plane. (2) Compared to previous kernel-based solutions like KRCore, Swift achieves similar performance, with a deficiency of within 5\% in the RDMA control plane across all task startup scenarios. (3) In the RDMA data plane, Swift significantly outperforms kernel-based methods, achieving 30.56-46.50\% higher average throughput and 18.55-37.21\% lower latency. (4) Unlike kernel-space solutions that are bound to specific kernel versions, Swift demonstrates good compatibility and can function properly with different Linux kernel versions. These evaluation results highlight that by challenging conventional assumptions, Swift provides a simple yet highly effective solution: despite up to 6.5\% performance degradation in the RDMA control plane, it significantly improves data plane performance and compatibility. Key Takeaways for the Community: We hope this paper will inspire the community in the following ways: \bullet Clarifying the Requirements of RDMA for Elastic Computing: To identify the necessary optimizations for enabling RDMA in elastic computing, we perform a comprehensive requirements analysis. By examining the appropriate time scales for various startup scenarios, we inform that microsecond-level optimization of the RDMA control plane is often unnecessary. \bullet Challenging Conventional Beliefs on RDMA Control Plane Overhead: We challenge long-held assumptions that the RDMA control plane is inherently slow and that user-space resources are difficult to share. By optimizing the performance of libibverbs by more than 10\times , yielding immediate benefits to our community, and enabling simple sharing of RDMA resources through fork , we demonstrate new opportunities for high-performance RDMA in elastic computing. \bullet A Simple Yet Effective Solution: Based on these observations, we propose Swift , a straightforward yet effective solution co-designed with a serverless framework. We believe Swift can inspire the community to develop more systems that leverage similar insights. 2 Background 2.1 Elastic Computing Elastic computing is a paradigm in which computing resources are dynamically adjusted to match current workload demands, ensuring optimal performance and cost efficiency [ 9 , 2 ] . It