SCENIC: Stream Computation-Enhanced SmartNIC

Benjamin Ramhorst, Maximilian J. Heer, Luhao Liu, Heejae Kim, Jonas Dann, Jin-Soo Kim, Gustavo Alonso · 2026

Read SCENIC: Stream Computation-Enhanced SmartNIC by Benjamin Ramhorst, Maximilian J. Heer, Luhao Liu, Heejae Kim, Jonas Dann, Jin-Soo Kim, Gustavo Alonso (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-15128.txt.

Introduction

Ramhorst and colleagues build SCENIC, an open-source SmartNIC that treats its datapath as a stream computer. Commercial cards offer speed and easy software fit but little customization, while research cards often lack bandwidth, features, or true NIC behavior. SCENIC runs a 200G datapath with offloaded TCP/IP and RDMA stacks, plus a fallback path for arbitrary traffic. Shared hardware and software abstractions let infrastructure and applications be designed tightly together.

Catalog record

CREATORBenjamin Ramhorst, Maximilian J. Heer, Luhao Liu, Heejae Kim, Jonas Dann, Jin-Soo Kim, Gustavo Alonso
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51994
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.15128

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SCENIC: Stream Computation-Enhanced SmartNIC Benjamin Ramhorst, Maximilian J. Heer, Luhao Liu, Heejae Kim, Jonas Dann, Jin-Soo Kim, Gustavo Alonso Abstract . Although modern, AI-centric datacenters heavily rely on SmartNICs, existing devices impose a hard trade-off. Commercial SmartNICs provide high bandwidth and easy software integration, but offer limited support for customization and data processing offload. In contrast, research SmartNICs often suffer from low bandwidth, limited functionality, and poor software compatibility - to the point that many are not actual NICs in a technical sense. This gap can be closed by treating the NIC datapath as a first-class stream computation substrate with shared hardware/software abstractions for a tight co-design of infrastructure and applications. To demonstrate this, we introduce SCENIC, an open-source datacenter SmartNIC. SCENIC implements a 200G network datapath over offloaded TCP/IP and RDMA stacks, as well as a fallback path for processing arbitrary network traffic. On top of the network logic, SCENIC combines on-datapath Stream Compute Units (SCUs) for data processing and embedded ARM cores for flexible control path manipulation with direct access to GPUs and SSDs. SCENIC is fully integrated with the OS, exposing native Linux network and RDMA verb interfaces, making the programmable datapath transparent to existing applications while enabling control of, e.g., user-defined offloads and programmable congestion control. SCENIC’s performance matches commercial platforms, and we show its versatility through several use cases such as offloaded collective communication and network-to-GPU hash-based data partitioning. 1. Introduction With the ever-increasing scale of modern applications and improvements in compute efficiency through hardware specialization ( Thompson and Spanuth 2021 ; Abadi et al. 2022 ) , computer systems are becoming increasingly constrained by network performance ( Zhang et al. 2020 ) . Following current trends in compute and network bandwidth scaling, estimates indicate that distributed communication will make up between 50% and 75% of future training run-time ( Pati et al. 2023 ) . At the same time, around 25-30% of CPU cycles in datacenters are spent on infrastructure tasks, often referred to as the "datacenter tax" ( Kanev et al. 2015 ) . To tackle these problems, recent focus has shifted to augment and optimize networking with compute through Smart Network Interface Cards (SmartNICs). SmartNICs, in addition to implementing the packet processing pipeline, also offload various steps of the data processing and compute pipeline. This includes, for example, network virtualization functions, storage access, network security and transport protocols, as shown by large-scale deployments of AWS Nitro ( Amazon Web Services 2022 ) , Microsoft AccelNet ( Firestone et al. 2018 ) and Alibaba CIPU ( Community 2022 ) . Furthermore, off-the-shelf SmartNICs, such as NVIDIA Bluefield ( NVIDIA 2023 ) , AMD Pensando ( AMD Pensando 2022 ) and Broadcom Stingray ( Broadcom 2019 ) , have become the backbone of modern ML systems, forming a scale-out network for thousands of GPUs ( Oracle 2025 ) . In research, SmartNICs have been used to explore in-network compute for ML systems ( Guo et al. 2025 ; Xiao et al. 2024 ) , storage offloads ( Zhang et al. 2023 ; Li et al. 2026 ) , databases ( Liu et al. 2024 ; Li et al. 2022 ; Sun et al. 2022 ) , and security ( Zhao et al. 2020 ; Panda et al. 2021 ) . Despite their high network bandwidth and ease-of-use, the very nature of closed-source and hardened commercial SmartNICs hinders novel research and adaptation to modern workloads. For example, next-generation protocols (e.g. UltraEthernet) ( Hoefler et al. 2025 ; Singhvi et al. 2025 ; Shalev et al. 2020 ) and congestion control algorithms ( Li et al. 2019 ; Zhang et al. 2024 ) are explored primarily through simulation due to the limited customizability of commercial NICs. Additionally, these SmartNICs often suffer from poor offload performance, as they are typically implemented using off-path Arm cores with high memory access latency ( Wei et al. 2023 ) or on-path RISC-V cores with limited single-thread performance ( Chen et al. 2024 ) . There has also been an increasing amount of interest in SmartNICs from the research community, with projects exploring many variations of the idea ( Forencich et al. 2020 ; AMD/Xilinx 2021 ; Zhong et al. 2023 ; Brunella et al. 2020 ) . However, most of these systems are limited in bandwidth (100G and often less), lack support for transport protocol offloading (e.g., RDMA, TCP/IP), have no native OS integration (e.g., through Linux netdev or ibv_device ), and have limited or no integration with GPUs or SSDs like commercial SmartNICs do today. With some exceptions, they are not maintained, being just prototypes to demonstrate an idea or the potential to offload some functionality to NICs. In this paper, we present SCENIC, an FPGA-based SmartNIC with end-to-end system integration, designed to support in-network data processing and enabling full customization. SCENIC exploits the streaming nature of network traffic by introducing the notion of reprogrammable Stream Computation Units (SCU) that can be assigned to process network flows in arbitrary ways. The SCUs can be utilized with any of the offloaded network stacks (RDMA, TCP/IP) as well as in combination with collective communication primitives. SCENIC supports up to 200G bandwidth with native OS integration through Linux netdev and ibv_device . The resulting system is similar to those used at scale by Microsoft in Azure cloud ( Rydberg et al. 2026 ) or NVIDIA to manage communication for AI accelerators ( Aubrey and Ghodsian 2026 ) , but with SCENIC being an open-source project providing higher customization possibilities across the entire stack 1 1 1 GitHub repository: https://github.com/fpgasystems/SCENIC . SCENIC builds on well-established, open-source projects (shell ( Korolija et al. 2020 ; Ramhorst et al. 2025 ) , network stacks ( Heer et al. 2025 ; fpgasystems [n. d.] ) , communication libraries ( He et al. 2024 ) , and applications) that had to be redesigned for higher bandwidth, new FPGA architectures and native datacenter compatibility. As such, it offers the possibility of modifying or replacing all of its components, tailoring the system for individual applications or research use cases. SCENIC’s contributions include: • A high-performance network datapath with offloads for common protocols (RDMA, TCP/IP), as well as a fallback path for processing arbitrary traffic. • Support for multiple parallel, isolated applications on the network datapath. Uniquely, SCENIC enables the deployment of offloaded applications both in programmable logic, similar to FPGA-based SmartNICs, and in on-chip Arm cores, similar to commercial DPUs. • A virtual memory model which allows offloaded applications to access both NVIDIA and AMD GPUs, as well as conventional SSDs. • Native integration with Linux netdev and ibv_device , exposing SCENIC as a standard NIC and ensuring compatibility with existing networked applications. • A thorough evaluation covering throughput, latency, GPU/SSD integration, and fairness, demonstrating performance comparable to commercial 200G devices. • A demonstration of SCENIC’s capabilities through two use cases: SmartNIC-offloaded collective communication with performance comparable to OpenMPI, and hash-based data partitioning for multi-GPU execution of database operators, with a 6.7x improvement over the CPU baseline. 2. Related Work Throughout this paper, we adopt the definition of a NIC from ( Daly et al. 2023 ) : a PCIe device with (i) a physical network interface (e.g., Ethernet

Read the complete text