Nanvix: A Multikernel OS Design for High-Density Serverless Deployments

Carlos Segarra † Pedro Henrique Penna ‡ Enrique Saurez ⋆ Íñigo Goiri ⋆ Peter Pietzuch † Shan Lu ‡△ Rodrigo Fonseca ⋆ † Imperial College London ‡ Microsoft Research △ University of Chicago ⋆ Azure Research - Systems · 2026

Read Nanvix: A Multikernel OS Design for High-Density Serverless Deployments by Carlos Segarra † Pedro Henrique Penna ‡ Enrique Saurez ⋆ Íñigo Goiri ⋆ Peter Pietzuch † Shan Lu ‡△ Rodrigo Fonseca ⋆ † Imperial College London ‡ Microsoft Research △ University of Chicago ⋆ Azure Research - Systems (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-11669.txt.

Introduction

Segarra and six colleagues present Nanvix, a multikernel OS for dense serverless deployments. Providers pack many applications per host, but density must not weaken performance or isolation, and naive sharing creates contention. Nanvix splits short-lived per-invocation state from persistent state shared within a tenant. Applications run in a user VM with a micro-kernel, forwarding I/O to a system VM with a shared macro-kernel. The split gives isolation across tenants, cuts contention, and yields order-of-magnitude faster startups with I/O overhead.

Catalog record

CREATORCarlos Segarra † Pedro Henrique Penna ‡ Enrique Saurez ⋆ Íñigo Goiri ⋆ Peter Pietzuch † Shan Lu ‡△ Rodrigo Fonseca ⋆ † Imperial College London ‡ Microsoft Research △ University of Chicago ⋆ Azure Research - Systems
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55989
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.11669

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Nanvix: A Multikernel OS Design for High-Density Serverless Deployments Carlos Segarra † Pedro Henrique Penna ‡ Enrique Saurez ⋆ Íñigo Goiri ⋆ Peter Pietzuch † Shan Lu ‡△ Rodrigo Fonseca ⋆ † Imperial College London ‡ Microsoft Research △ University of Chicago ⋆ Azure Research - Systems Abstract . Serverless providers strive for high resource utilization by optimizing deployment density : how many applications can be deployed per host server. However, achieving high deployment density without compromising application performance or isolation remains an open challenge. High density can be achieved by sharing components across applications, yet applications from different tenants must be strongly isolated from each other due to the risk of side-channel attacks. Sharing components across applications from the same tenant, if done naively, can introduce contention on host resources thus negatively affecting application performance. We describe Nanvix , a new multikernel OS that disaggregates ephemeral execution state, unique per application invocation, from long-lived persistent state, shared among invocations from the same tenant. Applications in Nanvix execute inside a lightweight user VM running a micro-kernel that implements threads and memory, and forwards all I/O requests to a system VM . The system VM runs a macro-kernel with a rich set of device drivers and is shared among all invocations from the same tenant. Nanvix’ split design achieves strong hypervisor isolation across tenants without sacrificing application performance, and reduces same-tenant contention by multiplexing all I/O requests to the system VM. Thanks to a system-wide co-design, Nanvix achieves order-of-magnitude lower application start up times with moderate I/O overheads. When replaying a production trace, Nanvix needs 20-100 × \times fewer host servers compared to state-of-the-art systems, improving deployment density. 1. Introduction The past decade of serverless research has driven significant reductions in application cold start latency through lightweight isolation (e.g. micro-VMs) ( 1 ; 54 ) , fast snapshot restoration ( 16 ) , elastic scaling under bursty load ( 10 ; 28 ) , and increasingly sophisticated orchestration layers ( 43 ) . As a result, production serverless systems can launch new applications in less than a hundred milliseconds, even in periods of high contention ( 33 ; 10 ) . Cold start latency, however, is not the only metric that needs to be optimized. From the perspective of the serverless provider, equally important are inter-tenant isolation and deployment density – how many applications can be co-located on a single server while still meeting per-request latency slo ( slo ) targets ( 33 ) . Unfortunately, it is hard to achieve deployment density while maintaining low cold start latencies and strong isolation: high density can be achieved by sharing components across applications, but excessive sharing can introduce resource contention and side-channels. An orthogonal but equally desirable property is compatibility with existing programming frameworks: being able to run existing software on standard runtimes, instead of requiring a completely new programming model and targeted rewrites ( 28 ; 48 ; 54 ) . Figure 1 . Serverless design space (Serverless providers wish to optimize deployment density as a proxy for resource efficiency, but struggle to do so while maintaining low cold start latencies, strong inter-tenant isolation, and application compatibility.) Fig. 1 illustrates the trade-offs made by different systems. Many prior works relax inter-tenant isolation by sharing the same process substrate via software-fault isolation ( 48 ; 12 ) , or the same os ( os ) kernel, via containerization ( 17 ; 9 ) . In this paper, we target multi-tenant serverless deployments that cannot compromise on inter-tenant isolation and must isolate applications using vm . Systems such as Azure Functions, explicitly sacrifice deployment density for lower cold start latency by pre-warming vm instances in a pool ( 2 ) . Other systems achieve deployment density, cold start latency, and inter-tenant isolation, but sacrifice application compatibility by imposing substantially different programming and execution models ( 28 ; 54 ) . Unfortunately, the systems that do retain compatibility (under virtualization) ( 1 ; 29 ; 33 ) end up paying a large, often order-of-magnitude, density and latency penalty compared to those which do not. This is because they use a guest os that was not designed for ephemeral execution and work around it with advanced vm snapshot techniques ( 10 ; 3 ) or using lightweight isolation inside a parent vm ( 33 ) . Ultimately, these system-level solutions shift the pressure to other parts of the system (see §2 ). On this landscape, our key observation is that the high cost of compatibility is the root cause of cold start latency and low deployment density. This cost cannot go down in a secure and fundamental way as long as we expect the guest os inside each vm to implement all the features required for compatibility such as devices, network and file systems (see 2(a) ). Consequently, to achieve a minimum virtualization environment for serverless applications, we argue for disaggregating the ephemeral execution state of every application from the long-lived persistent state of the os . (a) Traditional vm (b) Nanvix Figure 2 . Nanvix is a multikernel os for serverless (Existing multi-tenant serverless platforms offer compatibility by including all os functionality in the guest, fundamentally limiting performance and density. Nanvix, on the other hand, advocates for a disaggregated design.) Our proposal. To fulfill this idea, we present Nanvix , a new multikernel os for high-density serverless deployments. Nanvix splits the system services of the guest os across two virtualized environments: (1) a lightweight user VM with a micro-kernel that supports application’s ephemeral execution with thread and memory management; (2) a feature-rich system VM with a macro-kernel that provides system functionality (i.e. networking and file system) for all user VMs belonging to the same tenant (see 2(b) ). Nanvix is a unique multikernel os where two kernels provide complementary properties that together meet serverless performance, compatibility, security, and density goals: Micro-kernel.: It implements processes, threads, scheduling, memory management, IPC, and a POSIX compatibility layer, but eschews device virtualization, network, or file systems. This minimal-feature design ensures each user VM has a small memory footprint and very-fast startup, addressing the cold start latency without compromising deployment density or security. Macro-kernel.: It includes the full set of device drivers and kernel modules needed to serve I/O requests that the micro-kernel cannot handle. The system VM, similar to other cloud vm running a fully-featured os , has a considerably higher cold start latency and memory footprint than a user VM. Fortunately, unlike ephemeral user VMs, a system VM is long-lived, serves requests from many user VMs from the same tenant, and can be proactively auto-scaled. In addition, given that it does not execute tenant-specific code, all system VM instances can be restored from a generic snapshot. We adopt a clean-slate (co-)design for the micro-kernel, its VMM, and the userspace components of the system VM, while employing a trimmed Linux as the macro-kernel. We implement all components in Rust and release them as open-source. Nanvix executes unmodified applications written in C, C++ and Rust after compilation with our toolchain. It also executes Python, JavaScript, and WebAssembly (WASM) applications by compiling the language runtime. Our evaluation shows that user VMs start up in a handful of milliseconds, an order-of-magnitude

Read the complete text