Clove: Object-Level CXL Memory Management in Managed Runtimes Conference: ; ;

Sam Son, Zhihong Luo, Wen Zhang, Sylvia Ratnasamy, Scott Shenker · 2026

Read Clove: Object-Level CXL Memory Management in Managed Runtimes Conference: ; ; by Sam Son, Zhihong Luo, Wen Zhang, Sylvia Ratnasamy, Scott Shenker (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20370.txt.

Introduction

Son and four co-workers bring object-level memory control to managed runtimes on CXL tiered memory. Page-based control wastes the tight budget of CXL links, and past object-level work targets hand-built runtimes. Their Clove system extends managed runtimes with profile-based tracking of hot objects and rules to move them. A JVM prototype keeps fast-tier use high with bounded cost, cutting slowdowns by 22 to 84 percent over page-based systems.

Catalog record

CREATORSam Son, Zhihong Luo, Wen Zhang, Sylvia Ratnasamy, Scott Shenker
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66400
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.20370

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Clove: Object-Level CXL Memory Management in Managed Runtimes Conference: ; ; Sam Son, Zhihong Luo, Wen Zhang, Sylvia Ratnasamy, Scott Shenker Abstract . Object-level management of tiered memory has been studied to address the inefficiencies in page-based systems. However, object-level management for CXL-tiered memory remains underexplored due to CXL’s tight performance budget and load/store interface. As a result, existing approaches remain limited in scope, primarily targeting unmanaged-language applications with bespoke runtimes or compiler support. This paper identifies and explores a new design point for object-level CXL management: managed languages and their runtimes. The key observation is that existing managed runtimes already provide highly optimized mechanisms for problems closely related to object-level management, including object relocation and dynamic code generation. However, they still lack the features needed for tiered memory management, such as hotness tracking and relocation policies, and thus must be carefully extended to fully realize this direction. We present Clove, a system that extends existing managed runtimes to support object-level CXL management for managed-language applications. Clove combines profile-guided object hotness tracking with object relocation techniques and policies. Our JVM prototype demonstrates that this extension enables high utilization of fast-tier memory while bounding runtime overhead, reducing application slowdown by 22–84% compared to page-based systems. 1. Introduction The longstanding effort to build tiered-memory systems has recently accelerated with the advent of Compute Express Link (CXL). By offering significantly higher performance than previous memory-expansion approaches ( Liu et al. 2024 ; Samsung 2022 ) , CXL has spurred substantial research interest and growing industry adoption ( Intel 2024a ; Li et al. 2023 ) . As with any tiered memory system, efficient use of CXL memory requires maximizing the fast-tier hit ratio , i.e., the fraction of memory accesses served by the fast memory tier. Achieving this requires solving two key design problems: hotness tracking , which monitors the recency and frequency of memory accesses to distinguish hot data from cold data, and data relocation , which moves hot data to the fast tier and cold data to the slow tier at an appropriate granularity. Existing CXL memory management systems typically rely on virtual memory and use pages as the unit of both hotness tracking and relocation (see, for example, ( Lee et al. 2023 ; Raybuck et al. 2021 ; Vuppalapati and Agarwal 2024 ; Xiang et al. 2024 ; Duraisamy et al. 2023 ; Maruf et al. 2023 ; Li et al. 2023 ; Zhong et al. 2024 ; van Riel and Chegu 2014 ; Agarwal and Wenisch 2017 ; Maruf et al. 2022 ) ) because doing so preserves application transparency and incurs low runtime overhead, i.e., efficiency . However, such techniques face the fundamental problem that data on a single page may have very different access frequencies, a phenomenon we call intrapage hotness skew ; thus, even an optimal placement of pages cannot achieve the optimal fast-tier hit ratio. This problem is exacerbated by the extensive use of huge pages ( Hat 2025 ; Oracle 2025 ) (§ 2.2 ). Object-level management has been studied as a solution to this problem in the broader context, but CXL’s characteristics make it particularly challenging for two reasons. A higher bar for efficiency : CXL is much closer to local memory in performance than prior slow tiers, so the overhead of tracking and relocating many objects can easily outweigh the benefit of improved placement. No anchor point : CXL memory is accessed through ordinary loads and stores, leaving no natural software interception point for transparent management. We elaborate on these points in § 2.1 . As a result, object-level CXL memory management remains underexplored. To our knowledge, only one concurrent work studies object-level CXL management ( Banakar et al. 2026 ) , and it follows an approach proposed by prior tiering systems: it asks developers of unmanaged-language applications to rewrite important data structures using custom APIs, then builds dedicated runtime or compiler support to track and relocate the corresponding objects. This approach can be efficient because it narrows the number of objects to track, and it creates an explicit anchor point for management; however, it is not transparent because it still requires application rewriting. In this paper, we explore a new design point for object-level CXL memory management that is based on extending existing managed runtimes , such as the Java Virtual Machine (JVM) and .NET Common Language Runtime (CLR). While prior work starts from unmanaged languages and adds new runtime or compiler support to recover object-level visibility and efficient control, we instead start from the opposite direction: managed runtimes already have object-level visibility and efficient control mechanisms, and we ask whether they can be extended to manage CXL tiered memory efficiently and transparently at object granularity. This direction is important because it targets managed-language applications, a large class of production software that has received limited attention from prior object-level tiering systems. It is also promising because managed runtimes already solve problems closely related to object-level CXL management (§ 2.3 ): modern garbage collectors provide optimized support for relocating objects for heap compaction, and JIT-compilation-based execution provides a way to observe runtime behavior and selectively instrument code based on it, which is essential for transparent hotness tracking. Together, these mechanisms offer a natural starting point for efficient and transparent object-level management. However, managed runtimes do not provide object-level CXL management out of the box, posing the following technical challenges (§ 3 ). First, they still require efficient and transparent object hotness tracking for CXL. Existing tracking methods either require developer assistance or become too expensive when applied directly to objects. Second, the managed runtime lacks visibility into the physical tiers, so it must coordinate with the operating system to perform physical tier placement. Lastly, while object relocation mechanisms can be reused, how exactly they are repurposed matters. Motivated by these observations and challenges, we present Clove, a transparent and efficient object-level CXL memory management system for managed-language applications . Clove addresses the challenges above by carefully extending existing runtime mechanisms (§ 3 ). First, it introduces profile-guided object hotness tracking : Clove uses hardware-assisted profiling to identify the small set of load instructions responsible for most LLC misses and then tracks only the object accesses triggered by those instructions. This approach captures only accesses relevant to CXL tiering, providing accurate and transparent object hotness tracking with low overhead. Second, Clove uses a hybrid relocation approach that combines runtime-level hot-object compaction , which compacts hot objects into contiguous virtual pages, with existing page-level systems, which migrate the corresponding physical pages between tiers. This separation keeps the runtime independent of physical page placement and, as an additional benefit, allows large objects that span multiple pages to be managed at page granularity. Third, Clove introduces policies for hot-object compaction that carefully select objects to relocate, improving fast-tier utilization while bounding relocation overhead. We detail Clove’s design in § 4 . We prototype Clove on top of OpenJDK 21 (§ 5 ) and evaluate it using three memory-intensive Java applications under realistic workloads (§ 6 ). Our evaluation demonstrates that Clove reduces application slowdowns by 22–84% compared to state-of-the-art page-based systems without requiring any source-code changes. These improvements result from object-level management enabled by Clove’s

Read the complete text