Tidying Up the Address Space Conference: 3rd Workshop on Disruptive Memory Systems; October 13–16, 2025; Seoul, Republic of Korea 3rd Workshop on Disruptive Memory Systems (DIMES ’25), October 13–16, 2025, Seoul, Republic of Korea DOI: 10.1145/3764862.3768179 ISBN: 979-8-4007-2226-4/25/10
Vinay Banakar 1, 3 , Suli Yang 3 , Kan Wu 2 , Andrea C. Arpaci-Dusseau 1 , Remzi H. Arpaci-Dusseau 1 , Kimberly Keeton 3 1 University of Wisconsin-Madison 2 xAI 3 Google · 2025
Read Tidying Up the Address Space Conference: 3rd Workshop on Disruptive Memory Systems; October 13–16, 2025; Seoul, Republic of Korea 3rd Workshop on Disruptive Memory Systems (DIMES ’25), October 13–16, 2025, Seoul, Republic of Korea DOI: 10.1145/3764862.3768179 ISBN: 979-8-4007-2226-4/25/10 by Vinay Banakar 1, 3 , Suli Yang 3 , Kan Wu 2 , Andrea C. Arpaci-Dusseau 1 , Remzi H. Arpaci-Dusseau 1 , Kimberly Keeton 3 1 University of Wisconsin-Madison 2 xAI 3 Google (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-19765.txt.
Introduction
Vinay Banakar and five co-authors attack a waste problem in datacenter memory tiering: hot and cold data objects end up intermingled on the same memory pages. Page-based systems can only move whole pages, so a page with one hot object and much cold data cannot be reclaimed or promoted sensibly. Their answer is address-space engineering, reorganizing an application's virtual memory so hot and cold regions separate.
Their system, HADES, pairs a compiler and runtime that track access patterns and migrate objects accordingly, with little developer effort. Any existing page-level tiering backend can then manage the tidied layout. Across ten data structures, the approach cut memory use by up to seventy percent with only about three percent performance overhead.
Catalog record
| CREATOR | Vinay Banakar 1, 3 , Suli Yang 3 , Kan Wu 2 , Andrea C. Arpaci-Dusseau 1 , Remzi H. Arpaci-Dusseau 1 , Kimberly Keeton 3 1 University of Wisconsin-Madison 2 xAI 3 Google |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-19765
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Tidying Up the Address Space Conference: 3rd Workshop on Disruptive Memory Systems; October 13–16, 2025; Seoul, Republic of Korea 3rd Workshop on Disruptive Memory Systems (DIMES ’25), October 13–16, 2025, Seoul, Republic of Korea DOI: 10.1145/3764862.3768179 ISBN: 979-8-4007-2226-4/25/10 Vinay Banakar 1, 3 , Suli Yang 3 , Kan Wu 2 , Andrea C. Arpaci-Dusseau 1 , Remzi H. Arpaci-Dusseau 1 , Kimberly Keeton 3 1 University of Wisconsin-Madison 2 xAI 3 Google Abstract . Memory tiering in datacenters does not achieve its full potential due to hotness fragmentation—the intermingling of hot and cold objects within memory pages. This fragmentation prevents page-based reclamation systems from distinguishing truly hot pages from pages containing mostly cold objects, fundamentally limiting memory efficiency despite highly skewed accesses. We introduce address-space engineering: dynamically reorganizing application virtual address spaces to create uniformly hot and cold regions that any page-level tiering backend can manage effectively. HADES demonstrates this frontend/backend approach through a compiler-runtime system that tracks and migrates objects based on access patterns, requiring minimal developer intervention. Evaluations across ten data structures achieve up to 70% memory reduction with 3% performance overhead, showing that address space engineering enables existing reclamation systems to reclaim memory aggressively without performance degradation. † † cc-license: by 1. Introduction Memory is the most constrained and costly resource in modern datacenters, with utilization reaching 60-90% at hyperscalers like Google ( Tirmazi et al. 2020 ) and Meta ( Maruf et al. 2022 ) while driving 50% of server costs ( Li et al. 2023 ) . To control these mounting expenses, operators adopt memory tiering to move cold data from expensive DRAM to slower, cheaper storage ( Maruf et al. 2022 ; Li et al. 2023 ; Lee et al. 2023 ; Duraisamy et al. 2023 ) . However, the effectiveness of tiering is fundamentally limited by a semantic gap between applications and the operating system. Applications operate on fine-grained data objects, while the OS manages memory in coarse-grained pages. This mismatch causes frequently accessed (hot) and infrequently accessed (cold) objects to become intermingled on the same pages—a problem we term hotness fragmentation . This fragmentation cripples page-level reclamation, as even a single hot object on a page prevents the entire page from being safely moved to a slower tier without risking performance-degrading page faults. Existing systems do not address the root cause of this problem. Page-level reclamation systems like the kernel’s kswapd, Google’s zswap ( Lagar-Cavilla et al. 2019 ) , or Meta’s TMO ( Weiner et al. 2022 ) are powerful but ignorant; they can only identify pages as hot or cold, not the objects within them, and thus cannot distinguish a truly hot page from a mostly-cold one. Allocation-time hinting approaches ( Johnson et al. 2021 ) are too static, making a one-time placement decision that cannot adapt as an object’s access patterns change over its lifetime. While more radical object-level tiering systems ( Ruan et al. 2020 ; Guo et al. 2023 ) offer fine-grained control, they impose high adoption costs by requiring significant application modifications and direct hardware access. Therefore, what is needed is a system that provides object-level awareness to guide page-level decisions, without abandoning the abstractions that make existing systems practical. Figure 1. Address-Space Engineering. Hotness fragmentation (top) intermixes hot (red) and cold (blue) objects, making pages difficult to reclaim. Address-space engineering (bottom) reorganizes objects into uniformly hot and cold regions, enabling efficient page-level management. We propose address-space engineering : instead of making the OS object-aware, we engineer the application’s virtual address space to be OS-tiering-friendly, adapting to workload access patterns. While garbage-collected languages have long employed object reorganization for locality ( Huang et al. 2004 ; Chen et al. 2006 ; Hill et al. 2000 ; White 1980 ) , unmanaged languages like C++ present unique challenges due to the assumption that allocation-time decisions are final ( Blackburn et al. 2004 ) . The key insight is to challenge this assumption for pointer-based data structures while preserving the language’s semantic guarantees. As shown in Figure 1 , this approach "tidies up" the fragmented address space by dynamically identifying and migrating objects based on their access patterns, transforming a fragmented layout, where hot and cold data are mixed, into a cleanly organized one, where objects are grouped by their access temperature. This continuous, dynamic engineering of the virtual address space is the key to bridging the semantic gap between application objects and OS pages. Dynamic reorganization enables a powerful architectural principle: decoupling object-level placement from page-level reclamation. We propose a model with a frontend system responsible for making object placement decisions and a backend responsible for managing the underlying pages. The frontend provides the backend with an address space containing uniformly hot or cold regions, making the backend’s job easier: it can confidently reclaim entire cold regions or promote hot regions to huge pages. This architecture achieves the intelligence of an object-level system while retaining the compatibility and simplicity of existing page-level systems. In this paper, we present Hierarchically Aware Data structurES (HADES) , a compiler-runtime system that realizes this frontend/backend vision for pointer-based data structures in non-managed languages. HADES transparently tracks object-level access intensity and uses a safe, lock-free protocol to migrate objects between hot and cold heaps. We demonstrate that by adding a HADES frontend to standard reclamation approaches like kswapd and proactive reclamation, we can reduce memory usage by up to 70% on YCSB workloads with minimal performance degradation (3-5%). This work makes the following contributions: (1) a decoupled frontend/backend model for memory tiering based on dynamic object reorganization; (2) the design and implementation of HADES, an object-level frontend; and (3) an evaluation demonstrating that this model allows existing, unmodified backends to reclaim memory far more effectively. 2. Semantic Gap in Memory Management Real-world workloads exhibit highly skewed access patterns, with large portions of datasets remaining untouched ( Cao et al. 2020 ; Li et al. 2022 ) or accessed only once ( Yang et al. 2023 ) . Modern allocators ( Zhou et al. 2024 ; Evans 2006 ) optimize for allocation speed and spatial fragmentation reduction, making placement decisions at allocation time without considering future access patterns. Meanwhile, Linux’s memory reclamation system operates at page granularity, using access bits in page table entries to track activity. This fundamental mismatch scatters frequently accessed objects across memory pages, intermixing them with rarely accessed data and creating a semantic gap between application-level object access and OS-level page management. Figure 2. Page Utilization. Redis, Memcached, and MongoDB Page Utilization for 360s epochs running a YCSB-C (read-only) workload with a Zipfian distribution. A small fraction of bytes per page are accessed, and more pages are touched than necessary. From a memory tiering perspective, the core inefficiency arises from the fragmentation of large regions of cold data by a few hot objects, which makes entire pages unreclaimable. This intermingling of hot and cold objects within the same pages is a problem we term hotness fragmentation . To quantify the extent of hotness fragmentation, we introduce the metric Page Utilization . Page Utilization is defined as the ratio of unique accessed bytes to the total size of accessed pages over a specific time period T: PageUtilization(T)=\frac{TotalUniqueBytes(T)}{UniquePages(T)\times PageSize} A low