OBASE: Object-Based Address-Space Engineering to Improve Memory Tiering
Vinay Banakar 1, 3 , Suli Yang 3 , Kan Wu 2 , Andrea C. Arpaci-Dusseau 1 , Remzi H. Arpaci-Dusseau 1 , Kimberly Keeton 3 1 University of Wisconsin-Madison 2 xAI 3 Google · 2026
Read OBASE: Object-Based Address-Space Engineering to Improve Memory Tiering by Vinay Banakar 1, 3 , Suli Yang 3 , Kan Wu 2 , Andrea C. Arpaci-Dusseau 1 , Remzi H. Arpaci-Dusseau 1 , Kimberly Keeton 3 1 University of Wisconsin-Madison 2 xAI 3 Google (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-00378.txt.
Introduction
Banakar and five colleagues trace wasted memory in data centres to hotness fragmentation. Allocators group objects by size rather than use, so hot and cold items share pages and cold bytes stay locked in costly DRAM. Google traces show nearly all bytes in active pages are cold. Their OBASE system tracks access lightly and moves objects at run time so hot pages hold only hot items. Across varied structures and traces, page use rises several fold and footprint falls sharply, with small overhead.
Catalog record
| CREATOR | Vinay Banakar 1, 3 , Suli Yang 3 , Kan Wu 2 , Andrea C. Arpaci-Dusseau 1 , Remzi H. Arpaci-Dusseau 1 , Kimberly Keeton 3 1 University of Wisconsin-Madison 2 xAI 3 Google |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63318 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.00378
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
OBASE: Object-Based Address-Space Engineering to Improve Memory Tiering Vinay Banakar 1, 3 , Suli Yang 3 , Kan Wu 2 , Andrea C. Arpaci-Dusseau 1 , Remzi H. Arpaci-Dusseau 1 , Kimberly Keeton 3 1 University of Wisconsin-Madison 2 xAI 3 Google Abstract . Hardware and OS mechanisms for memory tiering are widely deployed, yet datacenters still overprovision DRAM. The root cause is hotness fragmentation : allocators place objects by size rather than access pattern, so hot and cold objects become interleaved within the same pages. A single hot object marks its page as active, trapping surrounding cold data in expensive DRAM. Our analysis of Google production workloads shows that up to 97% of the bytes in active pages are cold and unreclaimable. We propose address-space engineering : dynamically reorganizing virtual memory so that hot objects cluster into uniformly hot pages and cold objects into uniformly cold pages. We present OBASE , a compiler-runtime system for unmanaged languages that serves as an object-aware frontend for page-aware OS backends . OBASE tracks accesses via lightweight pointer instrumentation and migrates objects at runtime using a lock-free protocol that is safe under concurrency. By reorganizing the address space, OBASE enables unmodified backends (kswapd, TMO, TPP, Memtis) to tier memory effectively. Across ten concurrent data structures, six backends, and production traces from Meta and Twitter, OBASE improves page utilization by 2–4 × \times and reduces memory footprint by up to 70%, with only 2–5% overhead. 1. Introduction Memory capacity, especially DRAM, has become the dominant cost driver in modern data centers, often accounting for 50% of server capital expenses ( 49 ; 37 ; 11 ) . Memory tiering promises a solution: by placing cold, less accessed data in cheaper, slower tiers—such as compressed memory, SSDs, or CXL-attached disaggregated memory ( 10 ; 27 ; 30 ; 46 ; 31 ; 3 ) —one could significantly reduce the expensive DRAM capacity required, thereby lowering costs ( 53 ; 37 ; 32 ; 50 ; 14 ; 43 ) . In principle, this approach shows great promise, primarily because in hyperscale workloads, only a small volume of memory is hot; the vast majority remains cold and un-accessed for extended periods. As shown in Figure 1 , across six different Google workloads ( 18 ) , only 1.7%–21.3% of bytes are accessed during the trace duration. Indeed, four of the six workloads access less than 3% of bytes, suggesting that we could reclaim 80% to 98% of DRAM for secondary tiers with minimal impact on application performance. In practice, however, realizable gains often fall short of this potential. Google reported offloading only 20% of infrequently accessed data to a compressed memory tier ( 31 ) , while Meta achieved similarly modest savings of 20% - 32% ( 53 ) , leaving a substantial gap between theoretical and realizable gains. The crux of this gap lies in a mismatch between how applications organize data and how the OS manages memory: applications access data at object granularity, which varies in size, while the OS manages memory at fixed-size page granularity (4KB, 2MB, or 1GB). Modern allocators place objects on pages with no regard for how these objects will be accessed in the future, often placing frequently accessed objects and rarely touched objects intermingled on the same page. As a result, a few hot bytes (e.g., a single object) would make a whole page active from the OS’s perspective, trapping the whole page in expensive DRAM. One can clearly see this phenomenon in Figure 1 , where even though only 3.2% of bytes are accessed in a workload Bravo, 91.8% of the pages are accessed, making them unfit candidates for reclamation. Similar trends can be observed across all six workloads. We term this phenomenon hotness fragmentation and identify it as the root cause of inefficient tiering in current hyperscalers. We quantify this fragmentation using the page utilization metric. Figure 1 . The granularity gap in memory access of Google workloads. Dark Grey: The percentage of total memory bytes actually accessed. Light Grey: The percentage of total memory pages accessed. Red: The page utilization (calculated as Bytes Accessed / Pages Accessed, see § 2.2 for more details). To combat hotness fragmentation, we introduce address space engineering , which dynamically reorganizes objects within the address space so that objects with similar access intensities are grouped together. By segregating hot and cold objects, address space engineering promises to close the gap between theoretical and realizable memory savings. It creates a memory layout with uniformly cold pages that are significantly more amenable to tiering. Figure 2 . Low Per-Page Utilization in Google Production Workloads. CDFs of page utilization for six widely deployed applications, shown for all pages combined (left), separately for 4KB pages (center), and 2MB pages (right). Crucially, by focusing on the address space layout , we decouple memory tiering into two orthogonal, allowing independent innovation within each: the layout (frontend) problem, which organizes objects to yield high-quality page candidates for reclamation; and the reclamation (backend) problem, which focuses on migration policies and mechanisms across different tiers. This separation allows us to reuse existing page-based tiering infrastructures—both swap-based ( 31 ; 53 ) and byte-addressable ( 37 ; 32 ; 43 ) —and leverage future improvements in reclamation mechanisms. It also ensures that our layout optimization techniques remain applicable to future, currently non-existent memory tiers (e.g., CXL 3.0 fabrics or NVM). Further, it significantly lowers the adoption barrier for hyperscalers: rather than requiring changes to their existing tiering backends, address space engineering provides a superior memory layout that makes existing backends work more effectively. In this paper, we present O bject- B ased A ddress- S pace E ngineering ( OBASE ) , a compiler-runtime system that engineers the address space for unmanaged languages like C/C++. OBASE acts as an intelligent frontend for memory organization: it manages pointer-based data structures, transparently profiles object access using lightweight instrumentation to determine access intensity, and employs a novel lock-free protocol to migrate objects safely, clustering hot and cold objects together. As a result, OBASE prepares the memory layout for any OS backend , enabling them to work more effectively. Crucially, OBASE preserves standard language semantics, requiring minimal developer intervention. We evaluate OBASE with ten concurrent pointer-based data structures and six state-of-the-art reclamation and tiering backends ( 51 ; 37 ; 32 ; 50 ; 53 ) . Using key-value store workloads (YCSB) and production traces (Meta, Twitter), we demonstrate that OBASE improves page utilization (by 2-4x) and achieves higher memory savings (up to 70%) at the same performance overhead, or conversely, achieves equivalent savings with negligible performance impact. For tiered-memory configurations, OBASE achieves the same throughput with half the DRAM capacity. The rest of this paper is organized as follows. § 2 quantifies hotness fragmentation in production workloads and establishes the case for dynamic object reorganization. § 3 presents the design of OBASE , including the guide abstraction for object mobility, lightweight access tracking, and our pauseless lock-free migration protocol. § 4 details key implementation choices. § 5 evaluates OBASE across data structures, backends, and production traces. 2. Case for Dynamic Object Reorganization In this section, we show that hotness fragmentation is both severe and