NDPage: Efficient Address Translation for Near-Data Processing Architectures via Tailored Page Table
Qingcai Jiang ∗ , Buxin Tu ∗ and Hong An · 2025
Read NDPage: Efficient Address Translation for Near-Data Processing Architectures via Tailored Page Table by Qingcai Jiang ∗ , Buxin Tu ∗ and Hong An (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-14220.txt.
Introduction
Qingcai Jiang, Buxin Tu, and Hong An present a 2025 chip design paper on memory access for near-data processors. Such chips compute beside the memory to dodge the traffic jam of big data work. They still need virtual memory to stay easy to program. The standard four-level address map, though, costs too much here: lookups flood in and the small top cache can not hold the map entries.
Two fixes form their design, NDPage. Map entries skip the top cache, which speeds their reads and keeps real data in place. The map's last two levels merge into one flat layer, cutting lookup steps while keeping small pages. Tests weigh the gains. Tailored maps could make near-data chips fit real systems.
Catalog record
| CREATOR | Qingcai Jiang ∗ , Buxin Tu ∗ and Hong An |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-14220
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
NDPage: Efficient Address Translation for Near-Data Processing Architectures via Tailored Page Table Qingcai Jiang ∗ , Buxin Tu ∗ and Hong An Abstract Near-Data Processing (NDP) has been a promising architectural paradigm to address the memory wall problem for data-intensive applications. Practical implementation of NDP architectures calls for system support for better programmability, where having virtual memory (VM) is critical. Modern computing systems incorporate a 4-level page table design to support address translation in VM. However, simply adopting an existing 4-level page table in NDP systems causes significant address translation overhead because (1) NDP applications generate a lot of address translations, and (2) the limited L1 cache in NDP systems cannot cover the accesses to page table entries (PTEs). We extensively analyze the 4-level page table design in the NDP scenario and observe that (1) the memory access to page table entries is highly irregular, thus cannot benefit from the L1 cache, and (2) the last two levels of page tables are nearly fully occupied. Based on our observations, we propose NDPage, an efficient page table design tailored for NDP systems. The key mechanisms of NDPage are (1) an L1 cache bypass mechanism for PTEs that not only accelerates the memory accesses of PTEs but also prevents the pollution of PTEs in the cache system, and (2) a flattened page table design that merges the last two levels of page tables, allowing the page table to enjoy the flexibility of a 4KB page while reducing the number of PTE accesses. We evaluate NDPage using a variety of data-intensive workloads. Our evaluation shows that in a single-core NDP system, NDPage improves the end-to-end performance over the state-of-the-art address translation mechanism of 14.3%; in 4-core and 8-core NDP systems, NDPage enhances the performance of 9.8% and 30.5%, respectively. * * footnotetext: These authors contributed equally to this work. I Introduction Data-intensive applications spend significant time and energy moving data between the CPU and memory, which causes the ”memory wall” problem in modern computing systems [ 5 ] . Recent advances in 3D-stacked memory technologies, e.g., High Bandwidth Memory (HBM) [ 19 ] , enable the practical implementation of near-data processing (NDP) , which is a promising solution to alleviate the memory wall problem. By placing computing units within the logic layer of 3D-stacked memory, NDP systems enhance performance and energy efficiency with low-latency and energy-efficient memory accesses [ 26 ] . Despite the significant performance and energy-efficiency potential of NDP, system challenges remain a major obstacle to the practical adoption of NDP architectures. Among these challenges, efficient support for virtual memory is often considered one of the most significant ones in NDP architectures [ 18 ] . Virtual memory allows the operating system to automatically map NDP’s virtual memory addresses to the corresponding physical memory addresses. This flexible mapping provides several benefits for the NDP system, including programmer-transparent memory management and enhanced programmability. Supporting virtual memory comes at the cost of address translation , which is a performance bottleneck for data-intensive applications in modern computing systems with a 4-level page table [ 22 ] . In this work, we find that the address translation overhead is even more profound in NDP systems if we simply apply the 4-level page table design in NDP systems due to two reasons: (1) The data-intensive NDP applications introduce large amounts of irregular memory accesses, which cause frequent translation lookaside buffer (TLB) misses, thus leading to many page table walks (PTWs). (2) The area and power constraints in NDP limit the cache size and levels in NDP systems, making it hard to effectively cache the recently used page table entries (PTEs). Our goal in this work is to design an efficient address translation mechanism for NDP systems by adapting conventional page table design to the characteristics of NDP workloads. We aim to develop a practical technique that: (1) is highly efficient in both single-core and multi-core NDP systems, (2) remains transparent to NDP applications, and (3) requires only modest or no hardware modifications and ISA changes. To this end, we present NDPage, a new, highly efficient, software-transparent address translation mechanism tailored for NDP systems. Our two key observations behind NDPage are: (1) The memory access pattern of PTEs, referred to as metadata throughout this paper, in NDP systems is highly irregular. This irregularity prevents metadata accesses from benefiting from the cache and significantly pollutes the cache, which negatively impacts the performance of normal data accesses. (2) The flexibility of the 4-level radix page table is unnecessary in NDP systems, as the last two levels of page tables are often fully occupied. Based on our observations, we devise two key mechanisms in NDPage: (1) An L1 cache bypass mechanism for metadata that makes PTEs not cacheable in NDP’s L1 cache system, accelerating the memory access of PTEs and preventing them from polluting normal data in the cache system. (2) A flattened L2/L1 page table design that merges the last two levels of the page table in NDP systems to reduce the sequential page table accesses during address translation. We evaluate NDPage with Victima, an extended version of the Sniper simulator [ 7 , 8 ] used by prior works [ 22 , 21 ] , using 11 data-intensive applications from five diverse benchmark suites. Our evaluation yields 2 key results that demonstrate NDPage’s effectiveness. First , in single-core environments, NDPage improves performance by 34.4% on average over the baseline system using a four-level radix-tree-based page table, yielding 14.3% performance improvements compared with the second-best address translation mechanism. Second , in multi-core environments, NDPage improves performance by 42.6% (40.7%) on average over the 4-core (8-core) baseline system using a four-level radix-tree-based page table, yielding 9.8% (30.5%) performance improvements compared with the second-best address translation mechanism. This paper makes the following key contributions: • We investigate the problems of applying the conventional 4-level page table design for address translation in Near-Data Processing architectures. • We propose NDPage, an address translation mechanism specifically designed for NDP architectures, based on our two observations in address translation within NDP systems. • We evaluate NDPage using a diverse set of data-intensive applications and demonstrate its effectiveness in both single-core and multi-core environments. II Background II-A Near-Data Processing Architecture Fig. 1: Overview of NDP architecture. Near-data processing is a promising technique to alleviate the memory wall in data-intensive applications [ 26 , 15 ] . By placing the computing unit (referred to as an NDP core) near the main memory, NDP cores can access data with low latency and high throughput. Figure 1 shows a typical NDP architecture based on 3D-stacked memories like the Hybrid Memory Cube (HMC) [ 10 ] and HBM [ 19 , 20 ] . In this architecture, NDP cores are placed in the logic layer of the 3D-stacked memory. An NDP core typically has a shallow L1 cache due to two reasons: (1) a strictly limited power and area budget in the logic layer, and (2) the memory access in NDP applications usually exhibits low data locality, which cannot benefit from deep cache hierarchies [ 29 , 6 ] . Apart from that, to support virtual memory, an NDP core incorporates a memory management unit (MMU), which will be discussed