Athena: Synergizing Data Prefetching and Off-Chip Prediction via Online Reinforcement Learning
*Rahul Bera 1 *Zhenrong Lang 1 Caroline Hengartner 1 Konstantinos Kanellopoulos 1 Rakesh Kumar 2 Mohammad Sadrosadati 1 Onur Mutlu 1 1 ETH Zürich 2 NTNU · 2026
Read Athena: Synergizing Data Prefetching and Off-Chip Prediction via Online Reinforcement Learning by *Rahul Bera 1 *Zhenrong Lang 1 Caroline Hengartner 1 Konstantinos Kanellopoulos 1 Rakesh Kumar 2 Mohammad Sadrosadati 1 Onur Mutlu 1 1 ETH Zürich 2 NTNU (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-17615.txt.
Introduction
Rahul Bera and co-authors present Athena, a system that joins two ways to hide memory delay. Prefetching loads data before it is needed. Off-chip prediction guesses if a load will miss the cache. Both fight the same delay from unlike angles. Athena synergizes them with online reinforcement learning. The learner adapts choices as the program runs.
A joint policy can beat each trick used alone. Online learning fits shifting program phases. Faster memory means faster chips at the same clock rate. The work targets high-performance processors. It comes from teams at ETH Zürich and NTNU. Their design treats latency as a control problem, learned live.
Catalog record
| CREATOR | *Rahul Bera 1 *Zhenrong Lang 1 Caroline Hengartner 1 Konstantinos Kanellopoulos 1 Rakesh Kumar 2 Mohammad Sadrosadati 1 Onur Mutlu 1 1 ETH Zürich 2 NTNU |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 92 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-17615
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Athena: Synergizing Data Prefetching and Off-Chip Prediction via Online Reinforcement Learning *Rahul Bera 1 *Zhenrong Lang 1 Caroline Hengartner 1 Konstantinos Kanellopoulos 1 Rakesh Kumar 2 Mohammad Sadrosadati 1 Onur Mutlu 1 1 ETH Zürich 2 NTNU Abstract Prefetching and off-chip prediction are two techniques proposed to hide long memory access latencies in high-performance processors. In this work, we demonstrate that: (1) prefetching and off-chip prediction often provide complementary performance benefits, yet (2) naively combining these two mechanisms often fails to realize their full performance potential, and (3) existing prefetcher control policies (both heuristic- and learning-based) leave significant room for performance improvement behind. Our goal is to design a holistic framework that can autonomously learn to coordinate an off-chip predictor with multiple prefetchers employed at various cache levels, delivering consistent performance benefits across a wide range of workloads and system configurations. To this end, we propose a new technique called Athena, which models the coordination between prefetchers and off-chip predictor (OCP) as a reinforcement learning (RL) problem. Athena acts as the RL agent that observes multiple system-level features (e.g., prefetcher/OCP accuracy, bandwidth usage) over an epoch of program execution, and uses them as state information to select a coordination action (i.e., enabling the prefetcher and/or OCP, and adjusting prefetcher aggressiveness). At the end of every epoch, Athena receives a numerical reward that measures the change in multiple system-level metrics (e.g., number of cycles taken to execute an epoch). Athena uses this reward to autonomously and continuously learn a policy to coordinate prefetchers with OCP. Athena makes a key observation that using performance improvement as the sole RL reward, as used in prior work, is unreliable, as it confounds the effects of the agent’s actions with inherent variations in workload behavior. To address this limitation, Athena introduces a composite reward framework that separates (1) system-level metrics directly influenced by Athena’s actions (e.g., last-level cache misses) from (2) metrics primarily driven by workload phase changes (e.g., number of mispredicted branches). This allows Athena to autonomously learn a coordination policy by isolating the true impact of its actions from inherent variations in workload behavior. Our extensive evaluation using a diverse set of 100 memory-intensive workloads shows that Athena consistently outperforms multiple prior state-of-the-art coordination policies across a wide range of system configurations with various combinations of underlying prefetchers at various cache levels, OCPs, and main memory bandwidths, while incurring only modest storage overhead and design complexity. The source code of Athena is freely available at https://github.com/CMU-SAFARI/Athena . † † footnotetext: *Rahul Bera and Zhenrong Lang are co-primary authors. 1 Introduction Data prefetching [ 58 , 29 , 8 , 59 , 90 , 76 , 166 , 100 , 163 , 54 , 96 , 155 , 143 , 117 , 98 , 16 , 154 , 18 , 137 , 14 , 30 , 57 , 89 , 183 , 162 , 184 , 9 , 77 , 188 , 187 , 185 , 31 , 33 , 53 , 71 , 12 , 37 , 95 , 27 , 35 , 112 , 207 , 182 , 92 , 146 , 91 , 204 , 42 , 36 , 161 , 150 , 168 , 68 , 122 , 28 , 206 , 167 , 61 , 139 , 145 , 149 ] and off-chip prediction [ 13 , 80 , 99 ] are two speculation techniques proposed to hide the long memory access latency in high-performance processors. A data prefetcher hides memory access latency by predicting full cacheline addresses of memory requests and fetching their corresponding data into on-chip caches before the program demands them. An off-chip predictor (OCP), on the other hand, predicts which memory requests would go off-chip and starts fetching their data directly from the main memory, thereby hiding the on-chip cache access latency from the critical path of off-chip memory requests. Key Observations. While prior works demonstrate performance benefits of combining OCP with data prefetchers [ 13 , 81 ] , we make three key observations that highlight significant room for further performance improvement in processors using both prefetchers and OCP. First, we show that prefetching and off-chip prediction often provide complementary performance benefits, especially in bandwidth-constrained processors, where a prefetcher often degrades performance due to its bandwidth overhead [ 166 , 138 , 47 , 48 , 49 , 14 , 20 , 102 , 103 ] , but an OCP improves performance due to its accurate predictions. Second, naively combining prefetching and off-chip prediction often fails to realize their full performance potential together. More specifically, in workloads where a prefetcher degrades performance, it often masks the performance gains that an off-chip predictor alone could otherwise deliver. Third, existing coordination techniques [ 63 , 48 , 81 ] either lack the flexibility in coordinating OCP in the presence of multiple prefetchers employed at various cache levels [ 81 ] , or leave substantial room for performance improvement behind [ 48 , 63 ] . Our goal in this work is to design a holistic framework that can autonomously coordinate off-chip prediction with multiple prefetching techniques employed at various levels of the cache hierarchy by taking multiple system-level features into account, thereby delivering consistent performance benefits, regardless of the underlying workload and system configuration. To this end, we propose a new technique called Athena , 1 1 1 Named after the Greek goddess of wisdom and strategic warfare [ 5 ] . which formulates the dynamic coordination between prefetchers and OCP as a reinforcement learning problem. Athena observes a set of system-level features (e.g., accuracy of prefetchers and OCP, main memory bandwidth usage, prefetcher-induced cache pollution, etc.) over an epoch of workload execution. At the end of an epoch, Athena uses the feature values as state information to take a coordination action (i.e., enabling the OCP and/or prefetcher, and adjusting prefetcher aggressiveness). Athena also receives a numerical reward at the end of every epoch, which measures the change in multiple system-level metrics (e.g., number of cycles taken to execute an epoch) to evaluate the impact of its actions on the system. Athena uses this reward to autonomously and continuously learn and update a prefetcher-OCP coordination policy, that can adapt to changing workloads and system configurations. Novelty and Benefits. While prior works have explored RL-based prefetcher control (e.g., [ 14 , 79 , 63 , 20 ] ), Athena is the first work that systematically studies the interactions between state-of-the-art prefetchers and OCP, and provides an effective RL-based coordination policy. Athena differs from prior works in three key ways. First, prior works use the change in instructions committed per cycle (IPC) per epoch as the only reward for their RL-based learning mechanisms [ 63 , 79 , 20 ] . We observe that evaluating the effectiveness of a prefetcher and/or an OCP solely by the IPC change can be unreliable due to the inherent IPC variations caused by changes in workload behavior. To mitigate this, Athena introduces a composite reward framework that explicitly separates (1) system-level metrics that are directly influenced by Athena’s actions (e.g., execution cycles, last-level cache misses) from (2) metrics that are primarily driven by the change in workload behavior (e.g., number of mispredicted