A Case for Kolmogorov-Arnold Networks in Prefetching: Towards Low-Latency, Generalizable ML-Based Prefetchers
Dhruv Kulkarni 1, Bharat Bhammar 1, Henil Thaker 1, Pranav Dhobi 1 · 2025
Read A Case for Kolmogorov-Arnold Networks in Prefetching: Towards Low-Latency, Generalizable ML-Based Prefetchers by Dhruv Kulkarni 1, Bharat Bhammar 1, Henil Thaker 1, Pranav Dhobi 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-09074.txt.
Introduction
Computers waste time waiting for slow memory, so they guess which data will be needed next and fetch it early, a trick called prefetching. Dhruv Kulkarni and co-authors test a new kind of neural network, built from learnable curve pieces, as the guessing engine in this 2025 paper.
Their prefetcher predicts the gap between successive memory addresses rather than copying address patterns. Early tests show it answers far faster than rival learning-based prefetchers, with modest speed gains for the processor. The catch is weak tracking of long patterns, so the authors suggest hybrid designs that pair this speed with stronger sequence models, aimed at edge devices.
Catalog record
| CREATOR | Dhruv Kulkarni 1, Bharat Bhammar 1, Henil Thaker 1, Pranav Dhobi 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 18 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-09074
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Case for Kolmogorov-Arnold Networks in Prefetching: Towards Low-Latency, Generalizable ML-Based Prefetchers Thanks: 1 The authors are affiliated with the CSE Department at the Sardar Vallabhbhai National Institute of Technology, Surat, Gujarat, India. E-mail: {u21cs036, u21cs065, u21cs039, u21cs050, rpg}@coed.svnit.ac.in. Thanks: 2 Dr. Sai Manoj Pudukotai Dinkarrao is affiliated with Department of Electrical and Computer Engineering, George Mason University, Fairfax, VA 22030, USA. E-mail: [email protected]. Dhruv Kulkarni 1, Bharat Bhammar 1, Henil Thaker 1, Pranav Dhobi 1 Abstract The memory wall problem arises due to the disparity between fast processors and slower memory, causing significant delays in data access, even more so on edge devices. Data prefetching is a key strategy to address this, with traditional methods evolving to incorporate Machine Learning (ML) for improved accuracy. Modern prefetchers must balance high accuracy with low latency to further practicality. We explore the applicability of utilizing Kolmogorov-Arnold Networks (KAN) with learnable activation functions,a prefetcher we implemented called KANBoost, to further this aim. KANs are a novel, state-of-the-art model that work on breaking down continuous, bounded multi-variate functions into functions of their constituent variables, and use these constitutent functions as activations on each individual neuron. KANBoost predicts the next memory access by modeling deltas between consecutive addresses, offering a balance of accuracy and efficiency to mitigate the memory wall problem with minimal overhead, instead of relying on address-correlation prefetching. Initial results indicate that KAN-based prefetching reduces inference latency (18× lower than state-of-the-art ML prefetchers) while achieving moderate IPC improvements (2.5% over no-prefetching). While KANs still face challenges in capturing long-term dependencies, we propose that future research should explore hybrid models that combine KAN efficiency with stronger sequence modeling techniques, paving the way for practical ML-based prefetching in edge devices and beyond. I Introduction Advancements in the computing systems and the need to execute data-intensive applications such as machine learning, and high-performance computing demand rapid and efficient access to large volumes of data at disposal. However, due to inherent traits of the DRAM and the interconnections, the gap between memory access latency and processor speed has become a critical bottleneck. To address this, multiple techniques have been proposed in the literature [ 1 ] . Among these techniques, prefetching [ 2 ] plays a pivotal role in mitigating this issue by predicting and fetching data before it is requested, thereby reducing memory access latency and improving overall system performance. By leveraging advanced prefetching strategies—ranging from hardware-based approaches to machine learning-driven models—modern architectures can enhance data locality, minimize cache misses, and optimize resource utilization, ultimately accelerating computation and improving efficiency in data-driven workloads. Multiple prefetching strategies for designing a prefetcher have been proposed in the literature to enhance the performance and minimize the overheads. The best offset [ 3 ] prefetcher introduces a sophisticated mechanism that utilizes a priority queue to analyze and interpret different offsets—the magnitude of differences between successive memory accesses. By identifying patterns within these offsets, it predicts the most likely subsequent memory block to be accessed. In addition to heuristics-based prefetchers, machine learning-based prefetchers are as well introduced in the recent times. The Drishyam prefetcher [ 4 ] employs an innovative approach by transforming historical memory block access patterns into image-like representations. Leveraging computer vision models, it classifies these representations to predict the subsequent memory block. Another notable advancement, TransforMAP [ 5 ] , utilizes the Transformer model, renowned for its success in natural language processing and sequence prediction tasks, to forecast the next memory block access. By restricting its predictions to the same memory page, TransforMAP ensures both accuracy and computational efficiency. The state-of-the-art prefetcher designs inherits some of the challenges in the existing works and ML techniques: 1) The inability to understand complex patterns governing memory accesses 2) Lack of generalization ability of ML models underlying these prefetchers. 3) High inference time, making ML-based prefetchers impractical. To address the high inference time/prediction time, we pursue a delta/stride based prefetching strategy, which involves predicting the delta or absolute memory difference between the present and next address, making the predictors less complex and faster. To address the issues of understanding complex patterns, we explore a state-of-the-art model, very recently proposed in [ 6 ] In this work, we explore an offset-prefetching strategy, which predicts the next offset based on the history of block accesses, using Kolmogorov-Arnold Networks (KANs) [ 6 ] , a state-of-the-art learning model, based on the Kolmogorov-Arnold representation, which demonstrates that any bounded, continuous multivariate function can be represented as the summation of the functions of its constituent variables. Our preliminary experimental analysis showcases a 18\times improvement in prefetching time compared to state-of-the art prefetchers, such as [ 7 ] , with up to 2.5% improvement in IPC on some of the GAP and SPEC benchmarks compared to a no-prefetching scenario. Our novel contributions can be outlined in a two-fold manner: • To our knowledge, this is the first work to explore Kolmogorov-arnold Networks and employ learnable activation functions for prefetching in computer architecture. • This work also introduces a simplified prefetching pipeline. The prefetcher prediction is made lightweight thereby enables predicting the relative address (delta) within the same page, as opposed to generality, in order to make the prefetching feasible. II Proposed KANBoost Fig. 1: Prefetching architecture In this Section, we discuss the details of the KAN-based prefetcher design. The architecture of the proposed prefetcher is illustrated in Figure 1 . In contrast to correlation-based prefetchers, this work considers delta-based prefetcher due to its reduced latency in predicting the next address access. Figure 1 represents the prefetching architecture. We predict the future memory accesses for the last-level cache (LLC), down the cache hierarchy as demonstrated in Figure 1 . Prefetching is not performed on L1 Cache and L2 Cache. We collect previous accesses under the same page in the global history buffer and use the KAN predicting module (made up of a KAN model) predict the next block access under the same page. After concatenating the block address with the page address to form the complete address, the prefetching module prefetches the address to the LLC. To reduce the sample space for offset prediction, we restrict the prefetcher to predicting offsets within a page for different block accesses. This reduces inference time and additional complexity, in finding block accesses within other pages. II-A Kolmogorov-Arnold Networks KAN [ 6 ] is a type of neural network, based on the Kolmogorov-Arnold theorem, which states that any multivariable function can be represented as a finite composition of single-variable functions. This theorem allows KAN to decompose complex relationships into simpler sub-problems, thus enhancing accuracy and efficiency in predictions. The mathematical expression of KAN [ 6 ] is given by: f(x_{1},x_{2},\ldots,x_{n})=\sum_{i=1}^{2n+1}\phi_{i}\left(\sum_{j=1}^{n}\psi_{ij}(x_{j})\right) (1) f(x_{1},x_{2},\ldots,x_{n}) is the target function that maps the input variables x_{1},x_{2},\dots,x_{n} to the output. n represents the number of input variables. \phi_{i}(\cdot) are learnable activation functions applied to the intermediate summations. \psi_{ij}(x_{j}) represents transformation functions applied to each input variable x_{j} , decomposing the multivariate function. In the context of memory prefetching, KAN ’s ability to model intricate relationships between memory accesses makes it a promising candidate for addressing the challenges posed by the memory wall. By capturing the intricacies of memory behavior, KAN -based prefetchers like KANBoost can dynamically adjust