dae4hls : Exposing Memory-Level Parallelism for High-Level Synthesis using Explicit Decoupling CCS: Hardware Hardware-software codesign CCS: Hardware Hardware description languages and compilation

David Metz, Magnus Själander · 2026

Read dae4hls : Exposing Memory-Level Parallelism for High-Level Synthesis using Explicit Decoupling CCS: Hardware Hardware-software codesign CCS: Hardware Hardware description languages and compilation by David Metz, Magnus Själander (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-23549.txt.

Introduction

Metz and Själander present DAE4HLS, a decoupled access-execute paradigm that exposes memory-level parallelism for high-level synthesis. Standard tools handle simple memory patterns well, such as sequential bursts or small scratchpad data, but complex patterns on large data sets miss out. Their model explicitly decouples requests from responses, unlocking parallelism compilers cannot auto-provide. Applied to the commercial AMD Vitis toolchain and to a dynamic framework for irregular workloads, explicit decoupling lifts speed by 10 to 79 times.

Catalog record

CREATORDavid Metz, Magnus Själander
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58196
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.23549

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

dae4hls : Exposing Memory-Level Parallelism for High-Level Synthesis using Explicit Decoupling CCS: Hardware Hardware-software codesign CCS: Hardware Hardware description languages and compilation David Metz, Magnus Själander Abstract . High-level synthesis (HLS) performs well for simple memory access patterns, such as for sequential accesses that can be turned into bursts, or for memory accesses into small datasets that can be stored in scratchpads. This limits HLS to accelerating only the low-hanging fruit, where memory-level parallelism is either trivially abundant, due to simple access patterns, or latency is low, due to the small dataset. Applications with more complex access patterns on large datasets would also benefit from acceleration, and would especially benefit from the reduction in design and verification effort that HLS promises. In this paper, we present dae4hls , a decoupled access-execute (DAE) paradigm for HLS. We propose a new programming model for explicitly decoupling requests and responses, which unlocks memory-level parallelism that otherwise cannot be automatically provided by a compiler. We apply the dae4hls paradigm to the commercial AMD Vitis HLS toolchain and show that the existing AXI stream and AXI burst interfaces can be repurposed for explicit decoupling. We further apply the paradigm to a dynamic-HLS framework, which is better suited for handling irregular workloads as compared to statically scheduled HLS. We show that support for explicit decoupling improves the performance and achieves a total speedup of 10-79 × \times . 1. Introduction Irregular memory accesses are common for many data structures, ranging from linked lists to hash tables, and are prevalent in a wide range of applications, such as graph processing and ray-tracing. Unfortunately, the memory wall ( 31 ) has made their access latency increasingly costly and difficult to optimize automatically. CPUs rely on costly speculation to expose memory-level parallelism (MLP) to hide the latency of irregular memory accesses, while being at an inherent disadvantage, in terms of efficiency, compared to dedicated accelerators due to their programmability ( 9 ) . Dedicated accelerators can be very efficient, but the complexity of designing and verifying them manually makes them prohibitively expensive for many workloads. High-level synthesis (HLS) promises to solve this, but memory optimizations in HLS tools focus on locality. Locality-based optimizations work well for regular access patterns, but irregular/random access workloads defeat caches and require large windows of requests to be reordered ( 2 ) . The key to accelerating applications with irregular memory accesses is to identify available memory-level parallelism and generate enough overlapping memory accesses to hide the access latency. A new class of memory subsystem optimizes for misses, coalescing, and reordering, rather than focusing on caching ( 2 ) , enabling accelerators to maintain numerous independent requests in flight. Compilers are increasingly powerful but generally operate at an abstraction level close to machine code, which is generated from a programming language with limited expressiveness of the programmer’s intent. They are required to make conservative assumptions to ensure program correctness. Compilers, and thus HLS tools, are, therefore, still not sufficiently powerful to extract enough MLP from irregular applications without help. At the same time, programming frameworks such as the Open Computing Language (OpenCL) ( 15 ) and CUDA ( 23 ) are designed for embarrassingly data-parallel memory access, and do not provide the expressiveness required for controlling individual streams of data dependencies required to extract MLP from irregular memory accesses efficiently. Manual exposure of hardware mechanisms has historically enabled performance breakthroughs that compilers could not achieve automatically. This is especially the case when communication and memory accesses are concerned, since they are less predictable than arithmetic instructions. Even in highly optimized application domains, compilers alone are insufficient. When the AI space had its DeepSeek moment, where a relatively unknown company managed to attain a state-of-the-art model with surprisingly few resources, this was in part enabled by directly using PTX intrinsics rather than fully relying on a higher-level compiler ( 13 ) . While there have been decades of research into auto-vectorization, many performance-critical use cases for SIMD still rely on hand-optimized assembly. Both of these examples demonstrate that exposing hardware features to expert programmers can unlock new acceleration avenues that can, potentially, be automated later. dae4hls provides a decoupled access-execute paradigm and framework for HLS that enables performance-optimization experts to express the orchestration of memory operations without having to create a detailed implementation and the necessary transformations to take the proposed programming interface into functional circuits ( Section 3 ). In dae4hls , the programmer identifies memory accesses that benefit from decoupling by leveraging domain knowledge. dae4hls can be used to precisely fetch demand data, e.g., suitable for removing false dependencies ( Section 4.1 ), or to initiate a large number of parallel memory accesses, e.g., suitable for pointer-chasing scenarios in data structures ( Section 4.2 ). The dae4hls framework leverages explicit decoupling to automatically instantiate request and response logic, enabling multiple requests to be issued and for the data to be consumed once a response is received from the memory subsystem. Thus, dae4hls provides the means to utilize the potential of memory subsystems that support a large number of outstanding requests, without requiring the functionality to be implemented in RTL. We examine four applications with irregular memory accesses to showcase the power of explicit decoupling using both repurposed burst constructs in the commercial AMD Vitis HLS ( 1 ) toolchain ( Section 5.2 ) and an optimized dynamic HLS framework ( Section 5.3 ). Our results show that dae4hls produces accelerators with significantly improved throughput (10 \times to 79 \times ) while reducing resource consumption ( Section 7 ). 2. Background In this section, we present prefetching, streaming, and decoupled access execute with their main benefits and drawbacks at a conceptual level, recent advancements in HLS and accelerator memory subsystems for massive memory-level parallelism (MLP), and dynamic HLS’s benefits over conventional HLS. (a) Prefetch (b) Stream (c) Decouple Figure 1 . Illustration showing the general principle behind (a) prefetching, (b) streaming, and (c) decoupling. 2.1. Decoupled Access Execute While decoupled access execute (DAE) ( 29 ) is related to prefetching, in that they both aim to improve MLP and timeliness, there are distinct differences. Prefetch requests are, in essence, requests without a consumer for the response, as illustrated in 1(a) . Instead, they are used to provide data to a future request at a closer point in the memory hierarchy, and thus become more timely. This means that prefetching can be speculative and does not need to be perfect to function correctly, even though that would be desirable for performance reasons. However, prefetching requires address calculations to be performed twice: first for the (pre) Fetch , and later for the request from Compute to the Local Cache , as shown in the figure. Since prefetching is speculative, it does not guarantee that data is kept in the cache or has been prefetched in the first place. This is indicated by the dotted set of connections from the Local Cache to the Memory System . Prefetching, by its nature, increases the total number of requests to the memory subsystem, requiring more cache accesses to be handled. Another related concept to DAE is streaming, in which data between computation stages is placed in a FIFO for

Read the complete text