AI-Driven Optimization of Hardware Overlay Configurations
Rasha Karakchi · 2025
Read AI-Driven Optimization of Hardware Overlay Configurations by Rasha Karakchi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-06351.txt.
Introduction
Rasha Karakchi presents an AI method for designing chip overlays in a solo 2025 paper. The chips, called FPGAs, can be reshaped for new tasks, and an overlay gives them a fixed working layer. Finding a good overlay shape takes many slow trial builds, each checked on real hardware.
Karakchi trains a forest of decision trees on past design data to predict whether a new shape will work and how much chip resource it will use. The model forecasts logic use, memory use, and wiring spread before any build is run. In tests on an automata processor design, the forecasts matched real usage closely. The method cuts wasted builds and speeds design, which matters for teams that adapt chips to tasks such as text and pattern matching.
Catalog record
| CREATOR | Rasha Karakchi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 11 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-06351
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AI-Driven Optimization of Hardware Overlay Configurations Rasha Karakchi Abstract Designing and optimizing FPGA overlays is a complex and time-consuming process, often requiring multiple trial-and-error iterations to determine a suitable configuration. This paper presents an AI-driven approach to optimizing FPGA overlay configurations, specifically focusing on the NAPOLY+ automata processor implemented on the ZCU104 FPGA. By leveraging machine learning techniques, particularly Random Forest regression, we predict the feasibility and efficiency of different configurations before hardware compilation. Our method significantly reduces the number of required iterations by estimating resource utilization, including logical elements, distributed memory, and fanout, based on historical design data. Experimental results demonstrate that our model achieves high prediction accuracy, closely matching actual resource usage while accelerating the design process. This approach has the potential to generalize across different FPGA architectures, offering a more efficient workflow for hardware designers. 1 Introduction Designing complex systems on Field Programmable Gate Arrays (FPGAs) often presents significant challenges, particularly when using traditional FPGA CAD tools such as Quartus and Xilinx Vivado. One of the most time-consuming aspects of FPGA design is the process of building and compiling the design. This challenge becomes even more pronounced when working with overlays, where the goal is to test whether the hardware resources consumed by the overlay configuration will fit the available FPGA architecture. In these cases, designers are often left to rely on a trial-and-error process, running multiple configurations until they find a solution that works. One particularly challenging scenario arises when working with specialized FPGA overlays, such as the NAPOLY+ automata processor [ 1 , 2 , 3 , 4 ] . The success of an overlay design depends heavily on the logical features of the dataset, including the number of states and edges in the automata. Each state typically corresponds to a processor element (PE), while each edge corresponds to a wire or hardware interconnect. Theoretically, the number of states and edges should match the number of processor elements and wires, respectively. However, due to factors such as wire congestion and routing limitations, the design may fail to fit, even if these numbers initially appear to align. In such cases, the designer must adjust the configuration by changing the number of processor elements or interconnections, which may involve extensive experimentation. This trial-and-error approach can result in wasted time, as the designer waits for each configuration to be compiled and tested, only to find that it does not fit the target FPGA architecture. In other instances, while a configuration may fit, the utilization of hardware resources might be low enough that a higher-capacity configuration could have been tested instead, leading to further inefficiency. The question then arises: How can we reduce the time wasted on these iterative configurations? Traditional methods of designing FPGA overlays are slow, and each compilation cycle can take hours or even days. However, with the integration of artificial intelligence (AI) and machine learning (ML) techniques, there is a promising path forward. Harnessing AI for FPGA Design Optimization: AI has revolutionized numerous fields by providing solutions to problems that once seemed insurmountable due to their complexity or time-consuming nature [ 5 , 6 ] . In the context of FPGA design, machine learning algorithms, such as the random forest regression, are emerging as powerful tools to predict the likelihood of a given configuration fitting in the FPGA overlay [ 7 ] . By training a regressor model on historical design data, we can enable the system to predict which configurations are most likely to succeed before the compilation process even begins [ 8 ] . For example, in the case of the NAPOLY+ overlay design, the AI model would analyze the number of states and edges in the automata, along with other design parameters, to predict whether the configuration will fit the FPGA hardware. This can dramatically reduce the number of trial configurations that need to be tested manually, saving designers days or even weeks of time spent on tedious trials. Although the current approach targets a specific overlay (NAPOLY+) and a specific FPGA board (ZCU104), this limitation does not diminish its potential. In fact, this narrow focus allows us to refine and optimize the model for more accurate predictions. The real advantage of this AI-based approach lies in its ability to provide predictions in advance, allowing designers to make informed decisions before committing to lengthy compilation cycles [ 9 , 10 , 11 , 2 , 12 , 13 ] . This work represents just the beginning of what could become a more standardized approach to optimizing FPGA design processes across a range of overlays and FPGA boards. Although the current model is tailored to a specific overlay and FPGA board combination, the ultimate goal is to expand this framework to accommodate a larger variety of FPGA configurations, making AI-driven optimization a tool accessible to all FPGA designers. By leveraging the power of machine learning, we can create more generalizable solutions that will streamline the design process for a wide array of applications. 2 Targeted Design The NAPOLY+ design is a two-dimensional array of specialized STE+ elements, each integrating symbol processing, scoring (weighting) and arithmetic components. These elements accumulate scores along computational paths to determine the final results. The array layout resembles the structure of Configurable Logic Blocks in FPGAs. Each STE+ process activated signals from multiple predecessors. Unless the ”start” bit is set, its state bit resets. When activated, an STE+ transmits an activation signal to its outputs, which is ANDed with an interconnect configuration bit before verifying successors and continuing the process. Beyond logic activation, STE+ also computes an outgoing score. This score is determined by the incoming score from its predecessor and an edge score, a predefined value stored in a register and configured during reconfiguration. To handle mismatches and gaps, all STE+ elements are connected to the start STE+, though this setup is constrained by array size, fan-out limits, and hardware resources. The interconnection system consists of a grid of global and local wires, with horizontal wires restricted by FPGA bus size (1 million wires) and vertical wires managing local fan-out connections. During operation, the start STE+ remains active, enabling parallel symbol processing and allowing multiple STE+ elements to function simultaneously. To distinguish between new symbols and mismatching inputs, incoming scores are reset to zero for each new symbol, signaling the start of a new path. A dedicated fan-in signal is assigned to new symbols. Accepting STE+ elements confirm matches and report scores upon activation but do not connect to the start state. In previous work, the performance of NAPOLY+ was evaluated on two Zynq UltraScale+ MPSoC FPGA devices, which are optimized for high-performance applications such as ZCU104 which features approxiately 504K Logical Cells (LCs), 461K Flip-Flops (FFs), and 6.2 Mb of distributed memory. 3 Evaluation In the context of NAPOLY+ performance prediction, we used the Random Forest Aggressor to estimate the performance efficiency based on different array sizes taken from previous work. This model learns from existing FPGA performance data and generates predictions for new array sizes by analyizing patterns and trends in resource utilization and computational efficiency. For training, the model is trained using performance data from ZCU104 NAPOLY+ [ 1 , 3 ] which includes array