HYPERHEURIST: A Simulated Annealing-Based Control Framework for LLM-Driven Code Generation in Optimized Hardware Design
Shiva Ahir, Prajna Bhat, Alex Doboli · 2026
Read HYPERHEURIST: A Simulated Annealing-Based Control Framework for LLM-Driven Code Generation in Optimized Hardware Design by Shiva Ahir, Prajna Bhat, Alex Doboli (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-15642.txt.
Introduction
Ahir, Bhat, and Doboli propose HYPERHEURIST, a simulated-annealing control scheme that treats LLM-generated RTL hardware as candidates rather than final designs. Candidates pass compile checks, structural checks, and simulation before power-performance-area tuning, which applies only to verified designs. Across eight RTL benchmarks, the staged approach yields steadier, more repeatable tuning than single-pass LLM generation.
Catalog record
| CREATOR | Shiva Ahir, Prajna Bhat, Alex Doboli |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39069 |
| LICENSE | http://creativecommons.org/publicdomain/zero/1.0/ |
| RIGHTS | CC0 |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.15642
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
HYPERHEURIST: A Simulated Annealing-Based Control Framework for LLM-Driven Code Generation in Optimized Hardware Design Shiva Ahir, Prajna Bhat, Alex Doboli Abstract Large Language Models (LLMs) have shown promising progress for generating Register Transfer Level (RTL) hardware designs, largely because they can rapidly propose alternative architectural realizations. However, single-shot LLM generation struggles to consistently produce designs that are both functionally correct and power-efficient. This paper proposes HYPERHEURIST, a simulated-annealing–based control framework that treats LLM-generated RTL as intermediate candidates rather than final designs. The suggested system not only focuses on functionality correctness but also on Power-Performance-Area (PPA) optimization. In the first phase, RTL candidates are filtered through compilation, structural checks, and simulation to identify functionally valid designs. PPA optimization is restricted to RTL designs that have already passed compilation and simulation. Evaluated across eight RTL benchmarks, this staged approach yields more stable and repeatable optimization behavior than single-pass LLM-generated RTL. I Introduction Optimization in hardware design has traditionally relied on fixed rules, manually tuned heuristics, and scripts from experienced verification engineers. As designs grow larger and constraints become tighter, these approaches increasingly struggle to scale because they require constant retuning and a lot of domain expertise. Recent work shows that LLMs can change this pattern by instead of hard coding heuristics, LLMs can generate and adapt them based on feedback from synthesis, simulation, and quality metrics [ 1 , 2 , 3 ] . Prior work [ 1 , 4 , 5 , 6 ] shows this idea across multiple stages of the design flow, which includes high-level synthesis, physical design, placement, buffering, and rewriting. LLMs move beyond simple suggestions and begin to guide search, balance exploration and refinement, and react to performance feedback, such as timing, area, and power. In spite of this progress, existing approaches arguably remain fragmented [ 2 , 5 , 6 , 11 ] . Most are limited to a single design stage and use custom prompting or agent structures that do not transfer well across problems. Feedback mechanisms also vary widely, and durability across designs, tools, and technology settings is still limited. This paper introduces HYPERHEURIST as a unifying framework to address these gaps. HYPERHEURIST generates SystemVerilog code for digital hardware by treating heuristic design itself as a learnable process and applies it to RTL hardware optimization. It combines parallel heuristic generation, refinement that is critique-driven, and Simulated Annealing [ 7 ] with a simpler targeted pipeline for focused optimization. A contextual mechanism selects the strategy that best fits the problem and feedback, moving toward a more general and adaptive model of heuristic-driven EDA. The paper has the following structure. Section II presents related work and motivation. Section III presents methodology, Section IV describes experimental setup, and Section V discusses results. Search-efficient Balanced High-QoR lower search cost cost–quality trade-off higher QoR, often specialized Fast exploration with lighter optimization overhead Moderate search cost with stronger solution quality More aggressive refinement for higher optimization quality HLS-BO-LLM LLM-guided BO for efficient search iDSE pruning reduces search space LLM-DSE Agents multi-agent improves exploration BUFFALO RL improves optimization quality Evo-Placement evolutionary search for high QoR ASPEN formal refinement establishes quality Lower search cost Higher QoR / specialization increasing refinement and optimization intensity Fig. 1: Categorization of representative LLM-based heuristic-generation frameworks into search-efficient, balanced, and high-QoR regimes. Each method is annotated by its core mechanism, showing how different approaches trade off search cost, generality, and optimization quality. TABLE I: Operational and Qualitative Comparison of Six LLM-Based Heuristic-Generation Frameworks Framework Design Stage Core Method Heuristic Target Search Cost Generality Strengths Limitations HLS-BO-LLM [1] HLS DSE LLM + Bayesian opt. Directive configs (pragmas) Low–Medium Tool-specific Strong QoR vs. random/grid; interpretable directives Dependent on surrogate quality and HLS API iDSE [2] HLS DSE LLM-guided pruning + seeding Seeds + filters for directives Low Moderate Large reduction in explored designs; convergent/divergent reasoning Requires tuned prompting and HLS feedback loops LLM-DSE Agents [3] HLS / accelerator params Multi-agent LLM search Parameter tree search policy Medium Cross-tool potential Flexible agent roles; good under budgeted evaluations Coordination overhead; complex to debug Evo-Placement [4] Global placement LLM-generated alg. variants Initialization + update rules Medium–High Node-specific Non-trivial HPWL improvements; discovers novel optimizers Training/evolution cost; integration with legacy placers ASPEN [5] RTL datapath LLM + e-graphs + formal checks Rewrite rules and extraction Medium Technology-aware Combines correctness guarantees with PPA gains E-graph infra and solver overhead; corpus-dependent BUFFALO [6] Buffer-tree / CTS LLM + GRPO RL Tree topology and sizing Low (inference-time) Industrial-scale Large timing improvements; orders-of-magnitude runtime gains Heavy offline training; task-specialized sequence model II Related Work and Motivation Recent research has explored LLMs as active components in optimization workflows across high-level synthesis (HLS), RTL generation, and physical design. Rather than serving as passive code generators, related work positions LLMs as heuristic generators that propose, refine, or adapt optimization strategies under tool feedback [ 1 , 2 , 3 ] . Figure 1 categorizes existing LLM-based hardware generation approaches into three regimes, namely search-efficient, balanced, and high-QoR, illustrating the trade-offs between optimization quality, search effort, and reliance on tool-driven feedback. Table I summarizes the characteristics of related work. The first category focuses on HLS-driven design space exploration, where heuristics operate over pragma or parameter spaces. Yao et al. [ 1 ] integrate an LLM into a Bayesian optimization loop to guide pragma selection. Li et al. [ 2 ] extend this idea in iDSE by using the LLM to prune directive spaces, seed promising configurations, and adapt exploration based on observed QoR trends. Wang et al. [ 3 ] propose a multi-agent framework in which router, specialist, and critique agents collaboratively traverse parameter trees, with the LLM steering refinement using synthesis feedback. This work showcases that LLMs can reason quite effectively over structured directive spaces when coupled with numerical evaluation signals. More recent efforts extend LLM-guided heuristics into RTL and physical design, where models generate structured optimization artifacts rather than simple parameter selections. LLMs synthesize program-level constructs such as placement update rules, rewrite sequences, or structural layouts, which are evaluated using synthesis, equivalence checking, and Power-Performance-Area (PPA) feedback. Results show that LLMs can interact meaningfully with downstream EDA tools when constrained to emit executable, tool-evaluable artifacts. However, prior frameworks also expose persistent limitations [ 5 , 6 , 8 ] . Many prior approaches couple functional correctness and QoR optimization within a single search loop, wasting effort on unstable designs. Others use weakly regulated exploration, leading to oscillation, premature convergence, and structural drift. In contrast, HYPERHEURIST introduces phase-decoupled correctness gating, stabilizing search by separating correctness discovery from PPA refinement. It models RTL implementations as explicit search states, leverages tool-in-the-loop feedback, and regulates exploration using Simulated Annealing with specialized generation, mutation, and critique roles. III The HYPERHEURIST Framework This paper proposes HYPERHEURIST , a two-phase heuristic generation framework for RTL code that prioritizes functional correctness before discovering power, performance, and area (PPA) optimization. The central design principle is that correctness and optimization impose fundamentally different search dynamics and should therefore be handled by distinct but coordinated adaptive strategies. By decoupling these objectives, HYPERHEURIST avoids expending expensive optimization effort on invalid designs while allowing aggressive exploration once correctness is established. III-A Framework Architecture Figure 2 illustrates the conceptual architecture of the proposed HYPERHEURIST