RocketPPA: Code-Level Power, Performance, and Area Prediction via LLM and Mixture of Experts
Armin Abdollahi, Mehdi Kamal, and Massoud Pedram · 2025
Read RocketPPA: Code-Level Power, Performance, and Area Prediction via LLM and Mixture of Experts by Armin Abdollahi, Mehdi Kamal, and Massoud Pedram (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-21971.txt.
Introduction
Armin Abdollahi, Mehdi Kamal, and Massoud Pedram present RocketPPA in a twenty twenty-five paper on chip design. Their tool reads hardware code and predicts power, speed, and chip area at once. It aims to give fast estimates long before a chip is built.
RocketPPA joins a large language model with a set of small expert networks. The model reads the code, and its last hidden layer feeds the power, speed, and area scores. A light training method keeps the cost low. The team also built a code repair tool to make a large set of clean training designs, then tested the system on a known code test set.
Catalog record
| CREATOR | Armin Abdollahi, Mehdi Kamal, and Massoud Pedram |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-21971
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
RocketPPA: Code-Level Power, Performance, and Area Prediction via LLM and Mixture of Experts Armin Abdollahi, Mehdi Kamal, and Massoud Pedram Abstract This paper presents RocketPPA, a novel ultra-fast power, performance (delay), and area (PPA) estimator operating directly at the code-level abstraction using HDL code as input. The key technical innovation is its LLM-based regression model, which uniquely integrates a large language model (LLM) with a mixture-of-experts (MoE) architecture composed of multilayer perceptrons (MLPs). The LLM interprets the input HDL code and then utilizes its final hidden-layer representations to predict PPA metrics. Low-rank adaptation (LoRA) is used for parameter-efficient fine-tuning to enable efficient LLM training. Furthermore, the work includes the development of an LLM-based HDL code repair framework to generate a large and synthesizable training dataset. Experimental results on the VerilogEval benchmark demonstrate that RocketPPA achieves significant improvements in the accuracy of PPA estimation compared to previous state-of-the-art methods like Llama3-MetRex-8B. Specifically, at a 10% relative error threshold, RocketPPA enhances the pass rate for area prediction by 13.6%, delay by 9.4%, and power by 14.7%. At a 20% threshold, the improvements are 9.6% for area, 10.8% for delay, and 18.5% for power. Moreover, RocketPPA achieves a speedup of over 20× compared to MetRex and 30× over MasterRTL in processing the test set. The impact of RocketPPA is the potential to substantially accelerate the hardware design process by providing accurate PPA estimations early in the design cycle, thus avoiding the overhead of manual feature engineering and time-consuming synthesis flows. I Introduction PPA estimators are at the heart of modern VLSI design, as they critically influence the functionality and efficiency of hardware implementations [ 1 ] . In conventional electronic design automation (EDA), high-level approaches to PPA estimation typically involve abstract modeling techniques, simulation-based analyses, and synthesis optimizations that produce approximate metrics [ 2 ] . Although these traditional methods provide a helpful baseline, they often fail to capture nuanced interactions in increasingly complex circuits [ 3 ] . Their limitations include significant computational overhead, the reliance on manual calibration, and a lack of granularity that can impede the ability to fine-tune designs for optimal power, delay, and area performance [ 4 ] . These inherent limitations in traditional PPA estimation methods have started the exploration of alternative approaches that promise to capture the complexities of modern VLSI design more effectively. In this context, large language models (LLMs) have recently demonstrated considerable potential in automating hardware design workflows, particularly for Verilog code generation and analysis. Starting with solutions such as BetterV [ 5 ] and ChipNeMo [ 6 ] , researchers have shown that domain-specific fine-tuning can allow LLMs to generate high-quality Verilog modules that meet syntactic and even partial functional requirements. Building on these early results, multi-expert modeling paradigms like [ 7 ] and hierarchical or specialized data-curation pipelines like [ 8 , 9 ] have significantly expanded LLM performance, making it possible to target more complex scenarios in electronic design automation. Meanwhile, others have broadened the scope to include Verilog understanding [ 10 ] , hallucination mitigation [ 11 ] , hierarchical frameworks [ 12 ] , and open-source linting [ 13 ] . These advancements underscore the dramatic shift in chip design and verification by LLMs, creating a new research trajectory where code generation, debugging, and performance tuning converge. In this work, we propose an LLM-based regression model for estimating the design metrics of a given HDL Verilog code. The model accelerates the hardware design process by directly predicting PPA metrics at the code level. Our approach utilizes an LLM to analyze and understand the input HDL code, generating a latent representation based on its final hidden layer results. This representation is shared across separate MoE MLPs, each dedicated to predicting a specific design metric. We employ a normalization strategy to address the large dynamic range of metric values that improves the accuracy of the model prediction. To improve training efficiency and allow flexibility in using different foundation models, we apply LoRA to fine-tune the LLM. For training the proposed LLM-based PPA estimator, we generate a large set of syntactically correct and synthesizable HDL designs and train the model on them. Additionally, we evaluate its efficiency by comparing its estimations with those of two state-of-the-art (SOTA) code-level PPA estimators. Based on the above explanations, we can summarize the contributions of this work as follows. • Introducing an end-to-end LLM-based neural architecture that directly translates Verilog code into power, delay, and area metrics without additional processing steps. • Integrating a mixture-of-experts extension to the model’s regression part, enhancing the design parameters’ prediction. • Proposing a normalizing approach to improve the accuracy of the model. This paper is organized as follows. Section II reviews some previous work. The details of the proposed LLM-based PPA estimator are discussed in Section III. Section IV evaluates the efficacy of the RocketPPA compared to earlier works. Finally, the paper is concluded in Section V. II Related Work In this section, we review prior work on the use of LLMs in hardware design. Early efforts to harness LLMs to generate valid Verilog modules include BetterV [ 5 ] , which introduced discriminative guidance, and ChipNeMo [ 6 ] , which pioneered domain-adaptive tokenization and pre-training. Following these, multi-expert architectures [ 7 ] and hallucination-mitigation strategies [ 11 ] extended generation accuracy by focusing on syntactic correctness and domain alignment. Other works have explored hierarchical decomposition [ 12 ] , prompting frameworks [ 14 ] , and multi-agent ecosystems [ 15 ] to enhance code quality. Another crucial direction involves cleaning up and augmenting Verilog datasets for improved model training. For example, CRAFTRTL [ 8 ] introduced correct-by-construction non-textual data for code generation models, while OriGen [ 9 ] leveraged code-to-code augmentation and self-reflection to refine Verilog sets further. These studies have significantly reduced minor syntax errors by synthesizing large volumes of high-fidelity data, enabling more robust fine-tuning. Beyond raw generation, researchers have begun to quantify how well LLMs understand Verilog semantics. DeepRTL [ 10 ] presents a unified representation model that supports both generation and comprehension, and LintLLM [ 13 ] proposes a pipeline for automated defect detection. For more targeted benchmarks, RTLLM [ 16 ] and VerilogEval [ 17 ] offer tasks and datasets to measure functional correctness. In contrast, MetRex [ 18 ] specifically addressed the post-synthesis metrics (area, delay, power). MetRex [ 18 ] provides a large and automatically cleaned corpus of synthesized Verilog designs paired with post‑synthesis area, delay, and static power reports. A chain‑of‑thought template guides LLMs through gate counts and critical path reasoning, and supervised LoRA fine‑tuning on this dataset demonstrates that metric estimation can be performed directly from HDL text without feature extraction. This ongoing shift toward PPA-aware generation is underscored by advanced frameworks such as [ 19 , 20 ] , which leverage multi-stage prompts and search strategies to generate code meeting power or timing goals. As these models become fully integrated into the chip design workflow, researchers have also looked at watermarking [ 21 ] and IP protection. Frameworks like [ 22 ] highlight security and trust concerns with LLM-based EDA, advocating stronger safeguards against malicious or unauthorized code usage. Meanwhile, solutions like OPL4GPT [ 23 ] explore