DeepRTL2: A Versatile Model for RTL-Related Tasks

Yi Liu, Hongji Zhang, Yunhao Zhou, Zhengyuan Shi, Changran Xu, Qiang Xu · 2025

Read DeepRTL2: A Versatile Model for RTL-Related Tasks by Yi Liu, Hongji Zhang, Yunhao Zhou, Zhengyuan Shi, Changran Xu, Qiang Xu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-15697.txt.

Introduction

Yi Liu and five co-authors built DeepRTL2 in twenty twenty-five, a language model family serving the register-transfer level where chips are designed. Language models had already helped write and explain RTL code. But the embedding-based chores of design work had been neglected. Those chores include searching code by description, checking behavioral equivalence, and predicting performance.

DeepRTL2 unifies generation and embedding tasks in one versatile model family. The authors present it as the first comprehensive model of its kind for electronic design automation. Across their evaluations it reached state-of-the-art results on every task tested, both the writing side and the retrieval-and-judgment side. A single model spanning the workflow could speed up how engineers draft, find, verify, and tune hardware descriptions.

Catalog record

CREATORYi Liu, Hongji Zhang, Yunhao Zhou, Zhengyuan Shi, Changran Xu, Qiang Xu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-15697

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DeepRTL2: A Versatile Model for RTL-Related Tasks Yi Liu, Hongji Zhang, Yunhao Zhou, Zhengyuan Shi, Changran Xu, Qiang Xu Abstract The integration of large language models (LLMs) into electronic design automation (EDA) has significantly advanced the field, offering transformative benefits, particularly in register transfer level (RTL) code generation and understanding. While previous studies have demonstrated the efficacy of fine-tuning LLMs for these generation-based tasks, embedding-based tasks, which are equally critical to EDA workflows, have been largely overlooked. These tasks, including natural language code search, RTL code functionality equivalence checking, and performance prediction, are essential for accelerating and optimizing the hardware design process. To address this gap, we present DeepRTL2 , a family of versatile LLMs that unifies both generation- and embedding-based tasks related to RTL. By simultaneously tackling a broad range of tasks, DeepRTL2 represents the first model to provide a comprehensive solution to the diverse challenges in EDA. Through extensive experiments, we show that DeepRTL2 achieves state-of-the-art performance across all evaluated tasks. 1 Introduction The rapid advancement of large language models (LLMs) has had a profound impact on various domains ( Singhal et al. 2023 ; Bran and Schwaller 2024 ) , including electronic design automation (EDA). Recently, LLMs have shown remarkable potential in automating and enhancing tasks related to the generation and understanding of register transfer level (RTL) code ( Liu et al. 2024 ; Zehua et al. 2024 ; Zhao et al. 2024 ; Liu et al. 2025 ) . These models are capable of generating RTL code from high-level natural language instructions or summarizing the functionality of existing RTL code, thereby substantially improving the efficiency of hardware design workflows. While the application of LLMs to these generation-based tasks has yielded impressive results, their full potential at the RTL stage remains underexplored, particularly in embedding-based tasks that are equally crucial to the design process. Embedding-based tasks like natural language code search, RTL code functionality equivalence checking, and performance prediction are vital for accelerating and optimizing the hardware design process. Natural language code search allows designers to quickly query large RTL codebases with simple natural language descriptions, enabling efficient identification and reuse of relevant modules, thus reducing search time. Moreover, verification and optimization are two key time-consuming bottlenecks in hardware design. RTL code functionality equivalence checking can significantly reduce the time spent on verification by quickly assessing whether two designs are functionally equivalent. Performance prediction tasks, such as power, performance, and area (PPA) estimation, enable early evaluation of RTL design efficiency. Accurate performance predictions can guide RTL code optimization, minimizing the need for time-intensive trial-and-error. Together, these tasks enhance code reuse, verify functionality, and provide early performance feedback, resulting in a more streamlined and efficient design workflow. Previous methods have attempted to apply machine learning solutions for hardware design verification ( Vasudevan et al. 2021 ) and performance prediction ( Fang et al. 2023 ) , but they are typically design-specific, lack generalizable representations for RTL designs, or do not operate directly at the RTL stage. Figure 1: The overview of DeepRTL2. It can handle both generation- and embedding-based tasks at the RTL stage. For generation-based tasks, it performs RTL code generation and understanding. For embedding-based tasks, it uses cosine similarity scores between the embeddings of RTL code and functional descriptions to assess their match, enabling natural language code search. Additionally, cosine similarity between RTL code embeddings and rewritten code embeddings is used for functionality equivalence checking. Furthermore, a prediction model, such as XGBoost, can be applied to predict area and delay metrics based on code embeddings. In this paper, we introduce DeepRTL2 , a family of versatile LLMs designed to address both generation- and embedding-based tasks related to RTL. By unifying these tasks in a single model, DeepRTL2 offers a comprehensive solution to the multifaceted challenges inherent in EDA. Unlike previous work, which has primarily focused on generation, DeepRTL2 is the first model to provide a unified framework for handling a broad range of critical EDA tasks, including code generation, understanding, natural language code search, functionality equivalence checking, and performance prediction. Figure 1 provides an overview of our model. To achieve this, we have carefully curated a comprehensive dataset and developed new benchmarks for each task, with a particular focus on the embedding-based tasks, for which no existing datasets or benchmarks are available. We have adopted state-of-the-art decoder-only models, such as Llama-3.1 ( Dubey et al. 2024 ) and DeepSeek-Coder ( Guo et al. 2024 ) , as our base models for fine-tuning, given their superior performance over other architectures in the open-source LLM space. To enable these models to handle both generation- and embedding-based tasks, we adapt the generative representational instruction tuning (GRIT) approach ( Muennighoff et al. 2025 ) for fine-tuning, ensuring that DeepRTL2 can effectively manage the diverse tasks at the RTL stage. Through extensive experimentation, we demonstrate that the DeepRTL2 series achieves state-of-the-art performance across all evaluated tasks. 2 Related Works 2.1 Register Transfer Level in EDA Register transfer level (RTL) is a key abstraction in EDA that describes the flow of data between registers and the operations performed on this data. It is typically expressed using hardware description languages (HDLs), with Verilog being the most widely used HDL in the industry. Thus, throughout this paper, we use the terms RTL code and Verilog code interchangeably. In modern hardware design, engineers usually begin with specifications in natural language, which are then manually translated into HDLs before synthesizing the circuit elements ( Blocklove et al. 2023 ) . RTL serves as an intermediary between high-level design specifications and low-level implementation details, enabling designers to describe intricate digital systems while retaining flexibility for synthesis into gate-level representations. Within EDA workflows, RTL plays a crucial role in various phases, including functional verification, performance estimation, synthesis, and optimization. Efficient handling of RTL code is essential for minimizing design time, improving performance, and ensuring correctness. 2.2 LLMs for RTL With the rapid development of artificial intelligence (AI), there has been increasing interest in leveraging these technologies to automate and enhance RTL-based design workflows ( Chen et al. 2024 ) . A key area of focus has been the use of LLMs for RTL code generation and understanding, which has shown great promise in improving hardware design efficiency ( Thakur et al. 2023 ; Liu et al. 2023 ; Lu et al. 2024 ) . Recent works have fine-tuned open-source LLMs to generate high-quality RTL code from natural language descriptions ( Chang et al. 2024 ; Liu et al. 2024 ; Thakur et al. 2024 ; Zehua et al. 2024 ; Zhang et al. 2024 ; Cui et al. 2024 ; Zhao et al. 2024 ) , achieving significant improvements in the automation of hardware design process. Additionally, models like DeepRTL ( Liu et al. 2025 ) have extended these capabilities by introducing RTL code understanding tasks, i.e. , summarizing the functionality of existing code, which facilitates collaboration and comprehension among hardware designers. Despite the great success achieved in these generation-based tasks, prior research has largely overlooked embedding-based tasks, which are equally critical for addressing challenges in EDA. Embedding-based tasks, such as natural language code search, RTL code functionality equivalence checking, and performance prediction, are essential for improving the

Read the complete text