UCAgent: An End-to-End Agent for Block-Level Functional Verification

Junyue Wang, Zhicheng Yao, Yan Pi, Xiaolong Li, Fangyuan Song, Jinru Wang, Yunlong Xie, Sa Wang, Yungang Bao · 2026

Read UCAgent: An End-to-End Agent for Block-Level Functional Verification by Junyue Wang, Zhicheng Yao, Yan Pi, Xiaolong Li, Fangyuan Song, Jinru Wang, Yunlong Xie, Sa Wang, Yungang Bao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25768.txt.

Introduction

Wang and co-authors present UCAgent, an agent that automates chip block verification from start to finish. Verification eats about seventy percent of many chip project schedules. UCAgent avoids asking the model to write fragile SystemVerilog code. It builds a pure Python test setting with the Picker and Toffee tools instead. A configurable workflow of 31 stages guides the model, and each stage has an automatic checker. A labeling scheme tracks specs, coverage, and tests for consistency. The authors report up to 98.5 percent code coverage on real modules.

Catalog record

CREATORJunyue Wang, Zhicheng Yao, Yan Pi, Xiaolong Li, Fangyuan Song, Jinru Wang, Yunlong Xie, Sa Wang, Yungang Bao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40872
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.25768

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

UCAgent: An End-to-End Agent for Block-Level Functional Verification Junyue Wang, Zhicheng Yao, Yan Pi, Xiaolong Li, Fangyuan Song, Jinru Wang, Yunlong Xie, Sa Wang, Yungang Bao Abstract Functional verification remains a critical bottleneck in modern IC development cycles, accounting for approximately 70% of total development time in many projects. However, traditional methods, including constrained-random and formal verification, struggle to keep pace with the growing complexity of modern semiconductor designs. While recent advances in Large Language Models (LLMs) have shown promise in code generation and task automation, significant challenges hinder the realization of end-to-end functional verification automation. These challenges include (i) limited accuracy in generating Verilog/SystemVerilog verification code, (ii) the fragility of LLMs when executing complex, multi-step verification workflows, and (iii) the difficulty of maintaining verification consistency across specifications, coverage models, and test cases throughout the workflow. To address these challenges, we propose UCAgent, an end-to-end agent that automates hardware block-level functional verification based on three core mechanisms. First, we establish a pure Python verification environment using Picker and Toffee to avoid relying on LLM-generated SystemVerilog verification code. Second, we introduce a configurable 31-stage fine-grained verification workflow to guide the LLM, where each stage is verified by an automated checker. Furthermore, we propose a Verification Consistency Labeling Mechanism (VCLM) that assigns hierarchical labels to LLM-generated artifacts, improving the reliability and traceability of verification. Experimental results show that UCAgent can complete end-to-end automated verification on multiple modules, including the UART, FPU, and integer divider modules, achieving up to 98.5% code coverage and up to 100% functional coverage. UCAgent also discovers previously unidentified design defects in realistic designs, demonstrating its practical potential. 1 Introduction Functional verification is the critical process of ensuring that a hardware design’s implementation correctly realizes its intended specification, making it the most resource-intensive phase of the IC design [ 24 ] . As hardware designs grow exponentially in complexity, however, verification has become a server bottleneck in terms of time, labor, and reliability. Industry studies indicate that verification now consumes over 70% of the total IC project timeline [ 26 ] . Consequently, the demand for verification engineers significantly outpaces that for design engineers, while designers themselves must spend nearly half of their work time to assist with verification [ 10 ] . Yet, these massive investments fail to guarantee reliable outcomes. In 2024, only 14% of projects achieved first-silicon success, and logic/functional defects remain the leading cause of costly re-spins [ 11 ] , underscoring the urgent need for a highly automated verification paradigm. The industry has historically relied on constrained random verification [ 22 ] , formal verification [ 18 ] , and hardware emulation. However, these techniques have merely maintained a fragile balance rather than fundamentally closing the gap between design complexity and verification capability [ 9 ] . Against this backdrop, both industry and academia have viewed AI-driven automated verification as a promising path to breaking the bottleneck. Major EDA vendors (e.g., Synopsys [ 30 , 31 ] , Cadence [ 32 , 34 , 33 ] , and Siemens [ 6 , 7 ] ) have integrated AI into various stages of the verification flow, including assertion generation, coverage closure, and debugging. Concurrently, academia has explored the protential of using LLMs for specific tasks such as assertion generation [ 17 , 29 , 19 , 28 ] , automated testbench generation [ 2 , 16 , 37 ] , and coverage improvement [ 2 , 16 , 37 ] . Yet, these approaches mainly optimize specific stages of the verification process mentioned above, rather than automating the end-to-end verification process. Engineers are still required to orchestrate and integrate the distinct stages. Recent work has demonstrated the potential of LLMs for automated functional verification. Based on the verification language, these efforts can be broadly categorized into two paradigms: • SystemVerilog & UVM-based approaches: UVM² [ 42 ] uses a hybrid generation strategy combining templates with LLMs to automatically generate UVM testbenches from design specifications and iteratively optimizes testcases using coverage feedback; MAVF [ 20 ] proposes a multi-agent collaboration architecture that decouples verification into multiple specialized stages, including specification parsing, verification planning, testbench specification generation, and code generation, with specialized agents executing them in sequence and validating effectiveness on real chip modules. • Python-based approaches: PRO-V [ 45 ] adopts a pure-Python generation strategy and achieves end-to-end RTL automated verification by combining it with an LLM-as-a-judge mechanism. While these efforts confirm that LLM-based verification can significantly reduce time and labor costs, they still exhibit limitations in workflow flexibility, execution reliability, and result traceability. To build an autonomous agent system that spans the entire verification flow, three core challenges must be addressed: Challenge 1: Limited accuracy of LLM-generated Verilog/SystemVerilog verification code. LLMs are less proficient at generating hardware description languages (HDLs; e.g., Verilog/SystemVerilog) compared to software languages like Python. This stems primarily from two factors: • Severe disparity in training data. LLMs rely on massive datasets for pattern learning, and data scale directly affects model’s performance. For example, in The Stack v2 [ 21 ] , the largest open code dataset to date, Python accounts for 178.44 GB of data, while Verilog and SystemVerilog account for only 9.348 GB and 0.84 GB, respectively. This scarcity results in worse and less stable generation quality for HDLs. • Limited generation accuracy. Consequently, LLMs exhibit limited accuracy in Verilog/SystemVerilog and struggle with complex syntactic correctness [ 35 , 43 ] . Although many studies [ 5 , 44 , 14 , 46 ] have worked to improve generation quality, most focus on generating hardware design code. As a result, even state-of-the-art models struggle to consistently and stably generate syntactically correct and semantically consistent SystemVerilog verification code [ 27 ] . Challenge 2: Difficulty completing complex end-to-end verification tasks. The inherent complexity of functional verification requires processing massive volumes of design specifications, design/verification code and simulation reports, a sheer scale of information that easily exceeds the effective context window of current LLMs. In this setting, inherent issues of LLMs such as hallucination [ 36 ] , context rot [ 15 ] , and weak instruction following [ 13 ] are amplified, severely impacting the reliability and effectiveness of the verification outcomes. These limitations are particularly prominent in two aspects: • Information loss and error accumulation in complex task execution. Because functional verification stages are highly interdependent, any errors introduced in early phases (e.g., omitted constraints due to context loss, or syntactic flaws caused by hallucinations) accumulate rapidly and compromise the correctness of all subsequent stages. For instance, in existing work, MAVF requires multiple rounds of manual review and correction during testbench specification generation just to ensure later code generation accuracy. Therefore, an automated checking and feedback mechanism is strictly needed to constrain and correct outputs at each individual stage. • Inadequacy of simple workflows for diverse verification scenarios. To manage the inherent complexity of functional verification, tasks are typically decomposed into sequential stages for LLM execution. However, the complexity of hardware modules varies significantly, rendering overly simple workflows ineffective across diverse scenarios. For relatively simple designs (e.g., FIFOs or arithmetic units), interaction patterns are straightforward, allowing LLMs to directly generate stimuli and check output. Conversely, complex modules with strict ordering

Read the complete text