RefEvo: Agentic Design with Co-Evolutionary Verification for Agile Reference Model Generation
Yifan Zhang, Jianmin Ye, Jiahao Yang, Xi Wang School of Integrated Circuits, Southeast University, China National Center of Technology Innovation for EDA, China Email: {yifan.zhang, jianmin_y, xi.wang}@seu.edu.cn, [email protected] Corresponding author. · 2026
Read RefEvo: Agentic Design with Co-Evolutionary Verification for Agile Reference Model Generation by Yifan Zhang, Jianmin Ye, Jiahao Yang, Xi Wang School of Integrated Circuits, Southeast University, China National Center of Technology Innovation for EDA, China Email: {yifan.zhang, jianmin_y, xi.wang}@seu.edu.cn, [email protected] Corresponding author. (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-24218.txt.
Introduction
Zhang and three colleagues present RefEvo, a dynamic multi-agent framework for building high-fidelity chip reference models. Static workflows cannot adapt to varied complexity, long chats overflow context and forget specs, and testbenches can wrongly validate flawed models through correlated hallucinations. RefEvo plans workflows from semantic complexity, checks model and test logic through a dialectical arbiter against the spec oracle, and compresses context without losing spec content. On 20 hardware modules it passes 95 percent of tests and cuts token use by about 71 percent with full spec recall.
Catalog record
| CREATOR | Yifan Zhang, Jianmin Ye, Jiahao Yang, Xi Wang School of Integrated Circuits, Southeast University, China National Center of Technology Innovation for EDA, China Email: {yifan.zhang, jianmin_y, xi.wang}@seu.edu.cn, [email protected] Corresponding author. |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20027 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.24218
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
RefEvo: Agentic Design with Co-Evolutionary Verification for Agile Reference Model Generation Yifan Zhang, Jianmin Ye, Jiahao Yang, Xi Wang School of Integrated Circuits, Southeast University, China National Center of Technology Innovation for EDA, China Email: {yifan.zhang, jianmin_y, xi.wang}@seu.edu.cn, [email protected] Corresponding author. Abstract As the complexity of Systems-on-Chip (SoC) escalates, the “shift-left” strategy necessitates the rapid development of high-fidelity reference models (e.g., in SystemC) for early architecture exploration and verification. While Large Language Models show promise in code generation, applying them to hardware modeling faces distinct challenges: (1) rigid, static workflows fail to adapt to varying design complexities, causing inefficiency; (2) context overflow in long-turn interactions leads to the catastrophic forgetting of critical specifications; and (3) the “Coupled Validation Failure” problem—where generated TBs falsely verify flawed models due to shared hallucinations—severely undermines reliability. To address these limitations, we introduce RefEvo , a dynamic multi-agent framework designed for agile and reliable modeling. RefEvo features three key innovations: (1) A Dynamic Design Planner that autonomously decomposes specifications and constructs tailored execution workflows based on semantic complexity; (2) A Co-Evolutionary Verification Mechanism , which employs a Dialectical Arbiter to simultaneously rectify the model and verification logic against the specification (Spec) oracle, effectively mitigating false positives; and (3) A Spec Anchoring Strategy for lossless context compression. Evaluated on a diverse benchmark of 20 hardware modules, RefEvo achieves a 95% pass rate, outperforming static baselines by a large margin. Furthermore, our context optimization reduces token consumption by an average of 71.04% , achieving absolute savings of over 70,000 tokens per session for complex designs while maintaining 100% specification recall. I Introduction In the modern Electronic Design Automation (EDA) landscape, high-level reference models written in languages like SystemC or C++ have become critical assets [ 8 ] . These models serve as the “golden standard” for verifying Register Transfer Level (RTL) implementations and act as virtual prototypes for early software development [ 1 , 36 , 21 ] . Their importance is further amplified by the industry-wide adoption of the “shift-left” methodology, which mandates early validation through virtual platforms to enable hardware-software co-verification prior to silicon fabrication. However, despite their necessity, manually crafting these high-fidelity models remains a labor-intensive and error-prone process, creating a significant bottleneck in the agile hardware development cycle [ 4 , 7 ] . To alleviate this engineering burden, recent advancements in Large Language Models (LLMs) have sparked intense interest in automating EDA tasks [ 18 , 17 ] . While LLMs like GPT-4 have demonstrated remarkable proficiency in generating generic software, applying them to the strict constraints of hardware modeling presents unique challenges. Within the hardware domain, the majority of research progress has been concentrated on RTL code generation, exemplified by approaches such as RTLCoder [ 19 ] , ChatChisel [ 20 ] , ReChisel [ 22 ] , and ChatCPU [ 30 ] . Complementing these generation efforts, benchmarking studies [ 26 ] have also established robust evaluation frameworks specifically for assessing LLM capabilities in Verilog. Fig. 1: Performance capability of state-of-the-art LLMs using optimized prompt engineering and structured generation workflows (without Co-Evolutionary Verification). The radar chart highlights the significant struggle of current models in generating correct SystemC reference models across various hardware domains, particularly in Control Logic and Memory & I/O. However, SystemC modeling, which requires precise handling of transaction-level modeling (TLM) semantics, bit-widths, concurrency, and delta-cycle timing, remains a distinct challenge [ 14 ] . As illustrated in Fig. 1 , even when equipped with specialized design workflows and sophisticated prompt engineering [ 15 , 13 ] , advanced models struggle significantly to produce functional SystemC models across various hardware domains. A naive or purely structured application of LLMs often results in code that looks plausible but fails to compile or simulate correctly. We identify three primary hurdles hindering the practical adoption of LLMs in this domain: Syntactic and Semantic Correctness: Hardware models must adhere to strict event-driven simulation semantics. LLMs frequently generate code with subtle API misuses or missing library dependencies, leading to compilation failures that naive generation cannot resolve. Coupled Validation Failure: A critical risk arises when LLMs generate both the design under test (DUT) and the testbench (TB). Traditional static flows [ 24 ] often lead to a sycophantic scenario where the TB is inadvertently tailored to match the DUT’s hallucinations, resulting in a false-positive “PASS”. While introducing manual human-written TBs could mitigate this, it re-introduces the very bottleneck automation seeks to eliminate, as addressed by recent verification frameworks like ChatTest [ 28 ] and FIXME [ 27 ] . Furthermore, in early agile stages where specifications change frequently, manual TBs suffer from error propagation , where outdated verification logic fails to catch new design errors [ 9 , 11 ] . Therefore, an automated mechanism to validate the validator itself is essential. Context Limitations: As design complexity grows, the extensive interaction logs required for iterative refinement often exceed the context window of LLMs [ 10 , 35 , 5 ] . This causes the model to suffer from Catastrophic Forgetting , losing track of initial specifications such as register maps or interface protocols during long interaction sessions. To overcome these challenges, we propose RefEvo , an agent-based framework designed for the agile generation of reliable hardware reference models. Unlike static generation approaches, RefEvo treats generation as a dynamic, co-evolutionary process. Building on the collaborative paradigm of modern multi-agent frameworks [ 12 , 32 , 2 ] —where planners, coders, and debuggers work in concert—RefEvo introduces domain-specific innovations to address the aforementioned problems: • Dynamic Design Planner: To address workflow rigidity, we introduce a planner that acts as a “Brain”, analyzing semantic complexity to autonomously decompose specifications and construct bespoke execution workflows. • Co-Evolutionary Verification: To mitigate coupled validation failures, we propose a dialectical mechanism where a dedicated Arbiter Agent validates both the code and the TB against the specification oracle, significantly reducing false positives. • Spec Anchoring Context Management: To solve catastrophic forgetting, we implement a strategy that anchors the immutable specification while compressing interaction history, ensuring 100% recall of critical constraints. The remainder of this paper is organized as follows: Section II reviews related work. Section III details the RefEvo methodology. Section IV presents the experimental results and analysis. Section V concludes the paper. II Related Work Fig. 2: The logical architecture of RefEvo. (A) The Dynamic Planning phase where Agent 1 analyzes complexity to construct an execution plan. (B) The Symbiotic Verification Loop where the Modeler (Agent 2) and Verifier (Agent 3) co-evolve under the supervision of the Dialectical Arbiter (Agent 4). II-A LLM-Based Hardware Code Generation The application of LLMs in hardware design has gained significant traction. Early benchmarking efforts [ 26 ] established evaluation frameworks demonstrating that LLMs could generate syntactically correct Verilog code. Tools like RTLCoder [ 19 ] have demonstrated that fine-tuned LLMs can generate syntactically correct RTL code, while iDSE [ 16 ] also explored the integration of LLMs in high-level synthesis design space exploration. However, these works primarily focus on RTL generation. High-level modeling (SystemC/C++), which requires a higher level of abstraction and distinct simulation semantics, remains under-explored. RefEvo bridges this gap by targeting the specific challenges of reference model generation. A critical challenge in LLM-based code