ChipCraftBrain : Validation-First RTL Generation via Multi-Agent Orchestration
Cagri Eryilmaz · 2026
Read ChipCraftBrain : Validation-First RTL Generation via Multi-Agent Orchestration by Cagri Eryilmaz (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19856.txt.
Introduction
Eryilmaz presents ChipCraftBrain, a system that turns plain-language specifications into register-transfer-level chip code, the hardware description that defines how circuits move data. Six specialized agents, steered by a learning-based coordinator, split each design into linked sub-modules, solve logic diagrams by algorithm, and verify timing. It reached 97.2 percent on a standard human-written Verilog benchmark and built all eight modules of a RISC-V processor case that passed lint checks on programmable hardware.
Catalog record
| CREATOR | Cagri Eryilmaz |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 81511 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.19856
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ChipCraftBrain : Validation-First RTL Generation via Multi-Agent Orchestration Cagri Eryilmaz Abstract Large Language Models (LLMs) have shown promise for generating Register Transfer Level (RTL) code from natural language specifications, yet single-shot generation achieves only 60–65% functional correctness on standard benchmarks. Existing multi-agent approaches like MAGE improve pass rates to 95.9% on VerilogEval but remain untested on harder industrial benchmarks such as CVDP , lack synthesis awareness, and incur high API costs ($0.06/problem with 20 parallel Sonnet calls). We present ChipCraftBrain , a framework combining hybrid symbolic-neural reasoning with adaptive multi-agent orchestration for automated RTL generation. Four key innovations drive the system: (1) Adaptive multi-agent orchestration over six specialized agents using a trained PPO policy over a 168-dimensional state (with an alternative world-model MPC planner implemented and evaluated); (2) Hybrid symbolic-neural architecture that solves K-map and truth table problems algorithmically (zero cost, perfect accuracy) while using specialized agents for waveform timing analysis and general RTL generation; (3) Knowledge-augmented generation via a curated domain knowledge base of 321 patterns plus 971 open-source reference implementations with focus-aware retrieval; and (4) hierarchical specification decomposition that breaks complex multi-component designs into dependency-ordered sub-modules with interface synchronization. We evaluate across three complexity tiers. On VerilogEval -Human (156 simple modules), ChipCraftBrain achieves 98.7% pass@1 (154/156) on its best run (range 96.15–98.72% across 7 runs), placing it on par with or ahead of ChipAgents (97.4%, self-reported) and MAGE (95.9%) within measurement noise. On the 302-problem non-agentic, non-commercial code-generation subset of NVIDIA’s CVDP benchmark, spanning five task categories (RTL completion, spec-to-RTL, modification, linting, bug fixing), we achieve 94.7% pass@1 (286/302) under 5-iteration refinement with error feedback. We lead all five categories against the CVDP paper’s per-category single-shot baseline (Claude 3.7 Sonnet, 33.56% aggregate), with per-category lifts of 36–60 percentage points; we additionally lead three of four categories shared with NVIDIA’s recent ACE-RTL agentic system despite using roughly 30 × \times fewer per-problem generation attempts. A RISC-V SoC case study demonstrates hierarchical decomposition generating 8/8 lint-passing modules (689 LOC), validated on FPGA hardware, where monolithic generation fails entirely. I Introduction I-A The RTL Generation Challenge The semiconductor industry faces a persistent bottleneck: the demand for custom chip designs far exceeds the supply of skilled RTL engineers. As system-on-chip (SoC) complexity grows, with modern designs containing billions of transistors across dozens of IP blocks, the time and expertise required for front-end RTL design has become a critical constraint on innovation. Recent advances in Large Language Models (LLMs) have opened a promising avenue: generating synthesizable Verilog or SystemVerilog code directly from natural language specifications. However, the gap between generating code and generating correct, synthesizable code remains substantial. Single-shot generation with state-of-the-art models achieves only 60–65% pass rates on the VerilogEval benchmark [ 1 ] , far below the reliability threshold needed for production use. Moreover, existing evaluations concentrate on simple benchmarks. VerilogEval problems average 16 lines of code and 31 synthesis cells. Real-world IP blocks are far more complex: NVIDIA’s CVDP dataset [ 2 ] spans 783 industrial problems across 13 task categories (code completion, spec-to-RTL, modification, linting, bug fixing, testbench and assertion generation, and comprehension), and ChipBench [ 3 ] modules average 62 lines and 439 cells, 14 \times the gate count of VerilogEval . A system that excels on simple modules but fails on industrial designs has limited practical value. I-B Limitations of Current Approaches Several lines of work have attempted to close this gap, each with significant limitations: Single-shot generation approaches [ 4 , 5 , 6 ] fine-tune LLMs on Verilog corpora but provide no feedback mechanism. Errors in the generated code cannot be detected or corrected, resulting in pass rates of 45–78%. Iterative refinement systems [ 7 ] add error-feedback loops but use fixed retry strategies that do not adapt to the specific error patterns or design complexity of each problem. Multi-agent systems like MAGE [ 8 ] separate RTL generation, testbench creation, judging, and debugging into specialized agents. While achieving 95.9% on VerilogEval -Human, MAGE has three critical limitations: (a) no synthesis awareness in candidate scoring (only functional correctness), (b) primitive debug feedback (raw waveform dumps), and (c) high cost (20 parallel Claude Sonnet calls per problem at $0.06/problem). Crucially, while MAGE reports 37.4% on ChipBench, its performance on the broader CVDP benchmark has not been published. Workflow search approaches like VFlow [ 9 ] use Monte Carlo Tree Search to discover optimal agentic workflows, achieving 83.6% pass@1. However, the discovered workflow is static; it does not adapt per-problem based on design complexity or error patterns. I-C Our Contributions We present ChipCraftBrain , a framework that addresses these limitations through five key contributions: 1. Adaptive Multi-Agent Orchestration: Six specialized LLM agents (four RL-orchestrated, two rule-based) coordinated by a PPO policy operating on a 168-dimensional state representation that captures specification complexity, error patterns, code metrics, and generation history ( Section III ). 2. Hybrid Symbolic-Neural Architecture: An algorithmic K-map solver using Quine-McCluskey minimization [ 10 , 11 ] handles deterministic problem classes at zero cost and perfect accuracy, while a specialized Waveform agent tackles temporal reasoning tasks ( Section III ). 3. Knowledge-Augmented Generation: A curated 321-entry domain knowledge base plus 971 open-source reference implementations with focus-aware RAG retrieval across five strategies, augmented by a spec-guidance registry of 59 detectors—akin to the heuristic design-pattern knowledge accumulated by commercial EDA tools— that enrich specifications before generation with problem-type-specific technical briefs ( Section III ). 4. Hierarchical Specification Decomposition: Automatic detection and decomposition of complex multi-component designs into 4–8 dependency-ordered sub-modules with cross-module port synchronization, enabling generation of SoC-level designs where monolithic generation fails entirely ( Section III ). 5. Three-Benchmark Evaluation Across Complexity Tiers: We evaluate on VerilogEval (simple modules), CVDP (industrial IP), and ChipBench (hard accelerator designs), demonstrating where current AI-driven RTL generation excels and where it breaks down ( Section VI ). I-D Paper Organization The remainder of this paper is organized as follows. Section II surveys related work. Section III presents the system architecture, including multi-agent design, hybrid symbolic-neural components, RL orchestration, knowledge retrieval, hierarchical decomposition, and visible reasoning. Section IV details the validation pipeline. Section V defines the three-benchmark evaluation framework. Section VI reports experimental results and ablation studies. Section VII presents a RISC-V SoC case study with FPGA validation. Section VIII analyzes findings and limitations. Section IX outlines future work, and Section X concludes. II Related Work II-A LLM-Based RTL Generation The application of LLMs to hardware description language generation has progressed rapidly. VeriGen [ 4 ] demonstrated that models fine-tuned on Verilog corpora can generate syntactically valid code, though functional correctness remained limited. CodeV [ 5 ] improved on this with multi-level code summaries for training, achieving 77.6% on VerilogEval -Machine and 53.2% on VerilogEval -Human using a 33B parameter model. RTLCoder [ 6 ] explored instruction-tuned models for RTL, reaching 45–50%. ChipChat [ 12 ] applied GPT-4 in conversational chip design workflows. ChipNeMo [ 13 ] demonstrated that domain-adapted pretraining on hardware-design corpora improves downstream task performance but requires large labeled datasets. More recently, OriGen [ 14 ] enhances RTL generation through code-to-code augmentation and self-reflection; CraftRTL [ 15 ] targets correct-by-construction synthetic data including non-textual design representations; and ScaleRTL [ 16 ] scales post-training on a 1.7 M RTL reasoning