Bridging the Last Mile of Circuit Design: Post E D A -Bench , a Hierarchical Benchmark for PPA Convergence and DRC Fixing
Pengju Liu, Nuo Xu, Jinwei Tang, Yu Cao, Caiwen Ding · 2026
Read Bridging the Last Mile of Circuit Design: Post E D A -Bench , a Hierarchical Benchmark for PPA Convergence and DRC Fixing by Pengju Liu, Nuo Xu, Jinwei Tang, Yu Cao, Caiwen Ding (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06936.txt.
Introduction
Pengju Liu and four co-authors introduce PostEDA-Bench, a benchmark for the final stage of chip circuit design. Language model agents are now used to fix design rule violations and meet power, performance, and area targets after design tools run. Earlier benchmarks largely skipped the fixing task.
The benchmark holds 145 tasks in four groups, from basic rule fixing to harder reasoning and multi-goal cases. Testing eight large language models, the team finds decent results on simple tasks but sharp drops on realistic ones. Adding vision helps, and weak trade-off reasoning emerges as the main limit on multi-goal work.
Catalog record
| CREATOR | Pengju Liu, Nuo Xu, Jinwei Tang, Yu Cao, Caiwen Ding |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 89 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.06936
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Bridging the Last Mile of Circuit Design: Post E D A -Bench , a Hierarchical Benchmark for PPA Convergence and DRC Fixing Pengju Liu, Nuo Xu, Jinwei Tang, Yu Cao, Caiwen Ding Abstract LLM-based agents are increasingly applied to the “last mile” of Electronic Design Automation (EDA): repairing residual sign-off Design Rule Check (DRC) violations and converging Power–Performance–Area (PPA) targets after tool runs. Existing EDA-LLM benchmarks, however, omit DRC fixing entirely and rely on flat hierarchies tied to a single toolchain. We introduce PostEDA-Bench , a hierarchical benchmark with 145 145 tasks across DRC-Essential , DRC-Reasoning , PPA-Mono , and PPA-Multi , supported by EDA toolchains with machine-checkable evaluation. Across eight commercial and open-source LLMs under multiple agent scaffolds, we find that agents handle synthetic DRC-Essential and single-objective PPA-Mono reasonably well but degrade sharply on the more practical DRC-Reasoning (best SR 36.66 % 36.66\% ) and PPA-Multi (best SR 20.00 % 20.00\% ); vision augmentation consistently enhances DRC-Bench; and trade-off reasoning—rather than knob knowledge—is the dominant PPA-Multi bottleneck. 1 Introduction Large language model (LLM)–based agentic systems have demonstrated strong performance in code generation [ 7 , 22 , 1 ] , robotics and embodied AI [ 21 , 3 ] , and mathematical reasoning [ 15 , 5 ] . These advances have motivated recent work on LLM-driven agents for automating power–performance–area (PPA) convergence in electronic design automation (EDA) flows [ 18 , 19 , 17 , 12 , 8 , 4 , 9 , 6 , 12 ] , where engineers often spend significant time iterating after tool runs to meet PPA targets. Despite this progress, existing EDA-agent benchmarks still fall short of what is needed to evaluate practical post-EDA closure . As summarized in Table 1 , most benchmarks either focus on NLP-to-script generation rather than target-driven PPA optimization , contain only a small number of optimization tasks, use flat or coarse task hierarchies, or are tied to a single toolchain, limiting both diagnostic resolution and generality. More importantly, none of them evaluates design rule check (DRC) fixing , although residual sign-off DRC violations remain a time-critical “last-mile” workload even after modern routing. These gaps make a unified and realistic benchmark for post-EDA PPA optimization and DRC repair both urgent and necessary . Table 1 : Comparison with related benchmarks. Benchmark #Tasks Open -sourced Objective Hierarchy EDA Toolchains DRC Fix ChatEDA-bench [ 18 ] 50 ✓ NLP \rightarrow scripts Simple–Complex OpenROAD ✗ GPT4AIGChip [ 4 ] 6 ✗ Codegen&PPA Opt. Flat Vivado HLS tools ✗ Chipnemo [ 9 ] 959 ✗ NLP \rightarrow scripts Easy–Medium–Hard n/a ✗ IICPilot [ 8 ] 4 ✗ PPA Opt. Flat OpenROAD ✗ iEDA-bench [ 19 ] 50 ✗ NLP \rightarrow scripts Simple–Complex OpenROAD ✗ MCP4EDA [ 17 ] 10 ✓ NLP \rightarrow scripts Flat OpenROAD ✗ ORFS-agent [ 6 ] 6 ✓ PPA Opt. Flat OpenROAD ✗ AutoEDA [ 12 ] 100 ✗ NLP \rightarrow scripts Different–stage in EDA DC&Innovus ✗ PostEDA-Bench 145 ✓ PPA Opt. Multi-dimension& Multi-level OpenROAD& DC&Innovus ✓ \dagger : NLP \rightarrow scripts: generates EDA scripts from natural language; it runs tools but doesn’t optimize PPA. \lx@sectionsign : PPA Opt. denotes PPA Optimization. \star : OpenROAD is open-source, whereas DC and Innovus are commercial tools. \ddagger : DC and Innovus are only used to generate part of DRC-Bench tasks in PostEDA-Bench . To fill this gap, we introduce PostEDA-Bench , a hierarchical benchmark for evaluating LLM-based agents on post-EDA closure: PostEDA-Bench : 145 tasks across two dimensions, DRC-Bench and PPA-Bench , evaluating whether an agent can (i) repair sign-off DRC violations and (ii) drive designs to specified PPA targets, supported by both open-source ( OpenROAD ) and commercial ( DC + Innovus ) toolchains with machine-checkable evaluation. DRC-Bench: splits into DRC-Essential, three levels probing rule knowledge, contextual robustness, and cascaded multi-violation fixing on synthetic cases, and DRC-Reasoning, three levels of practical residual post-flow violations that demand geometric reasoning, stratified by minimum required edit steps. PPA-Bench: splits into PPA-Mono (Performance, Power, Area), with single- and multi-knob perturbation levels plus a Performance re-architecture level, and PPA-Multi, with 2D and 3D Pareto-targeted tasks that test trade-off reasoning under constraint floors. Using PostEDA-Bench , we evaluate commercial and open-source models, frontier and small backbones, and text-only versus vision–language variants under several agent scaffolds (ReAct, Proposer–Critic, ORFS-Agent, Reflexion and ToT). Our key findings are as follows: \triangleright Synthetic vs. practical asymmetry. Agents perform reasonably well on synthetic DRC-Essential (best SR 85.50\% ) and single-objective PPA-Mono (best SR 64.56\% ), but degrade sharply on the more practical DRC-Reasoning (best SR 36.66\% ) and PPA-Multi (best SR 20.00\% ), where post-flow geometric reasoning and multi-objective trade-offs dominate. \triangleright Vision augmentation enhances DRC-Bench. Adding a layout-image channel is never harmful and yields consistent SR/VRR gains on both DRC-Essential and DRC-Reasoning, with the largest lifts when text-only baselines are weak. \triangleright Trade-off reasoning is the PPA-Multi bottleneck. Several backbones produce negative NIS on PPA-Multi by regressing constraint metrics while chasing the violated objective, indicating they greedily optimize one PPA dimension rather than balancing competing targets. 2 Related Work DRC fixing. Design rule checking verifies layout manufacturability, yet residual sign-off errors and cascaded fixes often remain after automated repair. This motivates evaluating agents on rule understanding, layout inspection, geometric editing, and iterative DRC checking; additional background is in Appendix A . PPA optimization. Power, performance, and area are coupled objectives, and automated flows often miss tight targets despite many configuration, constraint, and design-level knobs. PPA-Bench targets this last-mile loop by testing whether agents can use tool feedback for single-objective improvement and multi-objective trade-offs; extended context is in Appendix A . 3 PostEDA-Bench Preliminary Source Design Collection. As shown on the left of Figure 2 , PostEDA-Bench starts from three public RTL sources: RTLLM v2 [ 11 ] (50 designs), VerilogEval -Human [ 10 ] (156 problems), and OpenCores [ 14 ] (1,283 listed IP projects), covering arithmetic circuits, controllers, and community IP blocks. We map retained designs to ASAP7 [ 2 ] and keep only candidates satisfying four auditable criteria: (i) parse and synthesis validity , i.e., a well-defined top module, valid syntax, and successful gate-level synthesis; (ii) non-trivial scale , with more than 300 instantiated standard cells; (iii) cross-source deduplication by top-module names, port signatures, and post-synthesis structural similarity, merging designs with more than 90% gate-level overlap; and (iv) release and audit eligibility , requiring documented provenance, license, selected top module, and derived artifacts. Aggregate statistics are reported in Table 2 ; Appendix B details deduplication, contamination control, and the release package. Because public RTL may appear in model pretraining corpora, PostEDA-Bench controls contamination by evaluating downstream tool interaction, benchmark-specific targets, and generated EDA artifacts rather than source-code recall. For reproducibility and release , both DRC-Bench and PPA-Bench ship with inputs, prompts, metadata, pinned tool setup, and evaluation drivers; final labels are machine-checkable through deterministic EDA tools and report parsers. Detailed release contents, tool versions, regeneration requirements, and limitations are documented in Appendices B , C , D and H . Statistic Number Tasks 145 Std. cells per source design min 301; avg 16,505; max 95,061 Covered layers in DRC-Bench N(P)Well – M9 DRC-Essential rules (before pruning) 168 Human fix steps (DRC-Reasoning) min 1; max 8 DRC runtime