Automated QoR improvement in OpenROAD with coding agents Conference: ; ;

Amur Ghose, Junyeong Jang, Andrew B. Kahng, Jakang Lee {aghose, juj015, abk, jal216}@ucsd.edu UC San Diego, La Jolla, California, USA · 2026

Read Automated QoR improvement in OpenROAD with coding agents Conference: ; ; by Amur Ghose, Junyeong Jang, Andrew B. Kahng, Jakang Lee {aghose, juj015, abk, jal216}@ucsd.edu UC San Diego, La Jolla, California, USA (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-06268.txt.

Introduction

Chip design tools improve slowly because expert engineers are scarce. Amur Ghose and 3 co-authors test whether coding agents can advance the tools themselves in a 2026 paper. Their system, AuDoPEDA, works autonomously inside OpenROAD, an open-source electronic design automation flow.

The agent reads the codebase, proposes research directions, expands them into implementation steps, and submits working code changes. A task suite and evaluation protocol measure improvements in power, performance, and area, the classic chip quality measures. With minimal human oversight, the system cut routed wirelength, effective clock period, and power by noticeable margins. The closed-loop setup shows language models can produce real engineering gains in a demanding, specialized codebase.

Catalog record

CREATORAmur Ghose, Junyeong Jang, Andrew B. Kahng, Jakang Lee {aghose, juj015, abk, jal216}@ucsd.edu UC San Diego, La Jolla, California, USA
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-06268

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Automated QoR improvement in OpenROAD with coding agents Conference: ; ; Amur Ghose, Junyeong Jang, Andrew B. Kahng, Jakang Lee {aghose, juj015, abk, jal216}@ucsd.edu UC San Diego, La Jolla, California, USA Abstract . EDA development and innovation has been constrained by scarcity of expert engineering resources. While leading LLMs have demonstrated excellent performance in coding and scientific reasoning tasks, their capacity to advance EDA technology itself has been largely untested. We present AuDoPEDA , an autonomous, repository-grounded coding system built atop OpenAI models and a Codex-class agent that reads OpenROAD, proposes research directions, expands them into implementation steps, and submits executable diffs. Our contributions include (i) a closed-loop LLM framework for EDA code changes; (ii) a task suite and evaluation protocol on OpenROAD for PPA-oriented improvements; and (iii) end-to-end demonstrations with minimal human oversight. Experiments in OpenROAD achieve routed wirelength reductions of up to 5.9%, and effective clock period reductions of up to 10.0%. 1. Introduction VLSI physical design (PD) remains heavily constrained by the availability of senior engineers who can reason across large, multi-language electronic design automation (EDA) codebases and long, iterative flows. Recent code-focused large language models (LLMs) show strong performance on local programming tasks, but their effectiveness degrades when the required context spans many files, undocumented invariants, and heterogeneous toolchains. The open-source OpenROAD project ( openroad ; openroad-github ) exemplifies this setting: it comprises millions of lines of C++, Tcl, Python, and Verilog, evolves on a weekly cadence, and offers only sparse cross-module documentation with many implicit interfaces. These characteristics make onboarding difficult for humans and pose an even greater challenge for autonomous coding agents. Inputs: OpenROAD repo, EDA literature \mathcal{C}_{\mathrm{lit}} . S0: Repo graph & docs Build cross-language property graph G and doc cards \mathcal{C}_{\mathrm{repo}} . S1: Literature-grounded planning DSPy + RAG over \mathcal{C}_{\mathrm{repo}} and \mathcal{C}_{\mathrm{lit}} to emit high-level plans. S2: Localization Map plans to concrete edit surfaces and granular steps (\Delta_{i},\text{tests, probes}) . S3: Autonomous execution Agent applies diffs, runs flows, and gates on QoR QoR = (WL, ECP, DRC, timing). Outputs: Accepted code diffs and QoR improvements. QoR Figure 1. The AuDoPEDA pipeline. In this work, we ask whether an LLM-driven system can make autonomous, repository-scale coding contributions to a production EDA stack while closing the loop on quality-of-results (QoR). Our answer is a programmatic pipeline that (i) bootstraps machine-usable documentation and a code graph for OpenROAD, (ii) composes domain literature with repository structure to synthesize plans, and (iii) executes those plans via an agentic code editor that proposes diffs, compiles, runs flows, and hill-climbs against PPA targets (e.g., routed wirelength, effective clock period). Our thesis is simple: unlike generic software engineering, EDA is a highly specialized technical domain in which expertise is acquired by reading code, papers, manuals, and tool/flow documentation. There is no fundamental reason why an autonomous coding agent cannot be “onboarded” in the same way, via a documentation-first approach. Concretely, our system factors this task into four coupled stages: Stage 0: Documentation bootstrap and code graph. We parse the OpenROAD repository with tree-sitter to obtain language-agnostic abstract syntax trees (ASTs) and structural edges (calls, includes, bindings), and compile them into a sparsified dependency directed acyclic graph (DAG) at file and function granularity ( treesitter ) . A documentation generator (“Docmaker”) traverses this DAG bottom-up to produce concise, leaf-to-module cards capturing APIs, invariants, and conditions both before and after, thereby creating a hierarchical knowledge base suitable for downstream retrieval and planning. This staged, graph-aware summarization mitigates the context dilution typical of single-shot prompts over raw files ( hcgs ; lewis2020rag ) . Stage 1: Literature-grounded, DSPy-programmed planning. We treat planning as a declarative LLM program compiled by DSPy ( dspy ) . The planner retrieves from (a) the Docmaker cards and code graph, and (b) a domain corpus covering placement, clock tree synthesis (CTS), routing, and timing closure via retrieval-augmented generation ( lewis2020rag ) . It emits high-level research directions (e.g., “reduce half-perimeter wirelength by adjusting legalization cost and congestion penalties”), each accompanied by acceptance tests, telemetry hooks, and rollback conditions that make the plans directly executable and evaluable. Stage 2: Plan localization to source. High-level plans are then projected onto concrete edit surfaces by aligning objectives with neighborhoods of the code graph (modules/files) and by extracting the relevant APIs and invariants from the leaf-level documentation cards. The result is a granular plan : an ordered set of diffs annotated with pre-flight checks (build, unit, flow-smoke tests), runtime probes (timing, design rule check (DRC), and routing metrics), and post-conditions tied to QoR deltas. This bridges literature-informed intent and concrete, verifiable changes to the OpenROAD codebase and scripts. Stage 3: Autonomous execution with verification loops. A Codex-class coding agent, operating in a planner–executor architecture, applies the proposed diffs, compiles the modified code, and runs instrumented OpenROAD flows on designated benchmarks. The agent iterates using self-measured signals (e.g., routed wirelength (rWL), worst negative slack (WNS), total negative slack (TNS), via count) together with guardrails such as revert-on-regression and bisect-on-failure. It leverages tool-use patterns (code search, syntax trees, build logs) similar to SWE-agent ( sweagent ) , and can opportunistically invoke tool APIs learned from examples (cf. Toolformer) ( toolformer ) . Failures (compile errors, runtime crashes, QoR regressions) are converted into counterexamples and fed back into the granular plan for repair, closing a self-correcting feedback loop. Contributions. We introduce AuDoPEDA , the first Au tonomous Do cumentation and P lanning system for EDA codebases that integrates learned program synthesis with design-automation workflows. Our concrete contributions are: • A graph-structured documentation maker for OpenROAD, built with tree-sitter , that constructs leaf-to-module cards capturing the invariants and interfaces required for downstream planning ( treesitter ; hcgs ) . This documentation pipeline fully generalizes to any EDA repository. • A literature-grounded planning layer , implemented with DSPy , which composes contextual documentation with EDA papers and wikis to generate testable, repository-aware research directions ( dspy ; lewis2020rag ) . • An autonomous executor for EDA codebases that translates plans into code diffs, compiles, runs full design flows, and hill-climbs on metrics under safety constraints ( sweagent ) . We intentionally scaffold atop the leading Codex agent from OpenAI, which is open-source and allows such modifications. • End-to-end validation on OpenROAD , demonstrating that the system can produce accepted patches and measurable QoR improvements — specifically, in routed wirelength and effective clock period — on fixed benchmarks and acceptance tests. Scope and positioning. Unlike prior work that either documents code or assists local edits, our system couples (i) graph-structured documentation, (ii) literature-grounded planning, and (iii) agentic execution with QoR feedback, all tailored to an industrial-scale EDA repository. The design emphasizes programming LLMs rather than ad hoc prompt engineering: each stage is a typed operator with explicit inputs and outputs (graphs, cards, plans, diffs, metrics), enabling determinism, auditability, and reuse across flows ( dspy ) . Below, Section 2 reviews relevant literature, and Section 3 presents the pipeline end-to-end. Section 4 gives full-system results: documentation artifacts, high-level and granular implementation plans, and resulting code diffs, along with QoR (routed wirelength, effective clock period) improvements obtained by applying these diffs to OpenROAD. Section 5 concludes with future directions for autonomous LLM agents in EDA. 2. Related Work Our work

Read the complete text