ORFS-agent: Tool-Using Agents for Chip Design Optimization
Amur Ghose, Andrew B. Kahng, Sayak Kundu, Zhiang Wang · 2025
Read ORFS-agent: Tool-Using Agents for Chip Design Optimization by Amur Ghose, Andrew B. Kahng, Sayak Kundu, Zhiang Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-08332.txt.
Introduction
Ghose, Kahng, Kundu, and Wang present ORFS-agent, a tool that uses a large language model to tune chip design settings. Chip flows have thousands of settings, and small changes can shift power, speed, and size. Their 2025 work tests the tool inside an open source design flow.
The agent tries settings, learns from the results, and tries again. Across six test designs, it beat a standard tuning tool on wire length and clock speed while using far fewer rounds. It also followed plain language goals, such as trading one gain for another. The tool can work with different models without new training. The design is also meant to stay flexible as new models appear.
Catalog record
| CREATOR | Amur Ghose, Andrew B. Kahng, Sayak Kundu, Zhiang Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-08332
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ORFS-agent: Tool-Using Agents for Chip Design Optimization Amur Ghose, Andrew B. Kahng, Sayak Kundu, Zhiang Wang Abstract Machine learning has been widely used to optimize complex engineering workflows across numerous domains. In the context of integrated circuit design, modern flows (e.g., going from a register-transfer level netlist to physical layouts) involve extensive configuration via thousands of parameters, and small changes to these parameters can have large downstream impacts on desired outcomes - namely design performance, power, and area. Recent advances in Large Language Models (LLMs) offer new opportunities for learning and reasoning within such high-dimensional optimization tasks. In this work, we introduce ORFS-agent , an LLM-based iterative optimization agent that automates parameter tuning in an open-source hardware design flow. ORFS-agent adaptively explores parameter configurations, demonstrating clear improvements over standard Bayesian optimization approaches in terms of resource efficiency and final design metrics. Our empirical evaluations on two different technology nodes and a range of circuit benchmarks indicate that ORFS-agent can improve both routed wirelength and effective clock period by over 13%, all while using 40% fewer optimization iterations. Moreover, by following natural language objectives to trade off certain metrics for others, ORFS-agent demonstrates a flexible and interpretable framework for multi-objective optimization. Crucially, ORFS-agent is modular and model-agnostic, and can be plugged in to any frontier LLM without any further fine-tuning. I Introduction Large Language Models (LLMs) have reshaped AI, excelling at natural-language generation, question answering, and zero-/few-shot learning [ 7 ] . Their emergent reasoning spans mathematical problem solving, code generation, and multi-step orchestration via agent frameworks [ 12 ] . LLMs integrate into agent systems [ 50 ] , pairing API calls, predefined functions (“tool use”), and context windows to meet language-defined goals. These agents already serve fields from healthcare to voice-controlled computing. Research on LLMs has seen major advances in neural architecture search [ 13 ] [ 32 ] , combinatorial optimization [ 5 ] [ 37 ] , and heuristic selection [ 6 ] [ 28 ] , all relevant to chip design sub-tasks. Chip design relies on a complex EDA flow that turns high-level hardware descriptions into manufacturable layouts. Each stage exposes hundreds or thousands of hyperparameters (timing constraints, placement strategies, routing heuristics, etc.) whose joint settings strongly affect power, performance, and area (PPA). At advanced nodes, design complexity and the parameter space balloon further [ 1 ] . The Concrete Problem. We target LLM-driven black-box optimization across varied objectives, circuits, and technology nodes. In ML terms, this is context-based Bayesian optimization: LLM agents exploit metadata (e.g., log files) as heuristics. Traditional Bayesian optimization (BO) tunes EDA parameters well, yet pure black-box methods miss domain knowledge and need explicit objectives. LLMs, with broad “world knowledge,” use chain-of-thought to iteratively propose and refine parameters [ 62 ] [ 53 ] . LLM agents interface with chip-design tools, parse intermediate results, call domain APIs, and adjust flow parameters in a human-like loop. They also slot into existing heuristic frameworks (e.g., BO) to boost efficiency. Distinction from other works: Fine-tuning vs. Model-Agnostic Approaches. Many recent efforts apply domain-specific fine-tuning. ChatEDA [ 53 ] , ChipNeMo [ 33 ] , and JARVIS [ 42 ] curate EDA-centric corpora, retrain or instruction- tune a base model, and then self-host the resulting checkpoint; this entails recurring data-collection, training, and maintenance costs whenever a stronger foundation model is released. ChatEDA, for instance, fine-tunes an open-source (or API-tunable) model on Q-A examples. Each new SOTA model demands another fine-tune: closed models (e.g., Claude) seldom allow this, and open models lag the frontier. Fine-tuning plus lifecycle management and hosting may cost USD $10k, and the maintainer pays for inference. Alternative approaches avoid retraining, and instead wrap or retrieve around frozen SOTA models. EDA-Copilot [ 4 ] , Ask-EDA [ 47 ] , and ORAssistant [ 25 ] combine retrieval-augmented generation with off-the-shelf chat models to answer tool-usage questions, while surveys (LLM4EDA [ 62 ] , “Future or Mirage?” [ 60 ] , and the taxonomy in [ 45 ] ) highlight the growing appeal of lightweight, model-agnostic agents. Our agent follows this latter paradigm: it wraps whatever SOTA model is available, with zero extra training cost; our full experiments can run on Grok-Mini for less than USD $10. Further, while previous agents such as ChatEDA build general Q-A support for engineers, our agent focuses solely on optimizing flow parameters. Our Contributions. We introduce ORFS-agent , an LLM-driven autotuner for an open-source chip-design flow that tops Bayesian optimization (BO) with fewer flow runs. Our main contributions are: • We embed ORFS-agent in OpenROAD-flow-scripts (ORFS) [ 70 ] . It schedules parallel ORFS runs, reads intermediate metrics (wirelength, timing, power), and iteratively refines parameters to optimize post-route results. Leveraging ORFS’s METRICS2.1 logging [ 22 ] , the agent skips bad configurations and gives robust, efficient chip design optimization. Modularity allows instantly switching models. • ORFS-agent obeys natural-language instructions to weight or constrain design metrics (e.g., favor timing over wirelength) and taps existing BO libraries inside its tool-use loop for extra lift. • On ASAP7 and SKY130HD (three circuits each), ORFS-agent trims ORFS calls and improves wirelength and effective clock period by \geq 13\% over baseline, beating the BO-based ORFS AutoTuner [ 22 ] . Fig. 1 : ORFS-agent integrated with OpenROAD-flow-scripts (ORFS); metrics gathered via METRICS2.1 [ 22 ] . In the following, Section II reviews BO and recent LLM-EDA work. Section III gives details of ORFS-agent—prompts, data, iterations. Section IV gives experiments. Section V concludes and sketches future work. Anonymized code is open-sourced for inspection at [ 71 ] . II Related Work We organize our discussion of related work into three subsections, covering Open-Source EDA, Bayesian Optimization, and LLMs for Optimization in EDA in that order. Additional discussion of EDA flow and OpenROAD is given in Appendix A . II-A Open-Source EDA and OpenROAD as an ML Testbed We target LLM/ML EDA research based on the permissively open-sourced OpenROAD [ 3 ] , where code, logs and data can be made public to enable reproducible training and evaluation. Tcl/Python APIs expose every flow stage, for capture of live metrics and debug – vital for ML agents. With its RTL-to-GDSII scope, transparency and active community, OpenROAD provides an excellent testbed. ORFS wraps OpenROAD in editable JSON/Tcl for large-scale experiments [ 70 ] . Other tools build on OpenROAD, e.g., DREAMPlace yields 30\times faster placement than OpenROAD’s RePlAce via CUDA acceleration [ 30 ] . II-B Bayesian Optimization in Flow Tuning Bayesian optimization (BO) is a widely used approach for parameter autotuning in EDA flows [ 22 ] including in commercial tools such as Synopsys DSO.ai [ 68 ] and Cadence Cerebrus [ 65 ] . It enjoys efficiency in terms of samples and solution space search, but faces drawbacks: • Contextual and Knowledge Limitations: BO frameworks typically do not incorporate domain knowledge unless manually encoded (e.g., at PDK level). Further, they do not adapt from past results. • Explicit Objective Functions: BO frameworks require explicitly defined objective functions, possibly missing complex or subjective criteria. This can hinder effectively balancing PPA in chip design. • Scalability Challenges: High-dimensional spaces and large designs can combinatorially overwhelm traditional BO approaches [ 57 ] . We seek flexible, context-aware and data-driven