To Appear in the IEEE International Conference on Learning and Adaptive Systems (ICLAD), June 2025. FedChip : Federated LLM for Artificial Intelligence Accelerator Chip Design
Mahmoud Nazzal, Khoa Nguyen, Deepak Vungarala, Ramtin Zand, Shaahin Angizi, Hai Phan, Abdallah Khreishah · 2025
Read To Appear in the IEEE International Conference on Learning and Adaptive Systems (ICLAD), June 2025. FedChip : Federated LLM for Artificial Intelligence Accelerator Chip Design by Mahmoud Nazzal, Khoa Nguyen, Deepak Vungarala, Ramtin Zand, Shaahin Angizi, Hai Phan, Abdallah Khreishah (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-13162.txt.
Introduction
Mahmoud Nazzal and co-authors let rival chip designers train one shared language model without showing each other their designs. Language models can draft AI accelerator chips, but the training data is exactly what firms guard, and general models lack the specialty. Their 2025 paper proposes FedChip, federated fine-tuning in which each party trains locally and only model updates travel.
To show the system working, the team releases a dataset of thirty thousand accelerator design variations scored on power, performance, and area. They also propose a grading metric that checks generated designs against acceptance criteria across repeated samples, rewarding balance among the three scores rather than a single lucky spike. Federated training improved design quality by more than seventy-seven percent over strong general models, the authors report, while every firm's proprietary data stayed home.
Catalog record
| CREATOR | Mahmoud Nazzal, Khoa Nguyen, Deepak Vungarala, Ramtin Zand, Shaahin Angizi, Hai Phan, Abdallah Khreishah |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-13162
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
To Appear in the IEEE International Conference on Learning and Adaptive Systems (ICLAD), June 2025. FedChip : Federated LLM for Artificial Intelligence Accelerator Chip Design Mahmoud Nazzal, Khoa Nguyen, Deepak Vungarala, Ramtin Zand, Shaahin Angizi, Hai Phan, Abdallah Khreishah Abstract AI hardware design is advancing rapidly, driven by the promise of design automation to make chip development faster, more efficient, and more accessible to a wide range of users. Amongst automation tools, Large Language Models (LLMs) offer a promising solution by automating and streamlining parts of the design process. However, their potential is hindered by data privacy concerns and the lack of domain-specific training. To address this, we introduce FedChip , a Fed erated fine-tuning approach that enables multiple Chip design parties to collaboratively enhance a shared LLM dedicated for automated hardware design generation while protecting proprietary data. FedChip enables parties to train the model on proprietary local data and improve the shared LLM’s performance. To exemplify FedChip ’s deployment, we create and release APTPU-Gen , a dataset of 30k design variations spanning various performance metric values such as power, performance, and area (PPA). To encourage the LLM to generate designs that achieve a balance across multiple quality metrics, we propose a new design evaluation metric, Chip@k , which statistically evaluates the quality of generated designs against predefined acceptance criteria. Experimental results show that FedChip improves design quality by more than 77% over high-end LLMs while maintaining data privacy. 1 1 1 Implementation and dataset are at https://github.com/ACADLab/FedChip . I Introduction The global Artificial Intelligence (AI) hardware market, fueled by innovations in deep learning accelerators, autonomous systems, and data-intensive applications, is expected to be worth $84.9 billion by 2031 [ 1 ] . Despite this growth, escalating design complexity and the need for specialized expertise [ 2 , 3 ] continue to pose significant challenges, making the process costly, time-intensive, and difficult to optimize for performance. To address these challenges, AI-based advancements in automated hardware design generation [ 4 , 5 , 6 , 7 ] are emerging as promising solutions, enabling faster, more cost-effective, and performance-optimized development. Among AI models, Large Language Models (LLMs) have a promising potential in automated hardware design generation due to their attractive abilities to incorporate domain-specific knowledge and enable human-level interaction with design workflows [ 6 , 8 , 5 , 9 ] . These abilities promise to open the design process to a broader range of developers. However, state-of-the-art LLMs such as OpenAI’s GPT-4o [ 10 ] and Anthropic’s Claude 3.5 Sonnet [ 11 ] struggle to consistently generate practical hardware designs. Common flaws in their outputs include hallucinated variables, particularly for small-scale circuits, and an inability to handle complex AI accelerators effectively [ 12 ] . The limitations of LLMs in hardware design stem from two key challenges: First , the lack of access to sufficient domain-specific training data due to privacy and Intellectual Property (IP) restrictions imposed by companies like NVIDIA, AMD, and Intel [ 13 , 14 ] . Concerns over data breaches and competitive risks further discourage data sharing [ 15 ] . Second , the complex trade-offs required in hardware design—balancing the power, performance, and area (PPA) metrics [ 16 ] —are highly workload-specific and demand detailed architectural expertise. Current LLMs lack domain-specific knowledge and precise control mechanisms to produce synthesizable and optimized designs. Addressing these challenges requires a collaborative framework that ensures data privacy while enabling specialized hardware design capabilities. Fig. 1: FedChip enables multi-party LLM fine-tuning for chip design. Federated learning (FL) [ 17 ] trains a shared model across multiple clients without sharing raw data, thereby promoting data privacy [ 18 , 19 ] . Therefore, FL is a promising framework for multi-party LLM training targeting automated hardware design generation. Recently, FL has been explored for fine-tuning LLMs across diverse tasks [ 20 , 21 , 22 ] , focusing on reducing computational overhead and handling clients with different tasks. However, existing methods are not directly applicable to automated hardware design generation, where generating descriptive text for designs involves balancing multiple, often conflicting [ 23 ] objectives such as PPA metrics. There is an urgent need for a novel FL-based LLM fine-tuning approach tailored to the unique requirements of automated hardware design generation. Contributions. Motivated by the above discussion, we propose FedChip illustrated in Fig. 1 , a novel FL-based fine-tuning framework designed for collaborative automated hardware design generation across multiple manufacturers. FedChip addresses the conflicting goals [ 23 ] inherent in hardware design by enabling privacy-preserving collaboration while optimizing PPA metrics. Our key contributions are: \bullet Curated Dataset : We introduce APTPU-Gen , a comprehensive dataset containing 30k hardware design variations annotated with PPA metrics, specifically designed to enhance LLM-based automated hardware design generation. The dataset is further clustered into sub-datasets reflecting the unique focuses of multiple hardware manufacturers, enabling realistic multi-party FL settings. \bullet A New FL Setting : We design and implement FedChip , a privacy-preserving FL framework that allows multiple hardware manufacturers to collaboratively fine-tune LLMs for domain-specific tasks without compromising proprietary data or intellectual property. \bullet Evaluation Metric : We propose a novel metric, Chip@k , to statistically evaluate generated hardware designs based on their adherence to predefined PPA quality criteria, promoting balanced optimization across multiple design parameters. \bullet Empirical Validation : Experimental results validating the effectiveness of the proposed FedChip in addressing privacy and hardware optimization challenges. FedChip is shown to improve design quality by more than 77% over high-end LLMs while preserving data privacy and addressing key trade-offs in hardware design. II Background LLMs for Hardware Design-Hardware Description is Text. LLMs, as state-of-the-art text-generative models, are naturally suited to automated hardware design generation tasks since hardware design representations like Hardware Description Language (HDL) and High-Level Synthesis (HLS) code are textual. This property has led to efforts to employ LLMs to automate and improve hardware workflows. Along this line, LLMs have been applied to automate hardware design at different abstraction levels, such as RTL [ 4 , 5 ] and Verilog HDL [ 6 , 7 ] . Furthermore, frameworks like GPT4AIGChip [ 8 ] and SA-DS [ 9 ] explore domain-specific applications, including accelerator design and dataset creation. Despite these advancements, current frameworks face fundamental challenges such as limited domain-specific datasets and the absence of fine-tuning, which can result in hallucinated outputs and suboptimal performance on complex tasks [ 5 , 9 ] . Fine-tuning, which can significantly improve LLM performance, is not yet widely applied in automated hardware design generation [ 24 ] . LLMs and Fine-tuning. Fine-tuning adapts general-purpose LLMs to domain-specific tasks by training on labeled datasets, enabling them to capture specialized patterns while maintaining their broad linguistic capabilities. This process improves task-specific performance metrics like accuracy and F1 score [ 25 , 26 , 27 ] . Furthermore, methods like low-rank adaptation (LoRA) and quantized LoRA (QLoRA) improve fine-tuning efficiency by selectively training a subset of model parameters while approximating the remaining ones, avoiding the need for full model retraining [ 28 , 29 ] . Hence, LLM fine-tuning is feasible on resource-constrained systems. However, the effectiveness of fine-tuning depends on high-quality domain data and robust evaluation metrics to ensure real-world applicability [ 30