CHICO-Agent: An LLM Agent for the Cross-layer Optimization of 2.5D and 3D Chiplet-based Systems

Qihang Wu, Aman Arora, Vidya A. Chhabria · 2026

Read CHICO-Agent: An LLM Agent for the Cross-layer Optimization of 2.5D and 3D Chiplet-based Systems by Qihang Wu, Aman Arora, Vidya A. Chhabria (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18764.txt.

Introduction

Wu, Arora, and Chhabria propose CHICO-Agent, a language-model framework for optimizing 2.5D and 3D chiplet systems across application, architecture, chip, and package levels. Monolithic silicon has hit reticle and economic limits as large models and AI workloads grow, pushing chiplet adoption. CHICO-Agent keeps a knowledge base of parameter-outcome trends and coordinates search through an admin-field multi-agent workflow. Against a simulated-annealing baseline, it finds lower-cost designs and leaves a clear audit trail for designers.

Catalog record

CREATORQihang Wu, Aman Arora, Vidya A. Chhabria
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38249
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.18764

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CHICO-Agent: An LLM Agent for the Cross-layer Optimization of 2.5D and 3D Chiplet-based Systems Qihang Wu, Aman Arora, Vidya A. Chhabria Abstract The rapid growth of large language models (LLMs) and AI workloads has pushed monolithic silicon to its reticle and economic limits, accelerating the adoption of 2.5D/3D chiplet systems. However, these systems increase design complexity by requiring co-design across multiple levels of the computing stack, including application, architecture, chip, and package. The resulting design space is highly combinatorial, with trade-offs among latency, energy, area, and cost. To address this challenge, we propose CHICO-Agent, an LLM-driven optimization framework for 2.5D/3D chiplet-based systems. CHICO-Agent maintains a persistent knowledge base to capture parameter–outcome trends and coordinates exploration through an admin–field multi-agent workflow. Compared with a simulated-annealing baseline, CHICO-Agent finds lower-cost configurations and provides an interpretable audit trail for designers. I Introduction Motivation. The rapid growth of artificial intelligence (AI) workloads has pushed monolithic silicon to its physical and economic limits, driving the adoption of heterogeneous integration (HI) using 2.5D and 3D chiplet-based architectures. In these systems, designs are partitioned into smaller dies interconnected through advanced packaging to improve yield, reduce costs, and enable chiplet reuse. However, HI systems require cross-layer co-design across application, architecture, chiplet, and packaging levels, as illustrated in Fig. 1 . Decisions at one layer influence others; for example, workload partitioning affects communication patterns, which impact interconnect topology, packaging, and metrics such as latency, energy, area, and cost. The many variables across these layers create a combinatorial design space, making exhaustive exploration infeasible and necessitating automated design space exploration (DSE) and optimization. Limitations of Existing Exploration Methods. Prior work has developed modeling and simulation frameworks to estimate system-level metrics, including performance, power, area, and cost (PPAC), for chiplet-based architectures. HISIM [ 14 ] provides analytical models for evaluating performance trade-offs in 2.5D and 3D systems, while CATCH [ 5 ] focuses on cost modeling. These frameworks enable evaluation of candidate architectures. However, relatively little work has addressed optimization and exploration of chiplet design spaces. As architectural, chiplet, and packaging parameters grow, manual exploration and parameter sweeps become infeasible. A few works explore automated DSE for chiplet systems. ChipletGym [ 9 ] formulates exploration as a reinforcement learning problem, while CarbonPATH [ 12 ] uses simulated annealing (SA). However, these approaches rely on stochastic search or metaheuristics that explore the space through random perturbations and iterative evaluation [ 12 , 9 ] . As a result, they can become trapped in local minima and often require careful hyperparameter tuning to obtain high-quality solutions. Moreover, many black-box search methods used for chiplet DSE do not maintain an explicit, human-interpretable knowledge, which limits how directly designers can reuse discovered cross-layer patterns. This limits the designer and/or optimizer to exploit relationships across architecture, chiplet, and packaging parameters. LLM-guided Reasoning for Design Space Exploration. Recent advances in large language models (LLMs) have demonstrated strong capabilities in reasoning, planning, and iterative problem solving [ 16 ] . These models can synthesize structured knowledge, identify relationships among variables, and refine solutions based on historical observations, creating an opportunity to rethink traditional hardware design optimization and design space exploration strategies. Instead of relying solely on stochastic perturbations, LLMs can guide the search by reasoning over previously evaluated configurations and identifying promising regions of the design space. LLMs have also been explored for DSE in chip design. MAHL [ 13 ] uses multi-agent LLMs to generate hierarchical chiplet RTL designs with adaptive debugging, targeting synthesis and PPA optimization. 3D-CIMlet [ 4 ] proposes a co-design framework for 3D compute-in-memory chiplets for edge LLM inference. ChatNeuroSim [ 7 ] employs LLM agents to automate compute-in-memory simulator workflows with design space pruning. However, these works address different design problems. Our work focuses on cross-layer system configuration, identifying chiplet counts and types, memory technologies, workload mapping strategies, packaging architectures, and interconnect choices to satisfy PPAC constraints for a given workload. Fig. 1: Computing stack highlighting the searchable design space spanning different levels, for 2.5D and 3D chiplet-based systems. Our Contribution. CHICO-Agent uses LLM reasoning to perform cross-layer DSE across the compute stack by iteratively analyzing historical PPAC evaluations to identify parameter–metric relationships and propose optimized configurations. The contributions are: • We develop CHICO-Agent , an LLM-guided framework for cross-layer optimization of chiplet architectures that reasons over previously evaluated designs to guide exploration. • CHICO-Agent and its LLM reasoning can identify higher-quality system configurations than metaheuristic baselines. • CHICO-Agent significantly reduces the hyperparameter tuning burden inherent to traditional metaheuristics. • We show that the reasoning traces generated by the LLM provide interpretable rationales linking design parameter changes to PPAC outcomes, offering actionable insights for designers. CHICO-Agent is available on an anonymized GitHub repository [ 3 ] . II Preliminaries Analytical Modeling of Chiplet-Based Systems Designing chiplet-based systems requires evaluating a large number of candidate system configurations that span multiple design dimensions. Accurately evaluating each system configuration using detailed simulation or full-system modeling can be computationally expensive, making such approaches impractical for large-scale DSE. To address this challenge, prior work has developed analytical models that estimate system-level metrics as functions of architectural and packaging parameters [ 9 , 12 , 14 ] . Analytical models provide fast approximations of PPAC metrics such as system performance, power, area, and costs by developing models across the compute stack. In our work, we leverage existing analytical models from [ 12 ] to model PPAC, and we focus on an optimization framework that combines these models with LLMs to search the design space. Optimization and DSE for Chiplet-based Systems. The DSE problem is formulated as an optimization problem, with the goal of minimizing a cost function given the target workload and application profile . The target workload specifies the computation to be accelerated (e.g., a GEMM operator defined by its tensor dimensions and batch size); it determines the volume of computation, data movement, and inter-chiplet communication, and therefore directly influences all PPAC metrics. The application profile assigns weighting coefficients to the PPAC objectives, reflecting deployment-specific priorities—for instance, a wearable application emphasizes energy and area, whereas an automotive application prioritizes latency and manufacturing cost. The cost function integrates multiple design objectives into a single scalar metric, enabling the optimizer to compare alternative solutions quantitatively. In CHICO-Agent, the cost function is: \begin{split}\text{System Cost}(\mathbf{x})={}&\alpha\,E_{\text{system}}(\mathbf{x})+\beta\,A_{\text{system}}(\mathbf{x})\\ &+\gamma\,L_{\text{system}}(\mathbf{x})+\theta\,C_{\text{system}}(\mathbf{x})\end{split} (1) where \mathbf{x} is a system configuration, and \alpha , \beta , \gamma , and \theta are application-specific weighting coefficients for energy, area, latency, and manufacturing cost, respectively. Formally, the goal is to find a system configuration \mathbf{x} that minimizes the system cost for the specific workload and optimization profile: \mathbf{x}^{*}=\arg\min_{\mathbf{x}\in\mathcal{X}}\;\text{System Cost}(\mathbf{x})\vskip-2.84526pt (2) where \mathcal{X} denotes the set of feasible configurations. Each of the terms in the cost function are unit-converted and normalized to their median value of 10,000 different system configurations of \mathbf{x} [ 12 ] . The configuration vector \mathbf{x} is a selection of design parameters spanning four levels of the compute stack as defined in Fig. 1 and described below [ 12 ] : • Application & Mapping: the dataflow strategy (output-stationary (OS), weight-stationary (WS), or input-stationary (IS)) determines which tensor operand is maximally reused in the on-chip buffer; the workload assignment order (ascending or descending) controls whether GEMM tiles are allocated

Read the complete text