CHIPSIM: A Co-Simulation Framework for Deep Learning on Chiplet-Based Systems
Lukas Pfromm 1 , Alish Kanani 1 , Harsh Sharma 2 , Janardhan Rao Doppa 2 , Partha Pratim Pande 2 , Umit Y. Ogras 1 · 2025
Read CHIPSIM: A Co-Simulation Framework for Deep Learning on Chiplet-Based Systems by Lukas Pfromm 1 , Alish Kanani 1 , Harsh Sharma 2 , Janardhan Rao Doppa 2 , Partha Pratim Pande 2 , Umit Y. Ogras 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-25958.txt.
Introduction
Lukas Pfromm, Alish Kanani, Harsh Sharma, Janardhan Rao Doppa, Partha Pratim Pande, and Umit Y. Ogras present a simulator for deep learning on chiplet based hardware. A chiplet system builds a processor from smaller dies linked over an interposer, which helps yield and scale as single large chips struggle to meet compute and memory demand. Fast, accurate simulation is needed to design such systems well.
Their framework, CHIPSIM, models compute and communication together, capturing network contention and pipelining that other simulators miss. It also profiles power for each chiplet and link at microsecond scale for heat analysis. Tests with mixed chiplet and network designs show versatility and up to a three hundred forty percent accuracy improvement in their comparisons.
Catalog record
| CREATOR | Lukas Pfromm 1 , Alish Kanani 1 , Harsh Sharma 2 , Janardhan Rao Doppa 2 , Partha Pratim Pande 2 , Umit Y. Ogras 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-25958
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CHIPSIM: A Co-Simulation Framework for Deep Learning on Chiplet-Based Systems Lukas Pfromm 1 , Alish Kanani 1 , Harsh Sharma 2 , Janardhan Rao Doppa 2 , Partha Pratim Pande 2 , Umit Y. Ogras 1 Abstract Due to reduced manufacturing yields, traditional monolithic chips cannot keep up with the compute, memory, and communication demands of data-intensive applications, such as rapidly growing deep neural network (DNN) models. Chiplet-based architectures offer a cost-effective and scalable solution by integrating smaller chiplets via a network-on-interposer (NoI). Fast and accurate simulation approaches are critical to unlocking this potential, but existing methods lack the required accuracy, speed, and flexibility. To address this need, this work presents CHIPSIM, a comprehensive co-simulation framework designed for parallel DNN execution on chiplet-based systems. CHIPSIM concurrently models computation and communication, accurately capturing network contention and pipelining effects that conventional simulators overlook. Furthermore, it profiles the chiplet and NoI power consumptions at microsecond granularity for precise transient thermal analysis. Extensive evaluations with homogeneous/heterogeneous chiplets and different NoI architectures demonstrate the framework’s versatility, up to 340% accuracy improvement, and power/thermal analysis capability. , I Introduction Deep neural networks (DNNs) require increasingly powerful systems due to their growing size and computational demands [ 1 ] . Traditional monolithic 2D chips have grown substantially to keep up with the exponential increase in model parameters and processing requirements. However, monolithic chips becomes less economical to manufacture due to declining yield as chip size increases [ 2 ] . These trends have driven a new advanced packaging and heterogeneous integration approach using smaller dies called chiplets [ 3 , 4 ] . Chiplet-based systems integrate many chiplets into a single package, as illustrated in Figure 1 . Each chiplet has a lower manufacturing cost than a monolithic chip due to its small size and higher yield [ 5 , 3 ] . Combining chiplets into a single package can deliver higher performance and energy efficiency than monolithic systems at comparable costs. Moreover, the greater modularity and heterogeneity enrich the design space, enabling systems tailored to specific application requirements [ 6 ] . Chiplet-based systems have experienced widespread adoption in both academia and industry. Studies in this area have explored various topics, including network topology, packaging, interconnects, power and thermal analysis, and application mapping [ 7 ] . In parallel, industry adoption has also accelerated, with notable examples such as NVIDIA’s B200 [ 8 ] , Intel’s Agilex and Meteor Lake [ 9 , 10 ] , AMD’s Ryzen, EPYC, and Instinct [ 4 ] , and other commercial products built on chiplet architectures. Federal funding initiatives, like the National Advanced Packaging Manufacturing Program (NAPMP) and Scalable Memory Architecture Program, have also been launched to support chiplet-based system development [ 11 , 12 ] . This convergence of academic research, industrial implementation, and strategic initiatives underscores the importance of chiplets and the supporting tools for their development. Fig. 1: An illustration of the CHIPSIM framework on a non-mesh heterogeneous chiplet-based system. Chiplet-based systems require fast and accurate evaluation methods to quantify the trade-off between competing objectives, such as performance, energy efficiency, and temperature. Simulations are essential throughout the design process, from early exploration and chiplet selection to floorplanning and workload mapping, especially when hardware prototypes are unavailable. Navigating complex and conflicting constraints to meet the design objectives is intractable without reliable tools. Large-scale heterogeneous architectures and target workloads further increase the complexity. As design complexity grows, fast and accurate simulation is key to enabling iteration, guiding decisions, and driving innovation. Current research on chiplet-based systems relies on simulation methods that are accurate but slow and inflexible or fast but inaccurate, as illustrated in Figure 2 . For instance, when cycle-level accuracy is needed, gem5 [ 13 , 14 ] can simulate the computations, while HeteroGarnet [ 15 ] or Booksim [ 16 ] simulates communication. However, gem5 is slow and has limited support for alternative processing technologies beyond CMOS designs. To achieve faster simulations or explore novel configurations such as chiplets based on in-memory computing (IMC), researchers frequently combine existing simulators in an ad-hoc fashion. Specifically, the computation and communication phases of the target applications are considered separately, with limited interaction between them [ 17 , 18 , 19 , 20 , 21 ] . Improvised methods cannot accurately capture complex behaviors like traffic contention and pipelining of DNN model layers, which can impact the simulation performance results by more than 340%, as we demonstrate in Section V . Moreover, decoupling computation and communication prevents a coherent notion of time , making modeling time-based behavior such as transient power analysis impossible. Thermal analysis, a crucial aspect of chiplet-based systems, requires time-based power consumption. Therefore, chiplet-based systems need fast, accurate, and modular co-simulation approaches. This paper introduces CHIPSIM, a co-simulation framework for chiplet-based systems executing DNN models. While co-simulation has been explored in other domains, CHIPSIM is the first framework to apply this methodology to chiplet-based architectures. In addition to co-simulation, CHIPSIM coordinates computation and communication phases under a unified notion of global simulation time, enabling concurrent execution of multiple DNN models while accurately capturing their interactions and system-level effects. CHIPSIM begins by simulating the first layer of the target DNN workload. Upon completion, it simulates the communication of the resulting activations to the chiplet that will run the consecutive layer. This way, computation and communication events are simulated in tandem while keeping track of the global time. When multiple DNN models arrive in a stream and must execute in parallel on the same system, CHIPSIM orchestrates concurrent computation and communication simulations while accurately capturing their interactions and impacts on each other. For example, the communication simulation at any given time accounts for all active chiplet-to-chiplet data movement of all DNNs in the system to capture network contention accurately. Our results show contention becomes a dominant factor in communication latency, especially during highly utilized times, yet it remains unmodeled by current approaches . Fig. 2: A visual comparison between existing simulators and the proposed simulation methodology. As a critical and novel aspect, CHIPSIM incorporates a detailed power tracking mechanism that generates power and thermal profiles with microsecond-level granularity for every chiplet. These power profiles enable transient and steady-state thermal analysis. Additionally, CHIPSIM supports both heterogeneous chiplet types and custom network-on-interposer (NoI) topologies to support extensive design-space exploration and diverse configurations. Due to its modularity, CHIPSIM can utilize different computation and communication simulators. In this work, we primarily target IMC chiplets simulated using CimLoop [ 22 ] and use HeteroGarnet [ 15 ] for communication. However, we perform additional hardware validations where CiMLoop is replaced with an analytical compute model. We emphasize that the proposed framework is not limited to any processing technology or choice of simulators . The key contributions of this work are as follows: • A comprehensive co-simulation framework that captures the salient features of hardware execution by modeling computation and communication events, • A concrete realization with open-source tools and modular support for heterogeneous chiplets and NoI topologies, • Comprehensive evaluations with three different system configurations that demonstrate up to 340% higher accuracy and enable transient power/thermal analysis—capabilities not possible with existing approaches. • Open-sourced code for the created tool available at github.com/LukasPfromm/CHIPSIM . The