Parallelizing a modern GPU simulator Conference: 2nd Workshop on Computer Architecture Modeling and Simulation; November 2, 2024; Austin, Texas, USA 2nd Workshop on Computer Architecture Modeling and Simulation (CAMS 2024), November 2, 2024, Austin, Texas, USA CCS: Computer systems organization Para

Rodrigo Huerta, Antonio González · 2025

Read Parallelizing a modern GPU simulator Conference: 2nd Workshop on Computer Architecture Modeling and Simulation; November 2, 2024; Austin, Texas, USA 2nd Workshop on Computer Architecture Modeling and Simulation (CAMS 2024), November 2, 2024, Austin, Texas, USA CCS: Computer systems organization Para by Rodrigo Huerta, Antonio González (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-14691.txt.

Introduction

Rodrigo Huerta and Antonio González speed up a tool that mimics graphics chips. Their 2025 paper starts from a pain point in chip research: one run of a modern simulator can take more than five days. Such tools are the main way teams test new chip designs before building them.

The pair split the simulator across many threads with a small set of code changes. The split version gives the same results as the single-thread run, with no loss of accuracy. On 16 threads it ran about six times faster on average, and up to 14 times faster on some jobs. A five-day job can now end in under 12 hours.

Catalog record

CREATORRodrigo Huerta, Antonio González
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-14691

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Parallelizing a modern GPU simulator Conference: 2nd Workshop on Computer Architecture Modeling and Simulation; November 2, 2024; Austin, Texas, USA 2nd Workshop on Computer Architecture Modeling and Simulation (CAMS 2024), November 2, 2024, Austin, Texas, USA CCS: Computer systems organization Parallel architectures CCS: Computer systems organization Single instruction, multiple data CCS: Computer systems organization Multicore architectures CCS: Computing methodologies Modeling and simulation CCS: Computing methodologies Parallel computing methodologies Rodrigo Huerta, Antonio González Abstract . Simulators are a primary tool in computer architecture research but are extremely computationally intensive. Simulating modern architectures with increased core counts and recent workloads can be challenging, even on modern hardware. This paper demonstrates that simulating some GPGPU workloads in a single-threaded state-of-the-art simulator such as Accel-sim can take more than five days. In this paper we present a simple approach to parallelize this simulator with minimal code changes by using OpenMP. Moreover, our parallelization technique is deterministic, so the simulator provides the same results for single-threaded and multi-threaded simulations. Compared to previous works, we achieve a higher speed-up, and, more importantly, the parallel simulation does not incur any inaccuracies. When we run the simulator with 16 threads, we achieve an average speed-up of 5.8x and reach 14x in some workloads. This allows researchers to simulate applications that take five days in less than 12 hours. By speeding up simulations, researchers can model larger systems, simulate bigger workloads, add more detail to the model, increase the efficiency of the hardware platform where the simulator is run, and obtain results sooner. 1. Introduction Computer architects use simulators to design new microarchitectures, conduct research, and propose new designs or optimizations to existing ones. In GPGPUs, one of the most popular simulators is Accel-sim ( Khairy et al. 2020 ) , based on GPGPUSim ( Bakhoda et al. 2009 ) . The Accel-sim framework can simulate modern NVIDIA GPU architectures such as Volta ( NVIDIA 2017 ) , Turing ( NVIDIA 2018b ) , Ampere ( NVIDIA 2020 ) , Ada ( NVIDIA 2022a ) , or Hopper ( NVIDIA 2022b ) . Previous works have reported that simulating GPU systems can be 44,000x slower in Multi2Sim ( Ubal et al. 2012 ) and 480,000x slower in GPGPU-Sim ( Malhotra et al. 2014 ) . The Accel-sim framework is single-threaded, and simulating some workloads requires an immense amount of time to complete. Figure 1 shows the time different applications take to be simulated in Accel-sim when executed in nodes with the specifications of Table 2. We can observe that many benchmarks require several hours to be simulated but some other applications such as mst , sssp , and lavaMD need much more time, close to three days ( >259200s ) for mst and sssp and more than five days ( >432000s ) for lavaMD . This long simulation runs compromise the amount of iterations in the typical research loop (propose a new feature, evaluate it) that can be performed and therefore, it limits the productivity of researchers. Figure 1. Time in seconds required to execute each workload with a single thread. In this paper, we propose to parallelize the Accel-sim simulator with a simple approach using OpenMP ( Dagum and Menon 1998 ) . This achieves very important reductions in simulation time. For instance, using 16 threads, we achieve an 5.8x average speed-up and up to 14x in some workloads. Besides, the user can easily configure how many threads each simulated workload will use, which provides several benefits. The main one is improving the efficiency of the hardware platform where simulations run by reducing the time unused cores are allocated by cluster schedulers such as SLURM ( Yoo et al. 2003 ) , which assigns cores to jobs when they demand a certain amount of RAM even if they do not perform any computation. Moreover, our proposal does not affect simulation accuracy, a very critical aspect, unlike previous works that parallelize GPGPU-Sim ( Lee and Ro 2013 ) ( Lee and Ro 2016 ) . As the modifications to execute the simulator in parallel are minimal and can be easily configured to be disabled and executed sequentially, debug tasks are as easy as in the vanilla simulator. In addition, our approach is compatible with other techniques that speed up simulation by using sampling ( Avalos Baddouh et al. 2021 ) , and others that reduce the detail of some components, such as NVAS ( Villa et al. 2021 ) . By speeding up simulators, researchers can model GPU architectures in more detail, simulate larger workloads and simulate bigger GPUs/multi-GPUs. The rest of this paper is organized as follows. In section 2 , we discuss previous works in the area. Section 3 analyses the code of Accel-sim and explains how its parallelization has been implemented. Then, we evaluate the benefits of parallelizing the simulator in section 4 . Finally, we summarize the main conclusions in section 5 . 2. Related Work Different GPU simulators have been developed to explore and propose architectural changes to these architectures. Some of the most popular ones are single-thread simulators, such as Multi2Sim ( Ubal et al. 2012 ) or GPGPU-Sim ( Bakhoda et al. 2009 ) . The former models the AMD Evergreen ( AMD 2011 ) architecture, while the latter models the NVIDIA Tesla ( Lindholm et al. 2008 ) . Recently, GPGPU-Sim was updated and renamed as the Accel-sim framework ( Khairy et al. 2020 ) to include some major features introduced in the NVIDIA Volta ( NVIDIA 2017 ) architecture. Some previous works have developed parallel GPU simulators. The first one is Barra ( Collange et al. 2010 ) , a GPU functional simulator focused on the NVIDIA Tesla architecture, which achieves a speed-up of 3.53x with 4 threads. However, this simulator models an old architecture and does not provide a timing model. Another work that models the NVIDIA Tesla architecture is GpuTejas ( Malhotra et al. 2014 ) , which includes a timing model and achieves a mean speed-up of 17.33x with 64 threads. Unfortunately, executing GpuTejas in parallel has an indeterministic behavior, leading to accuracy simulation errors of up to 7.7% compared to the single-threaded execution. One of the most successful parallel simulators is MGPUSim ( Sun et al. 2019 ) , an event-driven simulator that includes functional and timing simulation targeting the AMD GCN3 ( AMD 2016 ) . MGPUSim follows a conservative parallel simulation approach for parallelizing the different concurrent events during the simulation, preventing any deviation error from executing the simulator in parallel. It achieves a mean speed-up of 2.5x when executed with 4 threads. Several works have parallelized the GPGPU-Sim simulator. MAFIA ( Jog et al. 2015 ) can run different kernels concurrently in multiple threads but cannot parallelize single-kernel simulations. Lee et al. ( Lee and Ro 2013 ) ( Lee and Ro 2016 ) have proposed a simulator framework built on top of GPGPU-Sim. Their proposal needs at least three threads in order to run. Two threads are always dedicated to executing the Interconnect-Memory Subsystem and the Work Distribution and Control components. The rest of the threads are devoted to parallelizing the execution of the multiple SMs of the GPU. Lee et al.

Read the complete text