GaDE - GPU-acceleration of time-dependent Dirac Equation for exascale Journal: Computer Physics Communications

Johanne Elise Vembe, Marcin Krotkiewski, Magnar Bjørgve, Morten Førre, Hicham Agueny * · 2025

Read GaDE - GPU-acceleration of time-dependent Dirac Equation for exascale Journal: Computer Physics Communications by Johanne Elise Vembe, Marcin Krotkiewski, Magnar Bjørgve, Morten Førre, Hicham Agueny * (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-21697.txt.

Introduction

Johanne Elise Vembe, Hicham Agueny, and their co-authors present GaDE, a GPU solver for the time-dependent Dirac equation in three dimensions. The Dirac equation governs relativistic electrons, and solving it is how physicists simulate atoms blasted by intense laser fields. Such simulations are communication-heavy and demand the largest supercomputers.

GaDE combines message passing across machines with CUDA and HIP, so it runs on both NVIDIA and AMD processors, keeping most computation on the accelerators. The team evaluated it on LUMI, a supercomputer with AMD processors and a fast interconnect. Single-processor results were comparable between the AMD and NVIDIA cards tested, with the newest NVIDIA chip ahead. Scaling tests stood out: weak scaling kept about eighty-five percent efficiency across two thousand forty-eight processors. Strong scaling gave a sixteen-fold speedup on thirty-two processors. The solver targets exascale machines and laser-matter simulations.

Catalog record

CREATORJohanne Elise Vembe, Marcin Krotkiewski, Magnar Bjørgve, Morten Førre, Hicham Agueny *
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-21697

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

GaDE - GPU-acceleration of time-dependent Dirac Equation for exascale Journal: Computer Physics Communications Johanne Elise Vembe, Marcin Krotkiewski, Magnar Bjørgve, Morten Førre, Hicham Agueny * Abstract Modern heterogeneous high-performance computing (HPC) systems powered by advanced graphics processing unit (GPU) architectures enable accelerating computing with unprecedented performance and scalability. Here, we present a GPU-accelerated solver for the three-dimensional (3D) time-dependent Dirac Equation optimized for distributed HPC systems. The solver named GaDE is designed to simulate the electron dynamics in atoms induced by electromagnetic fields in the relativistic regime. It combines MPI with CUDA/HIP to target both NVIDIA and AMD GPU architectures. We discuss our implementation strategies in which most of the computations are carried out on GPUs, taking advantage of the GPU-aware MPI feature to optimize communication performance. We evaluate GaDE on the pre-exascale supercomputers, LUMI, powered by AMD MI250X GPU and the HPE’s Slingshot interconnect. Single GPU performance on NVIDIA A100, GH200 and AMD MI250X shows comparable performance between A100 and MI250X in compute and memory bandwidth, with GH200 delivering higher performance. Weak scaling on LUMI demonstrates exceptional scalability, achieving 85% parallel efficiency across 2048 GPUs, while strong scaling delivers a 16× speedup on 32 GPUs - 50% efficiency for a communication-intensive, time-dependent Dirac equation solver. These results demonstrate GaDE’s high scalability, making it suitable for exascale systems and enabling predictive simulations for ultra-intense laser experiments probing relativistic quantum effects. PROGRAM SUMMARY Program Title: GaDE Developer’s repository link: https://github.com/JVembe/dirac_hydrogen_code Licensing provisions: GPLv3 Programming language: C++, C 1 INTRODUCTION Advances in ultrafast laser technology have opened the possibility of visualizing and controlling the matter at the level of electrons [ 24 , 40 ] . Such progress has been guided by theoretical developments, which have been extensively focused on a non-relativistic quantum description of the dynamics of electrons induced by laser fields. This has been widely studied by solving the time-dependent Schrödinger equation (TDSE) covering a broad wavelength range (see [ 43 , 2 , 16 ] and references therein). However, a comprehensive picture of this dynamics in the relativistic regime is still missing, especially in the long-wavelength region and for large quantum systems. This requires solving the time-dependent Dirac equation (TDDE), which provides an accurate relativistic description of the electron dynamics induced by electromagnetic fields. It is well-recognized that solving the TDDE presents some numerical challenges (see e.g. [ 39 , 34 , 11 , 21 , 22 ] ). This is mainly due to numerical artifact caused by (i) fermion doubling problem arising from the discretization of the derivative operator. This makes it difficult to ensure conservation of the current density on the grid [ 33 , 34 , 39 ] . (ii) Simulation in a finite box, which requires careful consideration of the spurious reflection of the time-dependent wavefunction on the edges, for example by use of absorbing potentials [ 33 , 3 , 5 ] . (iii) Treatment of potentials with singularities, in particular the Coulomb potential. All of these issues play a role in determining which discretization methods are feasible in solving the TDDE. On the time evolution side, solving the TDDE additionally requires refined temporal and spatial grids, due to the presence of negative energy solutions whose influence on the dynamics of the electron are known as zitterbewegung [ 28 ] , a rapid oscillatory motion of the electron occurring on the Compton time scale, t\propto\frac{\hbar}{mc^{2}} . The need to resolve these phenomena renders the numerical solution computationally intensive for laser-matter interaction, as these processes take place at a significantly larger time scale than the zitterbewegung. Addressing these issues requires combining sophisticated numerical schemes with computational models that utilize advanced computer architecture. So far, existing Dirac-based solvers are mostly limited to a serial implementation of the time-independent Dirac equation developed for atomic structure calculations [ 14 , 13 ] and to a parallel implementation of the TDDE that utilizes the Message Passing Interface (MPI) library [ 4 , 21 , 9 ] . In these cases, the performance analysis was performed solely on strong scaling and that the solver’s scalability was limited to a maximum of 256 MPI-processes (e.g. in [ 4 ] the reported parallel efficiency was 25 % for the 3D-model). Here, although strong scaling measures the parallel efficiency of a solver for a fixed problem size as the number of processes increases, it does not provide a complete picture of a solver’s scalability, especially when both problem size and computational resources grow proportionally. On the other hand, there has been an attempt to utilize the graphics processing unit (GPU) to solve the TDDE by implementing the CUDA programming model [ 8 ] . However, the implementation was limited to a two-dimensional (2D) scheme of the TDDE, and the solver was designed specifically to target a single GPU. Therefore, there is a need for developing optimized TDDE-based solvers to leverage modern heterogeneous high-performance computing (HPC) systems; thus guiding the scientific community towards conducting accurate simulations in the relativistic regime. This in turn will help explore new physics to advance our understanding of the relativistic light-matter interaction. In recent years, there has been great interest in utilizing GPU accelerators for high-performance computing [ 31 , 44 , 36 , 12 , 17 ] . These graphics accelerators have the potential to accelerate computing significantly over traditional central processing units (CPUs) (see e.g. [ 8 , 23 ] ). This is primarily attributed to the massive processing capability of the GPU accelerators designed with a vast array of parallel processing units, which make them ideal for high throughput computing. The latter has been identified as an important factor for future design of hardware architecture [ 6 ] . And because of their computing power, GPUs are integrated into HPC systems. Currently, the world’s 5 most powerful supercomputers are powered by GPUs [ 41 ] , indicating their essential role in exploring the performance and scalability of scientific applications to improve their efficiency. For instance, a GPU-enabled simulation of 3D turbulence with a resolution of up to 35 trillion grid points has been reported to be performed on up to 4096 compute nodes of Frontier , the world’s second exascale supercomputer [ 44 ] . Other GPU-enabled simulations of turbulent flows have been executed on up to 256 and 512 compute nodes, respectively, on the two largest EuroHPC pre-exascale systems, LUMI and Leonardo [ 36 ] . It therefore becomes apparent that developing solvers that effectively harness the power of GPU accelerators in large HPC systems can significantly enhance computational efficiency and performance. Motivated by the general interest of studying the quantum electron motion in the relativistic regime and by the highly parallel architecture and high-throughput of GPU accelerators, we develop a GPU-based solver named GaDE to simulate the 3D-TDDE. The implementation combines MPI and the CUDA/HIP programming model and takes advantage of the GPU-aware MPI feature to further enhance performance by reducing latency [ 38 ] . Such a combination offers the potential to utilize multiple GPUs across multiple nodes in modern heterogeneous HPC systems. The solver GaDE is portable and can be compiled on both AMD GPUs and NVIDIA GPUs. Our implementation is designed to utilize efficient numerical schemes that combine the use of

Read the complete text