On the Challenges of Energy-Efficiency Analysis in HPC Systems: Evaluating Synthetic Benchmarks and Gromacs Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY

Rafael Ravedutti Lucio Machado, Jan Eitzinger, Georg Hager, Gerhard Wellein · 2025

Read On the Challenges of Energy-Efficiency Analysis in HPC Systems: Evaluating Synthetic Benchmarks and Gromacs Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY by Rafael Ravedutti Lucio Machado, Jan Eitzinger, Georg Hager, Gerhard Wellein (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-03697.txt.

Introduction

Rafael Machado and colleagues report, candidly, how hard it is to measure energy efficiency honestly on supercomputers. Their 2025 paper tests synthetic benchmarks and the Gromacs molecular dynamics package on two German clusters, Fritz and Alex. Intel and Nvidia hardware both came under the meters.

Runs used full sockets with MPI parallelism while Likwid and vendor profiling tools recorded power and performance. The metrics those tools return hide pitfalls the team hit repeatedly, from sampling quirks to attribution traps. Results are presented alongside the mistakes, deliberately. Their closing best practices aim to save the next efficiency study from the same misreadings.

Catalog record

CREATORRafael Ravedutti Lucio Machado, Jan Eitzinger, Georg Hager, Gerhard Wellein
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-03697

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

On the Challenges of Energy-Efficiency Analysis in HPC Systems: Evaluating Synthetic Benchmarks and Gromacs Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY Rafael Ravedutti Lucio Machado, Jan Eitzinger, Georg Hager, Gerhard Wellein Abstract . This paper discusses the challenges encountered when analyzing the energy efficiency of synthetic benchmarks and the Gromacs package on the Fritz and Alex HPC clusters. Experiments were conducted using MPI parallelism on full sockets of Intel Ice Lake and Sapphire Rapids CPUs, as well as Nvidia A40 and A100 GPUs. The metrics and measurements obtained with the Likwid and Nvidia profiling tools are presented, along with the results. The challenges and pitfalls encountered during experimentation and analysis are revealed and discussed. Best practices for future energy efficiency analysis studies are suggested. 1. Introduction High-performance computing (HPC) systems are essential for advancing research and solving complex problems in many fields, such as molecular dynamics, biomedical simulations, and artificial intelligence. However, the growing scale and complexity of modern HPC infrastructures has led to a significant increase in energy consumption, creating challenges in terms of cost, sustainability, and system reliability. As energy becomes a limiting factor in system scalability and efficiency, it is increasingly important to conduct a comprehensive energy analysis. This paper evaluates various aspects of conducting research experiments on HPC energy efficiency analysis. It examines the power usage of synthetic benchmarks and real application codes to understand the practical differences between them and to demonstrate how simple benchmarks can be useful to understand the energy and performance characteristics of modern architectures. Gromacs ( 9 ) , a molecular dynamics package with a primary focus on life-science simulations, is used as a real-world application. This software is renowned for its high performance on HPC systems comprising both CPUs and GPUs. The MD-Bench ( 10 ) prototyping harness for MD simulations is used as an additional benchmark. It contains short-range force calculation kernel implementations that use the Cluster Pair data structure introduced by Gromacs to exploit optimal SIMD usage on modern CPUs and GPUs. The experiments were conducted on two clusters: the Fritz cluster, which consists of Intel Ice Lake (ICX) and Sapphire Rapids (SPR) nodes, and the Alex cluster, which consists of nodes with Nvidia A40 and A100 GPUs. The objectives are to (a) understand how different settings, such as power-capping limits and frequency, affect performance and energy efficiency in various simulation scenarios and hardware, and (b) share the insights gained from this systematic study and explain how performance metrics can be presented for a meaningful energy efficiency analysis. Section 1.1 displays related work on the analysis of energy consumption and efficiency of HPC applications. Section 2 provides a theoretical background on Gromacs and the performance monitoring tools utilized in this work. Section 4 displays the challenges and results from our measurements, as well as a discussion on the pitfalls when doing research on performance and energy efficiency analysis on HPC systems. Finally, Section 5 provides the conclusions and outlines of this work. 1.1. Related Work As power constraints increasingly limit scalability in HPC systems, energy efficiency analysis at the application level has gained significant attention. Although some research focuses on system-level optimizations and power management techniques, such as DVFS ( 1 ; 5 ; 15 ) and power capping ( 4 ; 7 ; 13 ) , with little focus on specific applications and hardware, many studies focus on understanding and improving the energy behavior of scientific applications themselves on specific machines. Analysis at the application level for a specific hardware is crucial because energy consumption is determined by hardware characteristics, algorithmic choices, communication patterns, and computational intensity. Several studies have examined the energy-to-solution and performance trade-offs of representative scientific workloads, including molecular dynamics ( 11 ) , computational fluid dynamics ( 2 ) , and numerical linear algebra ( 12 ; 8 ) . These studies often use measurement frameworks such as Likwid, Intel RAPL, or NVIDIA’s NVML to collect power and performance metrics with high granularity. By correlating these measurements with computational phases (i.e. force calculations, solver steps, or communication regions), researchers can identify the code sections that are responsible for the majority of energy consumption and then evaluate whether these can be improved. In addition to the correlation and characterization of the energy and power consumption of one or more applications, there are studies that focus on providing analytic models to predict the performance and energy consumption of modern multi-core processors as a function of relevant parameters, such as frequencies and the number of active cores ( 3 ; 6 ) . These studies must be validated through synthetic benchmarks and real-world applications. Therefore, using a consistent methodology can help identify and overcome obstacles. 2. Background and Theory 2.1. Gromacs Gromacs is an open-source molecular dynamics simulation package designed to simulate systems at the atomic level, particularly biomolecular systems. It implements advanced integrators and constraint solvers, as well as algorithms for treating long-range interactions, such as the Particle-Mesh Ewald method. It also provides data structures for efficiently computing short-range atomic forces. Its popularity comes from its combination of numerical accuracy, high efficiency, and portability across a range of hardware platforms. Performance optimization has been a central objective throughout the development of Gromacs. The software exploits multiple levels of parallelism, including SIMD vectorization, OpenMP threading, MPI distribution, and GPU acceleration. Its hybrid parallelization strategy enables efficient use of heterogeneous architectures ranging from desktop workstations to top supercomputers. A distinctive feature of Gromacs parallelization is the separation of tasks between particle–particle (PP) computations, which dominate short-range force calculations, and PME computations for long-range electrostatics. Dedicated MPI ranks can be assigned exclusively to PME, while others focus on PP, reducing the cost and overhead from communication (MPI reductions from the PME algorithm only need to be done for dedicated PME ranks) and improving scalability on large systems. Combined with domain decomposition and dynamic load balancing, this strategy allows Gromacs to efficiently simulate systems with millions of atoms and to maintain high parallel efficiency on thousands of cores. A key optimization in Gromacs for short-range non-bonded interactions is the Cluster Pair (CP) algorithm. Instead of evaluating forces between individual particle pairs, particles are grouped into small spatial clusters (typically containing 4–8 atoms), and all interactions between two such clusters are computed in a single operation. This design improves data locality, reduces branching, and enables efficient use of SIMD vectorization on modern CPUs as well as massive parallelism on GPUs. In contrast, other MD packages rely primarily on Verlet neighbor-lists, where each atom maintains a list of neighbors within a cutoff distance (plus a buffer). While Verlet lists are conceptually simple and robust, they lead to irregular memory access patterns and often result in less efficient use of SIMD units, since they require the usage of gather instructions. The CP algorithm can be seen as an extension of the Verlet approach, since it also relies on neighbor searching, but it organizes the neighbor list at the cluster level rather than per atom. Besides, it also stores atom properties (such as positions, velocities and forces) in an array-of-struct-of-arrays (AoSoA) layout, where data from atoms in the same cluster is

Read the complete text