Mixed-Precision Performance Portability of FFT-Based GPU-Accelerated Algorithms for Block-Triangular Toeplitz Matrices DOI: XXXXXXX.XXXXXXX Conference: International Workshop on Performance, Portability & Productivity in HPC; November 16–21, 2025; St. Louis, MO CCS: General and reference Performance

Sreeram Venkat, Kasia Świrydowicz, Noah Wolfe, Omar Ghattas · 2025

Read Mixed-Precision Performance Portability of FFT-Based GPU-Accelerated Algorithms for Block-Triangular Toeplitz Matrices DOI: XXXXXXX.XXXXXXX Conference: International Workshop on Performance, Portability & Productivity in HPC; November 16–21, 2025; St. Louis, MO CCS: General and reference Performance by Sreeram Venkat, Kasia Świrydowicz, Noah Wolfe, Omar Ghattas (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-10202.txt.

Introduction

Supercomputers now speak many GPU dialects, and code written for one vendor's chips strands itself. Sreeram Venkat and co-authors freed an application that multiplies matrices with a special repeating structure, needed in wave and control problems. They translated it on the fly from its original CUDA form so it could run on AMD hardware.

Speed tricks were folded into AMD's open mathematics library, leaving the application untouched. A second framework then mixes number precisions operation by operation, choosing along a trade-off curve between speed and error tolerance. The portable, precision-tuned code scaled to over four thousand GPUs on the Frontier supercomputer, spanning three generations of AMD chips, evidence that performance need not be sacrificed for portability.

Catalog record

CREATORSreeram Venkat, Kasia Świrydowicz, Noah Wolfe, Omar Ghattas
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-10202

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Mixed-Precision Performance Portability of FFT-Based GPU-Accelerated Algorithms for Block-Triangular Toeplitz Matrices DOI: XXXXXXX.XXXXXXX Conference: International Workshop on Performance, Portability & Productivity in HPC; November 16–21, 2025; St. Louis, MO CCS: General and reference Performance CCS: Theory of computation Approximation algorithms analysis Sreeram Venkat, Kasia Świrydowicz, Noah Wolfe, Omar Ghattas Abstract . The hardware diversity displayed in leadership-class computing facilities, alongside the immense performance boosts exhibited by today’s GPUs when computing in lower precision, provide a strong incentive for scientific HPC workflows to adopt mixed-precision algorithms and performance portability models. We present an on-the-fly framework using Hipify for performance portability and apply it to FFTMatvec—an HPC application that computes matrix-vector products with block-triangular Toeplitz matrices. Our approach enables FFTMatvec, initially a CUDA-only application, to run seamlessly on AMD GPUs with excellent observed performance. Performance optimizations for AMD GPUs are integrated directly into the open-source rocBLAS library, keeping the application code unchanged. We then present a dynamic mixed-precision framework for FFTMatvec; a Pareto front analysis determines the optimal mixed-precision configuration for a desired error tolerance. Results are shown for AMD Instinct™ MI250X, MI300X, and the newly launched MI355X GPUs. The performance-portable, mixed-precision FFTMatvec is scaled to 2,048 GPUs on the OLCF Frontier supercomputer. 1. Introduction As the artificial intelligence (AI) market continues to drive GPU technology, hardware advancements are largely focused on accelerating lower precision computing power. As a result, GPUs such as the AMD 1 1 1 AMD, the AMD Arrow logo, and combinations thereof are trademarks of Advanced Micro Devices, Inc. Instinct™ MI355X and NVIDIA B200 have much higher peak throughputs for single (FP32) and half (FP16) precision workloads than for double (FP64) precision workloads. In addition, many consumer-grade GPUs have limited or no native FP64 support at all, and resort to emulation for double-precision calculations ( Göddeke et al. 2007 ) . It is important that traditional scientific high performance computing (HPC) workflows and algorithms are poised to take advantage of the advancements and trends in hardware. The prevailing methodology for this is to identify the computational portions of the scientific workflows that can be computed in lower precisions while maintaining a satisfactory level of accuracy in the final result. Examples of this methodology include iterative refinement in solving linear systems ( Carson and Higham 2018 ) , strategies to lower the precision of various components of linear solvers (i.e., preconditioner or matrix-vector product), see, for instance, ( Buttari et al. 2007 ; Guo et al. 2025 ) and the Ozaki scheme for matrix multiplication ( Buttari et al. 2007 ; Ozaki et al. 2025 ) . Techniques for inserting mixed precision into scientific workloads have been in the spotlight for the last decade: see ( Abdelfattah et al. 2021 ; Kashi et al. 2024 ) and the references therein. By utilizing lower precision to compute intermediate results and switching to higher precision for final accumulations or calculation of residuals, these mixed-precision algorithms provide significant speedups over their traditional, full double-precision counterparts. Iterative methods maintain the desired level of accuracy in the final result by taking more iterations, though the cost of each (lower-precision) iteration is reduced. Similarly, the Ozaki scheme incurs increased memory utilization to store decomposed, lower-precision matrices. However, by doing so, the Ozaki scheme can leverage matrix/tensor cores on GPUs that have much higher throughputs for lower-precision workloads. Another important consideration in the field of HPC application development is that of performance portability. DOE leadership-class computing facilities remain diversified across various vendors—with the Oak Ridge Leadership Computing Facility’s Frontier and Lawrence Livermore National Laboratory’s El Capitan systems using AMD hardware, the National Energy Research Scientific Computing’s Perlmutter and newly announced Doudna systems using NVIDIA hardware, and the Argonne Leadership Computing Facility’s Aurora system using Intel hardware. In addition, many new specialized AI chips from companies such as Cerebras are also being considered for scientific HPC workflows ( Ltaief et al. 2023 ) . The Exascale Computing Project from the DOE led to the development of many performance portability frameworks including Kokkos and Raja ( Trott et al. 2021 ; Beckingsale et al. 2019 ) . The SYCL C++ programming model from the Khronos group, the OCCA portability framework from Argonne National Laboratory and the Legion programming system from Stanford ( Reyes and Lomüller 2016 ; Medina et al. 2014 ; Bauer et al. 2012 ) are further alternatives for performance portability. These portability frameworks provide abstraction layers that allow users to implement parallel algorithms in a vendor-agnostic manner. They can be particularly useful when developing new applications or software libraries ( Paunović et al. 2024 ; Deakin and McIntosh-Smith 2020 ) . However, it is often the case that developers have an existing application written in a vendor-specific language—usually CUDA—but would like to run on hardware from a different vendor. For these cases, the aforementioned performance portability frameworks are less directly applicable. Integrating these performance portability frameworks into an application usually requires significant refactoring of the codebase. Additionally these frameworks often involve many advanced C++ structures (lambdas, templating, etc.) that make it more difficult to read and understand. Moreover, these frameworks generally follow a programming paradigm that is very different from CUDA. These factors pose a substantial obstacle to the many application developers that would much prefer to maintain a single CUDA source code but still be able to run their software on hardware from different vendors. Many developers were introduced to GPU programming through CUDA, and many universities still teach CUDA as the only GPU programming model in computer science curricula ( Morgan 2021 ) . For these situations, the HIP programming model aims to provide a solution. 2 2 2 https://rocm.docs.amd.com/projects/HIP/en/latest/ By mirroring the CUDA programming paradigm, it enables a relatively simple mapping of source code. For the same reason, it is also a much more readable and understandable model for developers used to CUDA. While HIP currently only natively supports AMD and NVIDIA backends, there are ongoing third-party efforts to support HIP on Intel hardware as well. 3 3 3 See, for example: https://github.com/CHIP-SPV/chipStar As a result, HIP provides cross-platform capability that spans the majority of today’s HPC hardware providers. The AI hardware companies on the other hand are a wholly different case; they come with specialized software stacks and are not generally supported by the other performance portability models (Kokkos, Legion, etc.) either. There are projects such as SCALE 4 4 4 https://docs.scale-lang.com/nonfree-unstable/ which aim to compile CUDA source code directly into AMD binaries; however, these are still under development and not yet ready for testing on production-level applications. While HIP’s cross-platform compatibility and similarity to CUDA are attractive to HPC application developers, the issue of code translation remains: what is the best way to deal with an existing CUDA source code? Some developers have taken the route of maintaining custom header files that use preprocesser definitions to “toggle” between CUDA and HIP at compile time. This method has the advantage of being lightweight but has the disadvantage that every time new functionality is added to the CUDA code, the header file has to be updated manually. The hipify 5 5 5 https://rocm.docs.amd.com/projects/HIPIFY/en/latest/index.html tool from AMD provides an answer to the translation by converting CUDA source code to HIP. When combined with

Read the complete text