Comparing the Performance of Heterogeneous Conjugate Gradient and Cholesky Solvers on Various Hardware Using SYCL Conference: International Workshop on OpenCL and SYCL; May 06–08, 2026; Heilbronn, Germany International Workshop on OpenCL and SYCL (IWOCL ’26), May 06–08, 2026, Heilbronn, Germany DOI: 10.1145/3811257.3811260 CCS: Computing methodologies Parallel programming languages CCS: Mathematics of computing Computations on matrices
Tim Thüring, Alexander Strack, Dirk Pflüger · 2026
Read Comparing the Performance of Heterogeneous Conjugate Gradient and Cholesky Solvers on Various Hardware Using SYCL Conference: International Workshop on OpenCL and SYCL; May 06–08, 2026; Heilbronn, Germany International Workshop on OpenCL and SYCL (IWOCL ’26), May 06–08, 2026, Heilbronn, Germany DOI: 10.1145/3811257.3811260 CCS: Computing methodologies Parallel programming languages CCS: Mathematics of computing Computations on matrices by Tim Thüring, Alexander Strack, Dirk Pflüger (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13209.txt.
Introduction
Thüring, Strack and Pflüger present multi-vendor, heterogeneous CPU-GPU versions of the conjugate gradient method and Cholesky decomposition using SYCL, tackling linear systems with symmetric positive-definite matrices. GPU-only plans waste powerful modern CPUs, so their code uses CPU and GPU at once. Against GPU-only versions on large matrices, the mixed code runs up to 32% faster for conjugate gradient and up to 29% faster for Cholesky. The Cholesky version also runs at least 12% faster across systems with NVIDIA, AMD and Intel GPUs.
Catalog record
| CREATOR | Tim Thüring, Alexander Strack, Dirk Pflüger |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60859 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.13209
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Comparing the Performance of Heterogeneous Conjugate Gradient and Cholesky Solvers on Various Hardware Using SYCL Conference: International Workshop on OpenCL and SYCL; May 06–08, 2026; Heilbronn, Germany International Workshop on OpenCL and SYCL (IWOCL ’26), May 06–08, 2026, Heilbronn, Germany DOI: 10.1145/3811257.3811260 CCS: Computing methodologies Parallel programming languages CCS: Mathematics of computing Computations on matrices Tim Thüring, Alexander Strack, Dirk Pflüger Abstract . Many important real-world applications, such as System Identification with Gaussian Processes, involve solving linear systems with symmetric positive-definite matrices. The iterative CG method and direct solvers based on the Cholesky decomposition are two popular methods that can be applied in this case. Since often very large systems have to be solved when dealing with such real-world scenarios, GPUs are commonly used to accelerate the computations. However, homogeneous approaches that only leverage the GPU in the system do not take full advantage of the often powerful CPUs located in modern HPC systems. In this work, we present multi-vendor, heterogeneous implementations of the CG method and the Cholesky decomposition that leverage the CPU and GPU of a heterogeneous system simultaneously using SYCL. Furthermore, we compare their runtime behavior to traditional, homogeneous approaches. The results show that for large matrices, our heterogeneous implementation is up to 32 percent faster for the CG method and up to 29 percent faster for the Cholesky decomposition compared to the corresponding GPU-only implementations. In addition, for large matrices, our heterogeneous implementation of the Cholesky decomposition can achieve at least 12 percent faster runtimes across several systems with GPUs from NVIDIA, AMD, and Intel. 1. Introduction Linear systems of the form \boldsymbol{A}\cdot\boldsymbol{x}=\boldsymbol{b} involving a symmetric positive-definite (SPD) matrix \boldsymbol{A} are fundamental building blocks of numerous important real-world applications. From the finite element method used in structural analysis ( 9 ) to electromagnetic transient simulations ( 23 ) and System Identification with Gaussian Processes (GPs) ( 20 ) , the solution of linear systems of equations is a core problem in science and engineering. In this work, we consider the latter application to GPs, where direct solvers such as the Cholesky decomposition are commonly used, but also iterative solvers that yield an approximation to the solution, such as the Conjugate Gradient (CG) method ( 16 ) can be applied. The linear systems can easily become very large, involving matrices with billions of entries. As a result, the computational effort to solve such systems dramatically increases, and GPUs are often used to accelerate the solving process. With classic homogeneous approaches, the CPU launches a kernel on the GPU and thereby offloads the complete calculation to the GPU. The drawback of this approach is that during the time the GPU is performing the computation, the CPU waits for the GPU to finish and does not contribute to the solution. However, many modern systems that are used for GPU computing feature powerful CPUs with high core counts and vectorization capabilities. These computational resources are not used efficiently in classic homogeneous GPU-only approaches. Heterogeneous computing targets this problem by aiming to leverage all available computational resources simultaneously to achieve a lower overall runtime. Nevertheless, this comes with the inherent challenge of programmatically addressing the heterogeneous hardware. Conventionally, it requires different programming languages for this task, such as CUDA for NVIDIA GPUs or language extensions like OpenMP for multi-core CPUs. As a result, libraries can end up with multiple instances of the same kernel written in different programming languages, which all require maintenance, optimization, and testing. In this work, we make use of SYCL to address this challenge of heterogeneous computing. By providing an abstraction layer, SYCL allows programming parallel kernels for various different architectures, including CPUs and GPUs of all major vendors, while relying on standard ISO C++ as a programming language. There already exists related work that implements the CG algorithm or the Cholesky decomposition heterogeneously. The pipelined, preconditioned variation of the CG method was implemented heterogeneously by 36 using a combination of CUDA and OpenMP. A further heterogeneous implementation of the pipelined CG method was implemented by 21 using the same programming language combination as the previous authors. 25 present a heterogeneous and distributed implementation of the preconditioned CG method and the pipelined CG method using MPI in addition to CUDA and OpenMP. A heterogeneous implementation of the Cholesky decomposition was performed by 22 leveraging BLAS kernels of the MAGMA library ( 37 ) as building blocks in combination with task scheduling using the PLASMA library ( 11 ) , where they extended the static scheduler to support heterogeneous computing. The MAGMA library also has ongoing efforts to implement a SYCL backend ( 1 ) . Further heterogeneous Cholesky decomposition implementations include the works by 33 ; 32 and 2 . Furthermore, homogeneous implementations of the CG algorithm and the Cholesky decomposition exist that make use of SYCL. 8 compared their SYCL implementation of the CG algorithm using DPC++ on CPUs, GPUs and FPGAs. The work by 6 compares a SYCL implementation of the matrix-free CG variant against reference libraries using CPUs and GPUs. Another CG implementation that makes use of SYCL is included in the PLSSVM library by 39 . PLSSVM mainly focuses on homogeneous computing; however, in theory, heterogeneous computing could be achieved using a combination of SYCL and MPI. With the potrf routine, the Cholesky decomposition is exposed via the SYCL API of the oneAPI Math Library (oneMath) ( 38 ) developed by the Unified Acceleration (UXL) Foundation. Even though this enables the usage of the Cholesky decomposition via a SYCL API, the backend is not necessarily SYCL code, as vendor-specific libraries can be used in the background. Generally, most existing heterogeneous implementations of the CG method and the Cholesky decomposition rely on a combination of several programming languages or language extensions to achieve simultaneous execution on CPU and GPU. Therefore, we have developed heterogeneous implementations of the CG method and the Cholesky decomposition using SYCL from scratch ( 35 ) . This allows for a fair comparison of the heterogeneous and homogeneous implementations on various systems featuring GPUs from NVIDIA, AMD, and Intel. To our knowledge, such a comparison of CG and Cholesky solvers for solving Gaussian Process covariance matrices in a heterogeneous setting using solely SYCL has not been performed before. In summary, this work makes the following contributions: • Novel, native SYCL implementations of memory-efficient, block-based CG and Cholesky solvers targeting both homogeneous and heterogeneous computing, • Performance evaluation of the heterogeneous and homogeneous solvers on various hardware, including GPUs from NVIDIA, AMD, and Intel, • Comparison of AdaptiveCpp and the Intel oneAPI DPC++/C++ compiler icpx regarding the CPU, GPU, and heterogeneous performance of both solvers. This paper is structured as follows: first, the CG method and the Cholesky decomposition are introduced in Section 2 . Subsequently, we explain how we implemented both methods heterogeneously on the CPU and GPU in Section 3 before we discuss the results of the performance analysis of the heterogeneous approach in Section 4 . Last, in Section 5 , we conclude our findings and provide an outlook for future work. 2. Fundamentals This chapter provides all relevant mathematical fundamentals regarding the two solvers for linear systems considered in this work: the CG method and the Cholesky