Memory Layouts for GPU-Data Transfer Buffering in SPH

Mladen Ivkovic, Abouzied M.A. Nasar, Tobias Weinzierl, Matthieu Schaller, Benedict D. Rogers, Georgios Fourtakas, Scott T. Kay · 2026

Read Memory Layouts for GPU-Data Transfer Buffering in SPH by Mladen Ivkovic, Abouzied M.A. Nasar, Tobias Weinzierl, Matthieu Schaller, Benedict D. Rogers, Georgios Fourtakas, Scott T. Kay (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-23891.txt.

Introduction

Ivkovic and colleagues restructure how particle simulation data is laid out in memory so that graphics processors spend less time waiting for data, in a 2026 paper on high performance computing. GPU compute speed has outrun transfer speeds between host memory and the device, so packing data for offloading now eats a growing share of runtime. The team studies a smoothed particle hydrodynamics solver and focuses on the host side layout of particle records.

The classic layout stores each particle as one struct with all its attributes. The authors split it into smaller substructs, grouped by which kernels read or write each attribute. Packing the split layout takes roughly twenty to forty percent less time. Total offloading time falls by about twelve to twenty five percent, with no change to the physics.

Catalog record

CREATORMladen Ivkovic, Abouzied M.A. Nasar, Tobias Weinzierl, Matthieu Schaller, Benedict D. Rogers, Georgios Fourtakas, Scott T. Kay
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE2 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.23891

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Memory Layouts for GPU-Data Transfer Buffering in SPH
Mladen Ivkovic, Abouzied M.A. Nasar, Tobias Weinzierl, Matthieu Schaller, Benedict D. Rogers, Georgios Fourtakas, Scott T. Kay

Abstract
The rise in GPU compute speed has outpaced improvements in host-to-device memory transfer speeds, despite the advent of shared-memory superchips. Consequently, memory transfer times now constitute an increasingly large fraction of total time-to-solution, compelling developers to compress GPU kernel input and output data into compact, minimal formats prior to GPU-offloading. This complements existing work on GPU- and compute-friendly data arrangements. We study a Smoothed Particle Hydrodynamics solver and propose memory layout strategies for host-side particle data that are particularly well-suited to GPU-offloading. Specifically, we advocate splitting classic array-of-struct data structures into a split array-of-struct arrangement, in which each logical struct decomposes into substructs determined by kernel read/write access patterns and attribute types. Splitting a monolithic particle struct into several bespoke, finer-grained structs can reduce the time required to pack data to and from buffers by ≈ 20 % − 40 % \approx 20\%-40\% , lowering total time spent on GPU-offloading by ≈ 12 % \approx 12\% – 25 % 25\% .



introduction
problem_formulation
method
results
conclusion

Read the complete text