Physics-Aware Compression of Plasma Distribution Functions with GPU-Accelerated Gaussian Mixture Models
Andong Hu, Luca Pennati, Ivy Peng, Stefano Markidis · 2025
Read Physics-Aware Compression of Plasma Distribution Functions with GPU-Accelerated Gaussian Mixture Models by Andong Hu, Luca Pennati, Ivy Peng, Stefano Markidis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-14897.txt.
Introduction
Hu and three co-authors squeeze plasma sim data with a physics-first pack tool in this twenty twenty-five paper. Such sims can fill drives by the vast unit if each mote is kept in full. The speed spread of motes holds the tale of heat and beams in the gas.
Inside, bell-curve mixes stand in for the full speed spread of the mote cloud. A bin step first cuts the math load, then chip gear fits the mix live. The pack keeps the mean speed, heat, and beam birth facts that plain packs lose. Its squeeze rate ran to ten-thousand-fold in the tests the team ran. Run time sat on par with stock pack tools, or beat them in spots.
Catalog record
| CREATOR | Andong Hu, Luca Pennati, Ivy Peng, Stefano Markidis |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-14897
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Physics-Aware Compression of Plasma Distribution Functions with GPU-Accelerated Gaussian Mixture Models Andong Hu, Luca Pennati, Ivy Peng, Stefano Markidis Abstract Data compression is a critical technology for large-scale plasma simulations. Storing complete particle information requires Terabyte-scale data storage, and analysis requires ad-hoc scalable post-processing tools. We propose a physics-aware in-situ compression method using Gaussian Mixture Models (GMMs) to approximate electron and ion velocity distribution functions with a number of Gaussian components. This GMM-based method allows us to capture plasma features such as mean velocity and temperature, and it enables us to identify heating processes and generate beams. We first construct a histogram to reduce computational overhead and apply GPU-accelerated, in-situ GMM fitting within iPIC3D , a large-scale implicit Particle-in-Cell simulator, ensuring real-time compression. The compressed representation is stored using the ADIOS 2 library, thus optimizing the I/O process. The GPU and histogramming implementation provides a significant speed-up with respect to GMM on particles (both in time and required memory at run-time), enabling real-time compression. Compared to algorithms like SZ, MGARD, and BLOSC2, our GMM-based method has a physics-based approach, retaining the physical interpretation of plasma phenomena such as beam formation, acceleration, and heating mechanisms. Our GMM algorithm achieves a compression ratio of up to 10 4 10^{4} , requiring a processing time comparable to, or even lower than, standard compression engines. 1 Introduction Plasma simulations are essential computational tools for understanding the dynamics of space, astrophysical systems, and fusion devices like tokamaks. Among the various computational techniques, the Particle-in-Cell (PIC) method [ 9 , 3 ] is one of the most advanced and widely used plasma simulation tools for studying the evolution of electrons and protons (called ions in plasma physics) under the influence of electromagnetic fields. The distribution function evolves by sampling computational particles and following their trajectories. The key information from PIC simulations is the data about particle positions and velocities, as it enables us to identify acceleration and heating mechanisms in the plasmas. Nonetheless, the storage requirements and post-processing costs significantly limit the volume of simulation data that can be saved and analyzed. In this work, we develop a compression method based on the Gaussian Mixture Model (GMM) [ 1 ] to tackle this challenge. Rather than saving all particle information, we perform a GMM operation, obtaining the weight, center, and covariance for a small number of Gaussians used to represent all the data, thus saving the storage by several factors. In particular, we develop a compression technique to compress particle distribution functions. Electron and ion distribution functions are related to the probability of finding an electron or an ion at a certain position in the phase-space, namely a position (x,y,z) in Cartesian coordinates with certain velocity components (u,v,w). In a 3D3V simulation, a distribution function f(\mathbf{x},\mathbf{v}) has six dimensions. Electron and ion particle distributions tend to be Gaussian in nature as a consequence of the H-Theorem and relaxation processes present in plasmas [ 11 ] . If particle distribution functions are different from Gaussian distribution functions, it hints at the presence of certain resonance phenomena that act only on a small part of the plasma populations, such as Landau damping or bump-on-tail. A Gaussian centered on a given velocity, different from zero, shows the presence of a beam with that specific bulk velocity. Similarly, an increase in the standard deviation of the Gaussian reflects a rise in the local plasma temperature. For these reasons, a GMM-based compression method is called physics-aware . This work provides the following contributions: • We develop a methodology to reduce the memory and computational demands of GMM, applying it to an intermediate histogram instead of particle data directly. • We develop a GPU implementation of the histogram-GMM pipeline and execute it during spare GPU cycles in the PIC simulation to compress plasma distribution functions. • We show physics-aware compression using Gaussian parameters, and compare the information loss, compression rate and performance with several established compression algorithms. 2 Background & Related Work Large-scale PIC simulations compute the trajectories of billions of computational particles, generating Terabyte-size data, including distribution functions. Fig. 1 shows different possibilities of storing particle information for particle distribution functions. On the leftmost panel, there is the raw information of particles velocity: in this plot, each dot corresponds to a particle, requiring the storage of 2N_{p} floating point data, where N_{p} is the number of particles. One compression scheme for particle distribution function, is to introduce a 2D grid in the space u,v to discretize the distribution and function and count how many particles belong to each bin. This data reduction technique allows us to encode our distribution function in a N_{g}\times N_{g} grid. The approach we pursue in this work is to use the GMM technique to fit the particle distribution function with a relatively small number of Gaussians (1-20) and store only the Gaussian parameters for the reconstruction. In the example of Fig. 1 , we only need the parameters of two Gaussians (12 floating point values for this two-dimensional example) to capture the complexity of the given distribution function. Figure 1: The distribution function of 10,000 particles can be approximated with an 64\times 64 histogram (central panel) or a GMM approach storing the weights, the center and covariance matrices of two Gaussians (rightmost panel). The basic idea of the GMM technique is to represent a probability distribution as a weighted sum of multiple Gaussian components, each defined by a mean vector and a covariance matrix [ 1 , 7 ] . Mathematically, a GMM models a probability density function (pdf) p(\mathbf{x}) as a weighted sum of M Gaussian components: \displaystyle p(\mathbf{x}) \displaystyle=\sum_{i=1}^{M}\alpha_{i}\mathcal{N}(\mathbf{x}|\boldsymbol{\mu}_{i},\boldsymbol{\Sigma}_{i}), (1) where \alpha_{i} are the mixture weights, \boldsymbol{\mu}_{i} are the means, and \boldsymbol{\Sigma}_{i} are the covariance matrices. Given N observed data, each one denoted as \mathbf{x}_{n} , the GMM parameters \{\alpha_{i},\boldsymbol{\mu}_{i},\boldsymbol{\Sigma}_{i}\} are estimated using the Expectation-Maximization (EM) algorithm [ 20 ] , which maximizes the likelihood function \mathcal{L}(\boldsymbol{\theta}|\mathbf{x}) , defined as: \mathcal{L}(\boldsymbol{\theta}|\mathbf{x})=\sum_{i=1}^{N}\left[\sum_{j=1}^{M}\alpha_{j}\mathcal{N}(\mathbf{x}_{n}|\boldsymbol{\mu}_{j},\boldsymbol{\Sigma}_{j})\right] . The EM algorithm consists of a two-step iteration: • E-step: Compute responsibilities for each Gaussian component for each observed data: \displaystyle\gamma_{i}(\mathbf{x}_{n}) \displaystyle=\frac{\alpha_{i}\mathcal{N}(\mathbf{x}_{n}|\boldsymbol{\mu}_{i},\boldsymbol{\Sigma}_{i})}{\sum_{j=1}^{M}\alpha_{j}\mathcal{N}(\mathbf{x}_{n}|\boldsymbol{\mu}_{j},\boldsymbol{\Sigma}_{j})}. (2) • M-step: Update the parameters: \displaystyle\alpha_{i}^{\text{new}} \displaystyle=\frac{1}{N}\sum_{n=1}^{N}\gamma_{i}(\mathbf{x}_{n}) (3) \displaystyle\boldsymbol{\mu}_{i}^{\text{new}} \displaystyle=\frac{\sum_{n=1}^{N}\gamma_{i}(\mathbf{x}_{n})\mathbf{x}_{n}}{\sum_{n=1}^{N}\gamma_{i}(\mathbf{x}_{n})} (4) \displaystyle\boldsymbol{\Sigma}_{i}^{\text{new}} \displaystyle=\frac{\sum_{n=1}^{N}\gamma_{i}(\mathbf{x}_{n})(\mathbf{x}_{n}-\boldsymbol{\mu}_{i})(\mathbf{x}_{n}-\boldsymbol{\mu}_{i})^{\top}}{\sum_{n=1}^{N}\gamma_{i}(\mathbf{x}_{n})} (5) The EM-GM technique is particularly suitable for describing the probability distribution associated with physical quantities since this algorithm conserves, exactly at each iteration – regardless of whether it has converged or not – the moments of the observed data up to the second moment [ 2 ] . This ensures the conservation of physical bulk quantities. The GMM technique has been used before for compressing scientific data in several research fields. For instance, it has been used to compress image data [ 25 ] and medical ECG data [ 24 ] . In the area of computational plasma physics, GMM has been used for checkpointing and restart [ 2 ] and as a post-processing tool to characterize magnetic reconnection regions [ 6 ] in PIC simulations. Several compression techniques have been developed for scientific computing data [ 13 , 4 ] , consisting of floating-point number. Among the most used and successful compression methods, there is MGARD (MultiGrid Adaptive Reduction of Data) [ 14 ] , developed at Oak Ridge National Lab for multi-level (inspired