Efficiently Generating Multidimensional Calorimeter Data with Tensor Decomposition Parameterization
Paimon Goulart [email protected], Shaan Pakala [email protected] University of California, RiversideEvangelos Papalexakis [email protected] · 2025
Read Efficiently Generating Multidimensional Calorimeter Data with Tensor Decomposition Parameterization by Paimon Goulart [email protected], Shaan Pakala [email protected] University of California, RiversideEvangelos Papalexakis [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-19443.txt.
Introduction
Paimon Goulart, Shaan Pakala and Evangelos Papalexakis shrink generative models for particle detector data using tensor decomposition, in their 2025 arXiv paper. Calorimeter simulations are expensive, so physicists increasingly train generative models to synthesize detector outputs. Multidimensional outputs still make those models heavy.
Their idea is to have the model generate small tensor factors instead of the full data tensor, then rebuild the data from the factors. Output size and parameter count drop sharply. Experiments show the synthetic data remains useful for downstream tasks. The authors argue decomposition is a general efficiency lever for generative models whose outputs are naturally tensors.
Catalog record
| CREATOR | Paimon Goulart [email protected], Shaan Pakala [email protected] University of California, RiversideEvangelos Papalexakis [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 15 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-19443
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Efficiently Generating Multidimensional Calorimeter Data with Tensor Decomposition Parameterization Paimon Goulart [email protected], Shaan Pakala [email protected] University of California, RiversideEvangelos Papalexakis [email protected] Abstract Producing large complex simulation datasets can often be a time and resource consuming task. Especially when these experiments are very expensive, it is becoming more reasonable to generate synthetic data for downstream tasks. Recently, these methods may include using generative machine learning models such as Generative Adversarial Networks or diffusion models. As these generative models improve efficiency in producing useful data, we introduce an internal tensor decomposition to these generative models to even further reduce costs. More specifically, for multidimensional data, or tensors, we generate the smaller tensor factors instead of the full tensor, in order to significantly reduce the model’s output and overall parameters. This reduces the costs of generating complex simulation data, and our experiments show the generated data remains useful. As a result, tensor decomposition has the potential to improve efficiency in generative models, especially when generating multidimensional data, or tensors. 1 1 footnotetext: Equal contribution 1 Introduction Producing complex simulation data is a vital step to understanding physical systems, in domains such as climate science [ 3 , 10 , 12 ] and high energy physics [ 8 , 7 ] . Unfortunately, performing the experiments to generate this simulation data sometimes requires excessive amounts of time and computational resources [ 7 , 12 ] . For this reason, we see generative models, such as Generative Adversarial Networks (GANs) [ 4 ] and Denoising diffusion models [ 6 , 20 ] , used for the generation of complicated simulation data [ 8 , 1 ] . This is especially useful as these datasets have higher resolution, becoming more expensive to generate experimentally and using overwhelming amounts of computing power [ 7 , 8 , 1 ] . To further accelerate this dataset generation, we introduce an internal tensor decomposition for these generative models, to significantly reduce the model parameters and increase overall efficiency. When generating multidimensional data, or tensors, we instead generate the much smaller tensor factors. Then after we generate these factors, we can combine them into the full generated tensor [ 17 ] . By doing this, we significantly reduce the number of parameters that are directly output by the model, reducing the overall model parameters as well. In our experiments, we show the viability of this internal tensor decomposition by comparing it with standard generative models that output the entire generated tensor. We make comparisons using the widely used Fréchet Inception Distance (FID) [ 5 ] , to quantify how well the distribution of generated data matches the distribution of original data. In our results, we see that we can reduce the number of parameters by decreasing the tensor decomposition rank, and still maintain similar performance to the generative models with more parameters. Our code is available at https://github.com/Pie115/GenTen-GAN-Diffusion . 2 Preliminaries 2.1 Tensors & Tensor Decomposition Tensors are multidimensional arrays. In other words, a vector is a 1-dimensional tensor, and a matrix is a 2-dimensional tensor. We will be looking at tensors of 3 or more dimensions [ 9 , 19 ] . 2.1.1 Tensor Decomposition Tensor decomposition is the process of expressing a tensor using smaller factors. For example, a common method of tensor decomposition is Canonical Polyadic Decomposition (CPD) [ 9 , 19 ] . CPD expresses a tensor as a sum of rank-one tensors. A rank R decomposition of a third-order tensor \boldsymbol{\mathscr{X}}\in\mathbb{R}^{I{\mathbf{x}}J{\mathbf{x}}K} would be expressed as: \boldsymbol{\mathscr{X}}\approx\sum_{r=1}^{R}(\mathbf{a}_{r}\circ\mathbf{b}_{r}\circ\mathbf{c}_{r}), where \mathbf{a}_{r}\in\mathbb{R}^{I},\mathbf{b}_{r}\in\mathbb{R}^{J},\mathbf{c}_{r}\in\mathbb{R}^{K} , and \circ denotes outer product. 2.2 Generative Adversarial Networks Generative Adversarial Networks (GANs) [ 4 ] are a type of ML model that generates synthetic data. It utilizes two internal ML models: a generator and a discriminator. The generator is trained to generate realistic images based on a set of real data. The discriminator is trained as a binary classification model to distinguish between the real dataset and the generator’s output. By training these two models in this way, the generator is encouraged to generate realistic images that will fool the discriminator. 2.3 Diffusion Models Denoising diffusion models [ 6 , 20 ] are a class of generative ML models, which like GANs, are used to generate new data. Unlike GANs however, diffusion models do not need to perform adversarial training. Instead, a neural network is trained to reverse a process which denoises data that is corrupted with varying amounts of Gaussian noise. New samples are then produced by iteratively denoising pure Gaussian noise into a new image. 3 Methods 3.1 Tensor Decomposition in GANs Utilizing tensor decomposition in GANs allows it to generate multidimensional data, while requiring far less parameters. In Figure 1 , we visualize an example of a GAN using tensor decomposition to generate tensors. Figure 1 : Example GAN with internal tensor decomposition. The GAN takes in a 1-dimensional random ( N(0,1) distribution) latent vector and passes it through MLPs to generate tensor factors. Then these tensor factors can be combined (using CPD in this figure) to produce the final generated tensor. In this figure, the generator produces three factor matrices of dimensions \mathbb{R}^{i\times r} , \mathbb{R}^{i\times r} , and \mathbb{R}^{j\times r} . Then we combine these factor matrices to produce the final generated tensor of shape \mathbb{R}^{i\times i\times j} . The tensor in this example is of shape \mathbb{R}^{i\times i\times j} , so generating the full tensor would require i^{2}\times j output parameters. Generating the tensor factors [ 17 ] only requires (i+i+j)\times r output parameters, which is usually much less. 3.1.1 Generator The generator loss is the average discriminator’s output on the generated data. Since the discriminator outputs a decimal value closer to 1 if it predicts generated data, and closer to 0 if it predicts real data, the generator wants to minimize this number. If the generator can minimize the discriminator’s average predictions on the generated data (closer to 0), this means the discriminator is predicting real for the generated data. This hopefully means the generator is producing data that is indistinguishable from the real data. 3.1.2 Discriminator For the discriminator, we take in the tensor as input and perform 2D convolutions on each slice. For example, the Calorimeter data is of shape \mathbb{R}^{25\times 51\times 51} , with 25 ‘slices’ (each slice is a 2D matrix) and a height and width of 51. Then the discriminator pools these outputs and passes this through a dense layer and sigmoid layer to essentially perform logistic regression on the intermediate layer. If the output is closer to 1, then it is predicting the input is generated data, and if it is closer to 0 then it is predicting real data. For the discriminator training, we use PyTorch’s Binary Cross Entropy loss function to evaluate the discriminator’s ability to distinguish between the real and generated data. 3.2 Tensor Decomposition in Diffusion Models In our model, we adopt a denoising diffusion implicit model (DDIM) framework. Compared to a standard denoising diffusion probabilistic model (DDPM), DDIM gives us faster sampling by using a deterministic non-Markovian process [ 20 ] . Rather than requiring a full sequence of T diffusion steps, DDIM allows us to generate high-quality samples using a reduced number of steps. Since it