Fast PET Reconstruction with Variance Reduction and Prior-Aware Preconditioning
Matthias J. Ehrhardt, Zeljko Kereta, Georg Schramm · 2025
Read Fast PET Reconstruction with Variance Reduction and Prior-Aware Preconditioning by Matthias J. Ehrhardt, Zeljko Kereta, Georg Schramm (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-04976.txt.
Introduction
Matthias Ehrhardt, Zeljko Kereta, and Georg Schramm wrote a two thousand twenty-five paper on making PET scan images faster. They study math methods that rebuild a scan image while using a prior rule to keep the image clean. Such prior-based methods are widely used in clinics and tend to beat older ones.
Tests used both fake data and real brain scans from a two thousand twenty-four contest. The key finding is that the prior rule must be built into the early step of the method for fast, stable results. Two methods, SAGA and SVRG, beat plain gradient descent, and their design helped win that contest.
Catalog record
| CREATOR | Matthias J. Ehrhardt, Zeljko Kereta, Georg Schramm |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-04976
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Fast PET Reconstruction with Variance Reduction and Prior-Aware Preconditioning Matthias J. Ehrhardt, Zeljko Kereta, Georg Schramm Abstract We investigate subset-based optimization methods for positron emission tomography (PET) image reconstruction incorporating a regularizing prior. PET reconstruction methods that use a prior, such as the relative difference prior (RDP) , are of particular relevance, as they are widely used in clinical practice and have been shown to outperform conventional early-stopped and post-smoothed ordered subsets expectation maximization (OSEM) . Our study evaluates these methods on both simulated data and real brain PET scans from the 2024 PET Rapid Image Reconstruction Challenge (PETRIC) , where the main objective was to achieve RDP -regularized reconstructions as fast as possible, making it an ideal benchmark. Our key finding is that incorporating the effect of the prior into the preconditioner is crucial for ensuring fast and stable convergence. In extensive simulation experiments, we compare several stochastic algorithms—including Stochastic Gradient Descent (SGD) , Stochastic Averaged Gradient Amelioré (SAGA) , and Stochastic Variance Reduced Gradient (SVRG) —under various algorithmic design choices and evaluate their performance for varying count levels and regularization strengths. The results show that SVRG and SAGA outperformed SGD , with SVRG demonstrating a slight overall advantage. The insights gained from these simulations directly contributed to the design of our submitted algorithms, which formed the basis of the winning contribution to the PETRIC 2024 challenge. 1 Introduction 1.1 Context PET is a pillar in modern clinical imaging widely used in oncology, neurology and cardiology. Most state-of-the-art approaches for the image reconstruction problem in PET imaging can be cast as an optimization problem \displaystyle x^{*}\in\argmin_{x}\left\{\mathcal{D}(Ax+r,y)+\mathcal{R}(x)\right\}, (1) where the data-fidelity term \mathcal{D}:\mathcal{Y}\times\mathcal{Y}\to[0,\infty] measures how well the estimated data Ax+r matches the acquired data y and the regularizer \mathcal{R}:\mathcal{X}\to[0,\infty] penalizes unwanted features in the image. A:\mathcal{X}\to\mathcal{Y} is a linear forward model for the PET physics, including effects such as scanner sensitivities or attenuation, and r is the additive background term to account for scattered and random coincidences. Due to the Poisson nature of the data, the data-fidelity is usually taken as the Kullback–Leibler (KL) divergence. The regularizer commonly entails nonnegativity constrains and terms promoting smoothness. A particularly successful model for smoothness in PET is the RDP [ 1 ] . This paper is concerned with algorithms for a fast reconstruction of x^{*} . Particularly, we present our winning contribution to the 2024 image reconstruction challenge PETRIC [ 2 ] , where the task was to reconstruct data acquired by a range of PET scanners using RDP regularized reconstruction methods. PET image reconstructions that use the RDP are of particular current relevance, as RDP is widely used in clinical practice, being implemented by a major commercial vendor, and has been shown to outperform conventional early-stopped and post-smoothed OS-MLEM reconstructions [ 3 , 4 , 5 ] . Their implementation is based on BSREM [ 6 ] . It was shown to be outperformed in terms of speed by an algorithm using ideas from machine learning and a tailored preconditioning [ 7 ] . In this paper, we outline our process in finding the winning algorithm and share the insights we gained along the way. For context, the task had to be completed in Synergistic Image Reconstruction Framework (SIRF) [ 8 ] and speed was measured as walltime until an application-focused convergence criteria were reached. 1.2 Problem Details Fast algorithms for PET reconstruction have traditionally been subset-based [ 9 ] , that is, only a subset of the data is used in every iteration. Over the last decade, algorithms using a similar strategy but derived for machine learning have entered the field, showing state-of-the-art performance [ 7 , 10 , 11 , 12 , 13 , 14 ] . They exploit the fact that the KL divergence is separable in the estimated data \displaystyle\mathcal{D}(Ax+r,y)=\sum_{i=1}^{n}\sum_{j\in S_{i}}d(A_{j}x+r_{j},y_{j}), (2) where n denotes the number of subsets and function d is defined by \displaystyle d(s,t)=\begin{cases}s-t+t\log(t/s),&\text{if $t>0,s>0$}\\ s,&\text{if $t=0,s\geq 0$}\\ \infty,&\text{otherwise}\end{cases}. Here S_{i} denote a subset of the data, e.g., all data associated to a “view”. A lot of effort has been put into finding good prior models (i.e., regularizers) for PET, including smooth and nonsmooth priors, promoting smoothness of the image to be reconstructed or promoting similarity to anatomical information [ 15 , 16 , 17 , 18 , 19 ] . In [ 1 ] , the authors propose a smooth and convex prior that takes into account the scale of typical PET images, resulting in promoting more smoothness in less active regions. Mathematically for nonnegative images x the resulting regularizer can be defined by \displaystyle\mathcal{S}(x)=\frac{1}{2}\sum_{i}\sum_{j\in N_{i}}w_{i,j}\kappa_{i}\kappa_{j}\frac{(x_{i}-x_{j})^{2}}{x_{i}+x_{j}+\gamma|x_{i}-x_{j}|+\varepsilon}, (3) where the first sum is over all voxels i and the second sum is over all “neighbors” j . The parameter \gamma>0 allows placing more or less emphasis on edge-preservation and the parameter \varepsilon>0 ensures that the function is well-defined and twice continuously differentiable. The terms w_{i,j} , \kappa_{i} and \kappa_{j} are weight factors accounting for distances between voxels and are intended to create a uniform “perturbation response” [ 20 ] . Note that the essential part of the prior is \displaystyle\phi(s,d)=\frac{d^{2}}{s+\gamma|d|+\varepsilon}, which has two important properties. First, if the sum of activities between voxels s is small compared to the scaled absolute difference \gamma|d| , the regularizer essentially reduces to total variation: \phi(s,d)\approx|d|/\gamma . Second, the larger the activity in both voxels, i.e., the larger s , the less weight is given on penalizing their difference, justifying the name of the regularizer. See also Appendix A.1 for formulas of derivatives. Combined with the indicator function of the nonnegativity constraint, \iota_{\geq 0}(x)=\begin{cases}0,&\text{if $x_{i}\geq 0$ for all $i$}\\ \infty,&\text{otherwise}\end{cases}, we arrive at the regularization model used in PETRIC \displaystyle\mathcal{R}(x)=\beta\mathcal{S}(x)+\iota_{\geq 0}(x). (4) This formula has to be interpreted to be \infty for infeasible images with negative voxel-values and has the finite RDP value everywhere else. The rest of the paper is structured as follows. In section 2 we introduce the building blocks of our algorithms. We discuss proximal stochastic gradient approaches for the solution of ( 1 ), the stepsize regimes, preconditioning and subset selection. In section 3 we thoroughly investigate the effects of different choices of building blocks in a simulated setting. In section 4 we present the algorithms we ended up using in PETRIC and their performance on real data. We conclude in sections 5 and 6 with final remarks. 2 Building Blocks Combining the modeling choices in ( 1 ), ( 2 ) and ( 4 ), we arrive at the optimization problem \displaystyle\min_{x}\left\{\sum_{i=1}^{n}\mathcal{J}_{i}(x)+\iota_{\geq 0}(x)\right\}, (5) where we define \mathcal{J}_{i}(x)=\mathcal{D}_{i}(x)+\frac{\beta}{n}\mathcal{S}(x) , and \mathcal{D}_{i}(x)\coloneq\sum_{j\in S_{i}}d(A_{j}x+r_{j},y_{j}) . The zoo of optimization methods for solving instances of problem ( 5 ) is rich and has been growing in recent decades, see [ 13 ] and references therein. For linear inverse problems, such as in PET image reconstruction, the most common approaches are based on (proximal) gradient descent or on primal-dual approaches. In this work we consider stochastic gradient methods for the solution of the problem ( 5 ). They take the form x^{(k+1)}=\operatorname{prox}_{\iota_{\geq 0}}\big(x^{(k)}-\tau^{(k)}D^{(k)}\tilde{\nabla}^{(k)}\big), (6) where \tau^{(k)}>0 is a stepsize, \tilde{\nabla}^{(k)} is an estimator of the gradient of the smooth part of the objective function \mathcal{J}(x)=\sum_{i=1}^{n}\mathcal{J}_{i}(x) , D^{(k)} is a matrix that acts as a preconditioner, and \operatorname{prox}_{\iota_{\geq 0}}