Deep Guess acceleration for explainable image reconstruction in sparse-view CT

Elena Loli Piccolomin, Davide Evangelista, Elena Morotti · 2024

Read Deep Guess acceleration for explainable image reconstruction in sparse-view CT by Elena Loli Piccolomin, Davide Evangelista, Elena Morotti (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-01703.txt.

Introduction

Elena Loli Piccolomini, Davide Evangelista, and Elena Morotti introduced a 2024 method for CT scans taken from few angles. Fewer views mean less radiation for the patient. Simple back-projection then leaves strong artifacts, while model-based methods are cleaner but too slow for clinic use.

Their Deep Guess scheme trains a neural network to give a smart starting image. A step-by-step solver then refines that start into a clear image that users can interpret. Only a few rounds are needed. On real CT images with very few views, the method beat its model-based rival and many data-driven tools. The team also tested a version that needs no ground truth and checked its strength against noise.

Catalog record

CREATORElena Loli Piccolomin, Davide Evangelista, Elena Morotti
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-01703

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Deep Guess acceleration for explainable image reconstruction in sparse-view CT Elena Loli Piccolomin, Davide Evangelista, Elena Morotti Abstract Sparse-view Computed Tomography (CT) is an emerging protocol designed to reduce X-ray dose radiation in medical imaging. Traditional Filtered Back Projection algorithm reconstructions suffer from severe artifacts due to sparse data. In contrast, Model-Based Iterative Reconstruction (MBIR) algorithms, though better at mitigating noise through regularization, are too computationally costly for clinical use. This paper introduces a novel technique, denoted as the Deep Guess acceleration scheme, using a trained neural network both to quicken the regularized MBIR and to enhance the reconstruction accuracy. We integrate state-of-the-art deep learning tools to initialize a clever starting guess for a proximal algorithm solving a non-convex model and thus computing an interpretable solution image in a few iterations. Experimental results on real CT images demonstrate the Deep Guess effectiveness in (very) sparse tomographic protocols, where it overcomes its mere variational counterpart and many data-driven approaches at the state of the art. We also consider a ground truth-free implementation and test the robustness of the proposed framework to noise. Keywords Non-convex optimization, Sparse view computed tomography, Model-based iterative reconstruction, Deep neural networks, Interpretable reconstruction. 1 Introduction Computed tomography (CT) reconstruction from sparse views has emerged as a focal point in medical imaging research. A key challenge lies in diminishing the total X-ray radiation dose administered to patients while maintaining reconstruction precision. The sparse-view methodology revolves around decreasing the number of rotation angles utilized, thereby eliciting compromised image quality due to the introduction of numerous streaking artifacts by the classical analytical algorithms, such as the Filtered Back Projection (FBP). Model-Based Iterative Reconstruction (MBIR) methods are extensively employed, relying on mathematical models to represent the problem being solved. In this case, sparse CT image reconstruction can be addressed as a linear problem of the form: {\boldsymbol{y}}=A{\boldsymbol{x}}+{\boldsymbol{e}}^{\nu}, (1) where {\boldsymbol{y}}\in\mathbb{R}^{m} is the sinogram, affected by noise {\boldsymbol{e}}^{\nu}\in\mathbb{R}^{m} with intensity depending on the positive parameter \nu , and A\in\mathbb{R}^{m\times n} is the forward operator describing the CT system geometry. Due to the sparse sampling, m<n and the system ( 1 ) has infinitely many solutions. Additionally, owing to the typical ill-posedness of inverse problems, it is beneficial to introduce a prior term. MBIR methods allow the reformulation of the inverse problem as a minimization problem involving a fit-to-data function and a regularization (or prior) function. In this paper, we consider the popular formulation given by: \min_{{\boldsymbol{x}}\geq 0}||A{\boldsymbol{x}}-{\boldsymbol{y}}||_{2}^{2}+\lambda\mathcal{R}({\boldsymbol{x}}), (2) where the least squares term represents the data-fitting function, \mathcal{R} is the prior term, and \lambda is the regularization parameter. Compressed sensing theory plays a crucial role in this framework, enabling the reconstruction of high-quality images from a limited amount of data through a suitable choice of the prior \mathcal{R({\boldsymbol{x}})} . Specifically, forcing gradient sparsity through the prior has been proven to be extremely useful in fields such as medical imaging, where preserving boundaries of low-contrast objects is essential for accurate diagnosis and treatment. Given a fixed 0<p\leq 1 , the gradient sparsity-inducing prior \mathcal{R} is defined as: \mathcal{R}({\boldsymbol{x}})=||D{\boldsymbol{x}}||_{2,p}^{p}:=||\>|D{\boldsymbol{x}}|\>||_{p}^{p}, (3) where |D{\boldsymbol{x}}|\in\mathbb{R}^{n} represents the gradient-magnitude image of {\boldsymbol{x}} , given by \left(|D{\boldsymbol{x}}|\right)_{i}:=\sqrt{(D_{h}{\boldsymbol{x}})_{i}^{2}+(D_{v}{\boldsymbol{x}})_{i}^{2}\ } with the operators D_{h} and D_{v} , denoting the differences among two adjacent pixels in the horizontal and vertical directions, respectively. It is widely acknowledged that the \ell_{0} quasi-norm (given by Equation ( 3 ) when p\to 0 ), which quantifies the cardinality of the non-zero entries in its argument, represents the optimal sparsifying prior. Unfortunately, minimizations involving an \ell_{0} prior pose significant computational challenges and are seldom addressed directly. Luckily, signal recovery remains feasible by substituting the \ell_{1} norm (with p=1 in Equation ( 3 )) for the \ell_{0} quasi-norm under appropriate assumptions [ 8 , 18 ] . In this case the regularization function is denoted as Total Variation (TV), which is very popular in CT applications. Many scholars also conducted a large amount of research on TV regularization, proposing numerous improved convex TV-based models, as we will detail in the next Section. Nonetheless, the TV prior exhibits limitations such as its tendency to excessively smooth regions containing fine details or textures. Setting 0<p<1 in Equation ( 3 ) defines \mathcal{R} as the isotropic Total p -norm Variation (T p V), which represents a better alternative to the TV prior for approximating the \ell_{0} quasi-norm. The T p V has already been successfully used in a number of imaging applications, including CT reconstruction, but its main drawback lies in its non-convex nature. Thus, ensuring the attainment of the global minimum by an MBIR may not be feasible, and MBIR approaches are prone to fall in one of the local minima, which could be significantly distant from the desired global solution. Consequently, non-convex minimization presents two practical disadvantages: the extensive computational effort required by the MBIR solver to converge and the unreliable dependence of the reconstructed image on the algorithm initialization. Nevertheless, the identification of a good local minimum can yield accurate reconstructions of sparse signals using significantly fewer measurements compared to the p=1 case [ 14 ] . Given the urgent need for rapid and accurate images in clinical applications, Deep Learning (DL) has emerged as a powerful alternative to MBIR. Many different approaches have been designed in the last years to address CT reconstruction with neural networks, and they have demonstrated the ability of data-driven methods to learn complex patterns from vast datasets, enabling the computation of high-quality images swiftly. However, three main drawbacks must be considered to make deep learning-based approaches usable in practice. Firstly, the black box structure of the trained networks makes it impossible to characterize the final outputs as numerical solutions of any mathematical inverse problem [ 42 ] . Secondly, the training of the neural networks typically requires extensive training samples, which may not be available in many real-world medical scenarios. As we will discuss in Section 2 , only a few works tackle this disadvantage in the literature. Lastly, while highly accurate when used on images consistent with the training samples, neural networks may manifest untrustworthy effects when applied to slightly different data. This unstable behavior is the subject of study in some recent research [ 1 , 30 , 20 ] . Our proposal and goals This research proposes to the imaging community a fast and reliable tool for CT image reconstruction, taking into consideration the pros and cons of the aforementioned state-of-the-art approaches and directly addressing the scientific challenges for the implementation of software in clinical routines. Specifically, we combine the advantages of both MBIR and DL-based best tools and design a unified solution of practical interest for medical imaging. The core idea is to use a neural network to initialize the starting iterate in the algorithm addressing the T p V-regularized problem. We refer to our strategy as the Deep Guess acceleration approach to highlight that we exploit the effectiveness of deep learning to define the initial guess in an MBIR solver and make its numerical convergence faster. The scheme of the Deep Guess acceleration framework is visually illustrated in Figure 1 . The benefits of the proposed approach are manifold. Figure 1: Graphical representation of the proposed data-driven approach for solving the non-convex imaging problem. • Fast execution:

Read the complete text