Network-Regularized Diffusion Sampling For 3D Computed Tomography
Shijun Liang, Ismail Alkhouri, Qing Qu, Rongrong Wang, Saiprasad Ravishankar · 2025
Read Network-Regularized Diffusion Sampling For 3D Computed Tomography by Shijun Liang, Ismail Alkhouri, Qing Qu, Rongrong Wang, Saiprasad Ravishankar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-14680.txt.
Introduction
Shijun Liang, Ismail Alkhouri, Qing Qu, Rongrong Wang, and Saiprasad Ravishankar extend diffusion-based image reconstruction from flat pictures to 3D CT scans. Diffusion solvers for inverse imaging have grown strong by casting sampling as a fitting step that enforces consistency with the measurements and with the diffusion process itself. Those methods, though, were built for 2D tasks and do not carry over directly to volumetric scans, where slices must agree with each other.
Their method, NERD, adds a penalty term that encourages continuity across neighbouring slices, cutting inter-slice artefacts and promoting coherent volumes. Two fast methods solve the resulting problem. For medical imaging, coherent 3D reconstructions from limited data are the difference between a scan a radiologist can trust and one full of seams.
Catalog record
| CREATOR | Shijun Liang, Ismail Alkhouri, Qing Qu, Rongrong Wang, Saiprasad Ravishankar |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-14680
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Network-Regularized Diffusion Sampling For 3D Computed Tomography Shijun Liang, Ismail Alkhouri, Qing Qu, Rongrong Wang, Saiprasad Ravishankar Abstract Numerous diffusion model (DM)-based methods have been proposed for solving inverse imaging problems. Among these, a recent line of work has demonstrated strong performance by formulating sampling as an optimization procedure that enforces measurement consistency, forward diffusion consistency, and both step-wise and backward diffusion consistency. However, these methods have only considered 2D reconstruction tasks and do not directly extend to 3D image reconstruction problems, such as in Computed Tomography (CT). To bridge this gap, we propose NE twork- R egularized diffusion sampling for 3 D CT ( NERD ) by incorporating an ℓ 1 \ell_{1} regularization into the optimization objective. This regularizer encourages spatial continuity across adjacent slices, reducing inter-slice artifacts and promoting coherent volumetric reconstructions. Additionally, we introduce two efficient optimization strategies to solve the resulting objective: one based on the Alternating Direction Method of Multipliers (ADMM) and another based on the Primal-Dual Hybrid Gradient (PDHG) method. Experiments on medical 3D CT data demonstrate that our approach achieves either state-of-the-art or highly competitive results. † † address: 1 Department of Electrical & Computer Engineering, University of Michigan, Ann Arbor, MI, USA 2 Department of Computational Mathematics, Science & Engineering, Michigan State University, East Lansing, MI, USA 3 Department of Mathematics, Michigan State University, East Lansing, MI, USA 4 Department of Biomedical Engineering, Michigan State University, East Lansing, MI, USA 1 Introduction Deep learning has been used to solve many inverse imaging problems (IIPs) [ 18 , 3 , 4 , 15 , 22 , 24 ] , including medical computed tomography (CT) [ 1 , 8 ] . Beyond supervised and unsupervised approaches, data-centric generative methods such as diffusion models (DMs) [ 12 ] have shown great potential in solving IIPs, with applications in both 2D and 3D scientific imaging [ 2 , 7 ] . DMs approximately learn the distribution of given high-dimensional training images and are adapted for IIPs by modifying the reverse sampling procedure to incorporate measurement conditioning. Among DM-based solvers, optimization-based sampling (such as step-wise triple-consistent sampling (SITCOM) [ 2 ] , Decoupled Data Consistency with Diffusion Purification (DCDP) [ 16 ] , ReSampling [ 21 ] , and DM Plug-and-play [ 25 ] ) have achieved highly competitive performance across various 2D tasks and noise settings. Extending these methods to 3D IIPs, such as in medical CT, is challenging due to the high dimensionality, which introduces increased memory and computational costs, especially since most DMs are trained on 2D slices. Therefore, it is critical to design efficient solvers that maintain spatial continuity and reduce inter-slice artifacts along all three spatial axes. In recent years, 2D pre-trained DMs have been adapted to solve 3D CT problems such as the works in Decomposed Diffusion Sampling (DDS) [ 7 ] and Diffusion Model-based iterative reconstruction (DiffMBIR) [ 8 ] . While DDS reduces the number of sampling steps from nearly 1000 to around 100, the method still requires a large number of reverse diffusion steps to achieve satisfactory results. Motivated by the need to reduce sampling steps while improving convergence and reconstruction quality, we make the following contributions: we first propose a new optimization-based framework for 3D CT reconstruction, inspired by network regularization, which integrates 2D pre-trained DMs with a TV-based spatial regularizer to reduce inter-slice artifacts. Second, we adopt two efficient solvers for this framework: one based on the Alternating Direction Method of Multipliers (ADMM) [ 5 ] and another based on the Primal-Dual Hybrid Gradient (PDHG) method [ 9 ] . Our experiments show that, for comparable run-time, our method reduces the number of sampling steps to as few as 30, while achieving higher reconstruction quality in 3D along all three axes than the SOTA method, DDS [ 7 ] . 2 Preliminaries & Related Work Forward model : The forward model for 3D medical Computed Tomography (CT) with sparse views (measurements) is given by \mathbf{y}=\mathbf{A}\mathbf{x}+\mathbf{n} , where \mathbf{y}\in\mathbb{R}^{m} is the measurement vector and \mathbf{x}\in\mathbb{R}^{n} is the unknown 3D image to be reconstructed (with m<n ). Here, the measurement operator for post-log sinogram data and parallel beam geometry can be approximated as \mathbf{A}=\mathbf{P}\mathbf{T} , where \mathbf{T} denotes the discrete Radon transform [ 6 ] and \mathbf{P} is a subsampling matrix that subselects views. The noise in the measurement domain is \mathbf{n}\in\mathbb{R}^{m} , which could be assumed to be from a Gaussian distribution \mathcal{N}(\mathbf{0},\sigma_{\mathbf{y}}^{2}\mathbf{I}) with \sigma_{\mathbf{y}}>0 , although other distributions are also used for CT. Network-regularized diffusion sampling: In this paper, we adopt the 2D step-wise triple-consistent diffusion sampling (SITCOM) framework introduced in [ 2 ] . SITCOM and other methods typically use the Tweedie’s formula to compute the denoised estimate at each time step [ 23 ] : \mathbf{f}_{\theta}(\mathbf{x}_{t})=:\frac{1}{\sqrt{\bar{\alpha}_{t}}}\big(\mathbf{x}_{t}-\sqrt{1-\bar{\alpha}_{t}}\epsilon_{\theta}(\mathbf{x}_{t},t)\big)\>, where \bar{\alpha}_{t} is a pre-defined noise schedule, \mathbf{x}_{t} is the noised image at sampling time t , and \epsilon_{\theta} is a pre-trained 2D diffusion model. The SITCOM sampler performs the following procedure over N sampling steps, where \lambda is a regularization parameter and \boldsymbol{\eta}\sim\mathcal{N}(\mathbf{0},\mathbf{I}) [ 2 ] : \displaystyle\mathbf{v}_{t} \displaystyle:=\arg\min_{\mathbf{v}^{\prime}_{t}}\|\mathbf{A}\mathbf{f}_{\theta}(\mathbf{v}^{\prime}_{t})-\mathbf{y}\|_{2}^{2}+\lambda\|\mathbf{v}^{\prime}_{t}-\mathbf{x}_{t}\|_{2}^{2}, ( \texttt{S}_{1} ) \displaystyle\mathbf{x}_{0} \displaystyle:=\mathbf{f}_{\theta}(\mathbf{v}_{t})=\frac{1}{\sqrt{\bar{\alpha}_{t}}}\Big(\mathbf{v}_{t}-\sqrt{1-\bar{\alpha}_{t}}\epsilon_{\theta}(\mathbf{v}_{t},t)\Big), ( \texttt{S}_{2} ) \displaystyle\mathbf{x}_{t-1} \displaystyle=\sqrt{\bar{\alpha}_{t-1}}\mathbf{x}_{0}+\sqrt{1-\bar{\alpha}_{t-1}}\boldsymbol{\eta}_{t}. ( \texttt{S}_{3} ) These steps enforce measurement consistency via the first term in ( S 1 ); forward diffusion consistency through the regularization term in ( S 1 ) and the noise injection (resampling) in ( S 3 ) [ 21 , 17 ] ); and backward diffusion consistency via the “network-regularized” optimization over the input of the diffusion model in ( S 1 ) (i.e., \mathbf{v}^{\prime}_{t} ) to ensure that the generated image \mathbf{x}_{0} aligns with both the measurements and the diffusion prior. In practice, ( S 1 ) is solved using the Adam optimizer [ 14 ] . This idea of network regularization is inspired by Compressed Sensing using Generative Models (CSGM) [ 4 ] , where a pre-trained GAN is used as a prior and optimized over its latent input to satisfy measurement constraints. Prior art in 3D CT via 2D diffusion models: There are two notable methods that have used 2D pre-trained diffusion models for solving 3D CT reconstruction and are closely related to our proposed approach : Diffusion Model-based iterative reconstruction (DiffMBIR) [ 8 ] and Decomposed Diffusion Sampling (DDS) [ 7 ] . A key distinction is that DiffMBIR uses the Stochastic Differential Equation (SDE) solver in [ 13 ] to estimate the image at time 0 for each sampling iteration, while DDS adopts Tweedie’s formula. For high quality results, both methods require hundreds of diffusion sampling steps (see DDS results in Figure 1 ). At each reverse sampling iteration, these methods obtain an estimated image at time 0 for which the denoising steps are applied slice-wise. This estimate is then used to initialize the optimization steps for the following problem: \min_{\mathbf{x}}\|\mathbf{A}\mathbf{x}-\mathbf{y}\|^{2}_{2}+\|\mathbf{D}_{z}\mathbf{x}\|_{1}\>, where \mathbf{D}_{z} is the finite difference matrix along the z -axis. The \ell_{1} norm is used to implicitly enforce spatial continuity between adjacent slices since the DM only models xy -planes [ 8 ] . We also adopt this form of regularization in our work. Since the aforementioned optimization consists of a quadratic data-fidelity term and an \ell_{1} -norm regularizer, both DDS and DiffMBIR solve it using ADMM with Conjugate