Analysis Plug-and-Play Methods for Imaging Inverse Problems
Edward P. Chandler, Shirin Shoushtari, Brendt Wohlberg, Ulugbek S. Kamilov, [0.7em] Washington University in St. Louis · 2025
Read Analysis Plug-and-Play Methods for Imaging Inverse Problems by Edward P. Chandler, Shirin Shoushtari, Brendt Wohlberg, Ulugbek S. Kamilov, [0.7em] Washington University in St. Louis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-15422.txt.
Introduction
Edward Chandler leads a team that reworks a popular way to restore images. The method, called Plug-and-Play, uses a noise removal tool as a stand in for what a clean image should look like. In the standard form, that tool acts on the image itself. The team ask what happens if it acts on the image's edges instead, through its gradient.
They train a noise remover to work in the edge domain, a learned form of an older edge based fix. They then build two ways to fold that tool into image repair steps. Tests on blur removal and enlarging show results on par with the standard form. The work widens the choices for image repair.
Catalog record
| CREATOR | Edward P. Chandler, Shirin Shoushtari, Brendt Wohlberg, Ulugbek S. Kamilov, [0.7em] Washington University in St. Louis |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 18 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-15422
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Analysis Plug-and-Play Methods for Imaging Inverse Problems Edward P. Chandler, Shirin Shoushtari, Brendt Wohlberg, Ulugbek S. Kamilov, [0.7em] Washington University in St. Louis Abstract Plug-and-Play Priors (PnP) is a popular framework for solving imaging inverse problems by integrating learned priors in the form of denoisers trained to remove Gaussian noise from images. In standard PnP methods, the denoiser is applied directly in the image domain, serving as an implicit prior on natural images. This paper considers an alternative analysis formulation of PnP, in which the prior is imposed on a transformed representation of the image, such as its gradient. Specifically, we train a Gaussian denoiser to operate in the gradient domain, rather than on the image itself. Conceptually, this is an extension of total variation (TV) regularization to learned TV regularization. To incorporate this gradient-domain prior in image reconstruction algorithms, we develop two analysis PnP algorithms based on half-quadratic splitting (APnP-HQS) and the alternating direction method of multipliers (APnP-ADMM). We evaluate our approach on image deblurring and super-resolution, demonstrating that the analysis formulation achieves performance comparable to image-domain PnP algorithms. 1 Introduction Imaging inverse problems seek to estimate an image from a set of noisy measurements. A common strategy is to formulate an optimization problem that incorporates both a forward measurement model and a prior that encodes assumptions about the structure of the desired solution. In classical signal processing, handcrafted priors such as total variation (TV) have been widely used to regularize inverse problmes [ 1 ] . While these hand-crafted priors can work well, they often introduce reconstruction artifacts, such as staircasing in TV-regularized solutions [ 2 ] . This limitation arises because handcrafted priors are typically too simplistic to accurately model the complex statistics of natural images. As deep learning image priors have demonstrated superior capabilities in capturing high-dimensional data distributions, learned priors have become central to state-of-the-art solutions for imaging inverse problems [ 3 , 4 ] . Plug-and-play (PnP) methods have been extensively used to incorporate such learned priors, specified by denoisers, for solving inverse problems [ 5 , 6 ] . PnP methods are not only empirically successful but also supported by theoretical analyses that guarantee convergence under certain conditions [ 7 ] . Image Image Gradient Noise Level Noisy Image Gradient Network Output Loss Figure 1: Training pipeline for an image gradient prior. The image gradient is computed from the image, additive white gaussian noise is added with a randomly selected noise level, the noisy gradient and noise level is passed through the network, and the output is compared to the clean image gradient via the loss. Historically, an important direction for the development of image priors was the decomposition of images into transformed features, such as the image gradient [ 1 ] or wavelets [ 8 ] . While such decompositions played a central role in classical signal processing and image reconstruction, they have been largely underutilized in modern deep learning. An important framework in signal processing for incorporating these decompositions in image reconstruction is that of analysis priors [ 9 , 10 ] . In this problem formulation, priors impose some structure, commonly sparsity, on the transformed representation of the reconstructed image. Despite their importance in classical signal processing, analysis priors have received little attention in a deep learning context. While deep learning methods are highly effective in the image domain, the success of classical decompositions motivates their re-examination in modern deep-learning settings. In this work, we develop a learned image gradient prior which is incorporated within an Analysis PnP Half Quadratic Splitting (APnP-HQS) reconstruction algorithm and an Analysis PnP Alternating Direction Method of Multipliers (APnP-ADMM) reconstruction algorithm. We experimentally demonstrate the viability of such priors by showing that they can achieve similar reconstruction performance to those obtained with standard learned image priors. These results demonstrate the potential of modern deep analysis priors, such as learned image gradient priors, when used within reconstruction algorithms for image restoration. 2 Background 2.1 Imaging Inverse Problems Many imaging systems can be formulated as {\bm{y}}={\bm{A}}{\bm{x}}+{\bm{n}}, (1) where {\bm{A}}\in\mathbb{R}^{m\times n} is the forward model of the imaging system, {\bm{x}}\in\mathbb{R}^{n} denotes the image to recover, {\bm{n}}\in\mathbb{R}^{m} represents noise, and {\bm{y}}\in\mathbb{R}^{m} is the measurement. The goal is to solve an inverse problem , where {\bm{x}} is recovered from {\bm{y}} . It is common to formulate the inverse problem as an optimization \mathop{\mathrm{arg\,min}}_{{\bm{x}}}\ f({\bm{x}})+g({\bm{x}}), (2) where f is the data-fidelity term enforcing measurement consistency and g is the prior or regularization term that restricts the feasible solutions of {\bm{x}} . One of the most commonly used f is \frac{1}{2}\|{\bm{A}}{\bm{x}}-{\bm{y}}\|_{2}^{2} , which arises from the maximum likelihood estimation under the assumption of additive white Gaussian noise in {\bm{y}} [ 11 ] . The prior term g is meant to enforce desired features for the reconstructions. A classical example is that of total variation (TV) [ 1 ] , which enforces the piecewise smoothness of images. 2.2 Analysis Signal Priors The analysis formulation of Eq. ( 2 ) places a prior on a transformed version of {\bm{x}} [ 9 , 10 ] . This transformation has historically been a linear map. Letting the linear transformation be {\bm{D}} , Eq. ( 2 ) can be written with an analysis prior as \mathop{\mathrm{arg\,min}}_{{\bm{x}}}\ f({\bm{x}})+g({\bm{D}}{\bm{x}}). (3) Popular versions of {\bm{D}} are the image gradient and wavelet transform [ 1 , 8 ] , and g is commonly a sparsity-enforcing norm, such as the \ell_{1} norm. An example is anistropic TV, where {\bm{D}} is the image gradient and g is the \ell_{1} norm: \|{\bm{D}}{\bm{x}}\|_{1} . The image gradient is the finite difference of the image {\bm{x}} along the horizontal and vertical axes. This can be written as the convolution along the horizontal and vertical axes of the image with the kernel {\bm{d}}=[1,\text{-}1] . In this work, we only consider the case when {\bm{D}} is the image gradient. Algorithm 1 APnP-HQS 0: forward model \mathbf{A} , measurement \bm{y} , gradient denoiser {\mathcal{D}}_{\theta} , image noise level \sigma , denoiser prior strength schedule \sigma_{t} , and regularization parameter \lambda . 1: Initialize {\bm{x}}_{0} from {\bm{y}} ; let \alpha_{t}:=\lambda\sigma^{2}/\sigma_{t}^{2} 2: for t=1 to T do 3: {\bm{z}}_{t}={\mathcal{D}}_{\theta}({\bm{D}}{\bm{x}}_{t-1},\sigma_{t}) 4: {\bm{x}}_{t}=\mathop{\mathrm{arg\,min}}_{{\bm{x}}}\|{\bm{A}}{\bm{x}}-{\bm{y}}\|_{2}^{2}+\alpha_{t}\|{\bm{D}}{\bm{x}}-{\bm{z}}_{t}\|_{2}^{2} 5: end for 6: return {\bm{x}}_{T} Algorithm 2 APnP-ADMM 0: forward model \mathbf{A} , measurement \bm{y} , gradient denoiser {\mathcal{D}}_{\theta} , image noise level \sigma , denoiser prior strength schedule \sigma_{t} , and regularization parameter \lambda . 1: Initialize {\bm{x}}_{0} from {\bm{y}} ; initialize {\bm{s}}_{0} to \bm{0} ; let \alpha_{t}:=\lambda\sigma^{2}/\sigma_{t}^{2} 2: for t=1 to T do 3: {\bm{z}}_{t}={\mathcal{D}}_{\theta}({\bm{D}}{\bm{x}}_{t-1}-{\bm{s}}_{t-1},\sigma_{k}) 4: {\bm{x}}_{t}=\mathop{\mathrm{arg\,min}}_{{\bm{x}}}\ \|{\bm{A}}{\bm{x}}-{\bm{y}}\|_{2}^{2}+\alpha_{t}\|{\bm{z}}_{t}+{\bm{s}}_{t-1}-{\bm{D}}{\bm{x}}\|_{2}^{2} 5: {\bm{s}}_{t}={\bm{s}}_{t-1}+{\bm{z}}_{t}-{\bm{D}}{\bm{x}}_{t} 6: end for 7: return {\bm{x}}_{T} 2.3 Plug-and-Play Priors The Plug-and-Play (PnP) framework solves Eq. ( 2 ) by incorporating a learned prior with a data-fidelity term [ 6 ] . These priors are generally trained to be Gaussian image denoisers, although other paradigms have been explored [ 12 , 13 , 14 , 15 , 16 ] . An important aspect of PnP is that the prior is trained without any knowledge of the inverse problem for which it will be used, i.e. it is trained purely as an image denoiser. Therefore, the PnP framework provides a method to solve any imaging inverse problem that can be formulated as Eq. ( 2 ) without training a