Whiteness-based bilevel estimation of weighted TV parameter maps for image denoising

Monica Pragliola, Luca Calatroni, Alessandro Lanza · 2025

Read Whiteness-based bilevel estimation of weighted TV parameter maps for image denoising by Monica Pragliola, Luca Calatroni, Alessandro Lanza (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-07814.txt.

Introduction

Monica Pragliola, Luca Calatroni, and Alessandro Lanza wrote this 2025 mathematics paper on cleaning noise from images without any training data. Total variation denoising smooths noise while keeping edges, but its strength should vary across the picture. Guessing that strength map is the hard part.

Their approach nests two optimizations. The inner one denoises with a given map; the outer one scores the map by how white, or pattern-free, the removed residual looks. No reference images and no noise level are needed, which makes the method fully unsupervised. An early stopping rule, tuned on natural images, guards against fitting the noise itself. Tests compare supervised and unsupervised versions for both single and per-pixel settings. The unsupervised route holds up well.

Catalog record

CREATORMonica Pragliola, Luca Calatroni, Alessandro Lanza
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-07814

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Whiteness-based bilevel estimation of weighted TV parameter maps for image denoising Monica Pragliola, Luca Calatroni, Alessandro Lanza Abstract We consider a bilevel optimisation strategy based on normalised residual whiteness loss for estimating the weighted total variation parameter maps for denoising images corrupted by additive white Gaussian noise. Compared to supervised and semi-supervised approaches relying on prior knowledge of (approximate) reference data and/or information on the noise magnitude, the proposal is fully unsupervised. To avoid noise overfitting an early stopping strategy is used, relying on simple statistics of optimal performances on a set of natural images. Numerical results comparing the supervised/unsupervised procedures for scalar/pixel-dependent parameter maps are shown. 1 Introduction Variational methods are a popular paradigm to overcome the difficulties related to inverse imaging problems: they seek an estimate of the unknown image by minimizing a functional encoding information on the noise and prior beliefs on the image. For image denoising, denoting by \mathbf{y}\in{\mathbb{R}}^{n} the (vectorised) data corrupted by Additive White Gaussian Noise (AWGN), variational methods solve \mathbf{x}^{*}(\bm{\lambda})\in\argmin_{\mathbf{x}\in{\mathbb{R}}^{n}}\left\{\frac{1}{2}\|\mathbf{x}-\mathbf{y}\|_{2}^{2}+R(\mathbf{x};\bm{\lambda})\right\}\,, (2) where \mathbf{x}^{*} depends on a certain number of parameters \bm{\lambda}\in\Lambda possibly involved in the so-called regularisation term R . In general, flexible models are characterised by a large number of parameters for which robust selection strategies need to be introduced. How to properly select parameters in variational models is an issue that has attracted the interest of many researchers working on inverse problems. Strategies for the selection of \bm{\lambda} maps in variational models can be divided into supervised, semi-supervised and unsupervised. Supervised methods rely on the existence of datasets of groundtruth and corrupted data that allow to customise the regularisation on a specific class of images [ 12 ] . Semi-supervised methods exploit the availability of partial information, such as the noise statistics - see, e.g. the Discrepancy Principle (DP) [ 16 ] or its bilevel counterpart [ 9 ] , and the Stein’s Unbiased Risk Estimator (SURE), all requiring to know the noise level. Unsupervised methods solely rely on quantities depending on the data \mathbf{y} . Empirical approaches for selecting a single regularisation parameter \bm{\lambda}=\lambda , such as the L-curve [ 4 ] or the Generalised Cross Validation [ 6 ] , belong to this class, which also includes strategies detecting a general number of parameters - see the recent Unknown Noise level SURE (UNSURE) [ 21 ] and references therein. Among the unsupervised approaches, in the last years attention has been given to methods observing that a good reconstruction is such that the residual image \bm{r}^{*}(\bm{\lambda}):=\mathbf{y}-\mathbf{x}^{*}(\bm{\lambda}) is close to the noise realisation degrading the data in terms of its spectrum; this can be done, e.g., enforcing whiteness of the residual, whenever applicable [ 1 ] . In [ 13 ] , the authors introduced the Residual Whiteness Principle (RWP) in presence of AWGN for setting a scalar regularisation parameter \lambda . In [ 20 ] , for the same problem, the RWP has been formulated as a bilevel task, where the upper loss measures the whiteness of the residual, and compared to other supervised or semi-supervised losses. Recently, a general bilevel formulation of the RWP, called Generalised Whiteness Principle (GWP), applicable for the estimation of a general number of parameters under the corruption of non white but whitenable noises, has been proposed [ 2 ] . Nonetheless, the GWP has been only applied to set a small number of parameters and the bilevel task is solved approximately due to the presence of non-smooth lower cost functionals. In this work, our goal is to extend the bilevel framework introduced in [ 20 ] for the estimation of a single parameter \lambda to the case in which the variational model involves a large number of unknown parameters \bm{\lambda} . We are exploring the potential of the whiteness loss while mitigating some of the drawbacks that the GWP formulated in [ 2 ] brings along when applied to such challenging scenario. Here, our interest is focused on the selection of the parameters defining a space-variant regularisation term [ 18 ] for the denoising problem under the action of AWGN; more specifically, we are considering the following variational model \!\!\!\!\!\mathbf{x}^{*}(\bm{\lambda}){\in}\argmin_{\mathbf{x}\in{\mathbb{R}}^{n}}\left\{\frac{1}{2}\|\mathbf{x}-\mathbf{y}\|_{2}^{2}{+}\mathrm{WTV}(\mathbf{x};\bm{\lambda})\right\}\,,\,\mathrm{WTV}(\mathbf{x};\bm{\lambda}){=}\sum_{i=1}^{n}\lambda_{i}\|(\bm{\mathrm{D}}\mathbf{x})_{i}\|_{2}\,, (3) where the Weighted Total Variation (WTV) term is a weighted version of the TV regulariser [ 19 ] , and allows to tune the amount of regularisation pixelwise. Numerical tests show that the whiteness principle returns informative \bm{\lambda} -maps, and suggest that its employment in highly-parametrised settings could be beneficial. 2 Bilevel estimation of WTV parameter maps We consider a bilevel optimisation approach to compute the optimal parameters \widehat{\bm{\lambda}} for the WTV regulariser in ( 3 ) given a noisy image \mathbf{y}\in{\mathbb{R}}^{n} , i.e. we consider \displaystyle\widehat{\bm{\lambda}}\in \displaystyle\argmin_{\bm{\lambda}\,\in\,\Lambda}~\mathcal{Q}(\mathbf{x}^{*}(\bm{\lambda})):=\frac{1}{2}\|\bm{\rho}(\mathbf{x}^{*}(\bm{\lambda}))\|_{2}^{2} (4) \displaystyle\text{s.t.}\quad\mathbf{x}^{*}(\bm{\lambda})\in\argmin_{\mathbf{x}\in{\mathbb{R}}^{n}}~\frac{1}{2}\|\mathbf{x}-\mathbf{y}\|_{2}^{2}+\textsc{WTV}(\mathbf{x};\bm{\lambda}), (5) where \mathcal{Q} is a metric assessing the quality of the reconstruction \mathbf{x}^{*}(\bm{\lambda}) depending on either the availability of reference data and/or some knowledge on the noise/problem statistics, with \bm{\rho}(\cdot) being chosen accordingly. Note that although several approximation techniques have been considered to address bilevel problems with non-smooth lower-level constraints (see, e.g., [ 17 ] ), we restrict in the following to the more simple case where in ( 4 )-( 5 ) smoothness is assumed for the lower-level variational constraint, so as to apply implicit differentiation w.r.t. \bm{\lambda} by means of the implicit function theorem, see, e.g. [ 12 , 10 ] . We will thus consider a smoothed version of ( 3 ) depending on a smoothing parameter 0<\epsilon\ll 1 , \textsc{WTV}_{\epsilon}(\mathbf{x};\bm{\lambda})=\sum_{i=1}^{n}\lambda_{i}~h_{\epsilon}((\mathbf{D}\mathbf{x})_{i})\,,\quad h_{\epsilon}(\bm{v})=\begin{cases}\frac{3}{4\epsilon}\|\bm{v}\|_{2}^{2}-\frac{1}{8\epsilon^{3}}\|\bm{v}\|_{2}^{4}\quad&\quad\text{if }\|\bm{v}\|_{2}<\epsilon\\ \|\bm{v}\|_{2}-\frac{3\epsilon}{8}\quad&\quad\text{if }\|\bm{v}\|_{2}\geq\epsilon\end{cases}, (6) with h_{\epsilon}:{\mathbb{R}}^{2}\to{\mathbb{R}}_{\geq 0} a C^{2} -Huber smoothing function. The smoothed functional F_{\epsilon}(\mathbf{x};\mathbf{y},\bm{\lambda}):=\frac{1}{2}\|\mathbf{x}-\mathbf{y}\|_{2}^{2}+\textsc{WTV}_{\epsilon}(\mathbf{x};\bm{\lambda}) (7) is thus C^{2} and 1 -strongly convex. We report in the following its main properties whose proof follows easily from [ 20 , Proposition III.1] . In the following proposition, \odot denotes element-wise multiplication while \bm{\Lambda}:=[\bm{\lambda}\,;\bm{\lambda}]\in{\mathbb{R}}^{2n}_{>0} . Proposition 1 The functional F_{\epsilon} defined in ( 7 ) is twice continuously differentiable and 1 -strongly convex on {\mathbb{R}}^{n} , hence it admits a unique minimiser. Its gradient \bm{\nabla}_{\mathbf{x}}F_{\epsilon}\in{\mathbb{R}}^{n} and Hessian \bm{\nabla}^{2}_{\mathbf{x}}F_{\epsilon}\in{\mathbb{R}}^{n\times n} are given by \displaystyle\bm{\nabla}_{\mathbf{x}}\,F_{\epsilon}(\mathbf{x};\mathbf{y},\bm{\lambda}) \displaystyle= \displaystyle\left(\mathbf{x}-\mathbf{y}\right)+\bm{\lambda}\odot\>\bm{\mathrm{D}}^{\mathrm{T}}\,\bm{\nabla}_{\mathbf{x}}H_{\epsilon}(\bm{\mathrm{D}}\mathbf{x}), \displaystyle\bm{\nabla}^{2}_{\mathbf{x}}\,F_{\epsilon}(\mathbf{x};\mathbf{y},\bm{\lambda}) \displaystyle= \displaystyle\bm{\mathrm{I}}_{n}+\mathbf{D}^{\mathrm{T}}\,\mathrm{diag}(\bm{\Lambda})\bm{\nabla}^{2}H_{\epsilon}(\bm{\mathrm{D}}\mathbf{x})\,\mathbf{D}, (8) where \bm{\nabla}H_{\epsilon} and \bm{\nabla}^{2}H_{\epsilon} denote the vector (respectively, matrix) of first-(respectively, second-)order derivatives of H_{\epsilon}(\bm{z}):=\sum_{i=1}^{n}h_{\epsilon}(z_{i}) w.r.t. \bm{z}=\mathbf{D}\mathbf{x} and \mathrm{diag}(\bm{\Lambda})\in\mathbb{R}^{2n\times 2n}_{>0} is the diagonal matrix having \bm{\Lambda} on the diagonal. By defining \lambda_{\textsc{max}}:=\|\bm{\lambda}\|_{\infty} , the gradient \bm{\nabla}_{\mathbf{x}}F_{\epsilon} is thus L_{\lambda_{\textsc{max}},\epsilon} -Lipschitz continuous, and \small L_{\lambda_{\textsc{max}},\epsilon}\>{=}\>\max_{\mathbf{x}\in{\mathbb{R}}^{n}}\left\|\bm{\nabla}^{2}_{\mathbf{x}}F_{\epsilon}(\mathbf{x};\mathbf{y},\bm{\lambda})\right\|_{2}\>{\leq}\;1+\frac{12\,\lambda_{\textsc{max}}}{\epsilon}\;{=:}\;\,\overline{L}_{\lambda_{\textsc{max}},\epsilon}. (9) In the context of supervised approaches, the upper loss may be chosen as (half) the mean squared error (MSE) between the reference image \overline{\mathbf{x}} and the reconstruction \mathbf{x}^{*}(\bm{\lambda}) [ 12 , 7 ] , so as to maximise the Signal-to-Noise-Ratio (SNR): \mathcal{Q}_{\text{MSE}}(\mathbf{x}^{*}(\bm{\lambda});\overline{\mathbf{x}})=\frac{1}{2}\|\bm{\rho}(\mathbf{x}^{*}(\bm{\lambda}))\|_{2}^{2}\,,\quad\bm{\rho}(\mathbf{x}^{*}(\bm{\lambda})):=\frac{1}{\sqrt{n}}(\mathbf{x}^{*}(\bm{\lambda})-\overline{\mathbf{x}})\,. (10) In our settings, the MSE loss is employed for the computation of benchmark results but its adoption is unfeasible in practice. Assuming that no information is available on the noise level and on the reference image, a natural choice is to consider the bilevel counterpart of the RWP, formally introduced in [ 20 ] , that amounts to maximise the whiteness of the residual image \bm{r}^{*}(\bm{\lambda}) via minimisation of (half) the squared norm of its sample normalised auto-correlation \bm{\gamma}(\bm{r}^{*}(\bm{\lambda})) : \mathcal{Q}_{\text{white}}(\mathbf{x}^{*}(\bm{\lambda});\mathbf{y}){=}\frac{1}{2}\|\bm{\rho}(\mathbf{x}^{*}(\bm{\lambda}))\|_{2}^{2}\,,\;\bm{\rho}(\mathbf{x}^{*}(\bm{\lambda})){:=}\bm{\gamma}(\bm{r}^{*}(\bm{\lambda})){=}\frac{\bm{r}^{*}(\bm{\lambda})~\hbox to7.52pt{\vbox to7.52pt{\pgfpicture\makeatletter\hbox{\hskip 3.75932pt\lower-3.75932pt\hbox to0.0pt{\lxSVG@begingroup@{_scopebegin=1} \lxSVG@begingroup@{stroke=#000000} \lxSVG@begingroup@{fill=#000000} \lxSVG@setlinewidth{\the\pgflinewidth}\lxSVG@begingroup@{stroke-width=0.4pt} \lx@inpgf@ignorespaces\nullfont\hbox to0.0pt{\lxSVG@begingroup@{_scopebegin=1} { {{}}\lx@inpgf@ignorespaces\hbox{\hbox{{\lxSVG@begingroup@{_scopebegin=1} {{}{{{}}}{{}}{}{}{\lx@inpgf@ignorespaces}{\lx@inpgf@ignorespaces}{}{}{}{}{}{{}\lxSVG@stroke\lxSVG@drawpath@unclipped{M 4.93 0 C 4.93 2.72 2.72 4.93 0 4.93 C -2.72 4.93 -4.93 2.72 -4.93 0 C -4.93 -2.72

Read the complete text