Interpolating between Tikhonov regularization and spectral cutoff

Martin Sæbye Carøe, Mirza Karamehmedović, Pierre Maréchal · 2026

Read Interpolating between Tikhonov regularization and spectral cutoff by Martin Sæbye Carøe, Mirza Karamehmedović, Pierre Maréchal (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-09505.txt.

Introduction

Solving a linear ill-posed operator equation demands regularization, and two classic tools manipulate the spectrum of the pseudo-inverse: Tikhonov regularization and spectral cutoff. Martin Sæbye Carøe and two co-authors introduce a formula interpolating between them in their 2026 paper. One parameter sweeps a family of regularizations with the two classics as limiting cases.

Tuning that parameter to the equation at hand can soften the weaknesses of both endpoints, since neither classic suits every operator. Numerical simulations in signal and image processing demonstrate the approach, showing the interpolated family adapting where pure Tikhonov or pure cutoff would falter. The paper thus turns a binary choice between two regularizers into a continuum with a tunable middle.

Catalog record

CREATORMartin Sæbye Carøe, Mirza Karamehmedović, Pierre Maréchal
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-09505

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Interpolating between Tikhonov regularization and spectral cutoff Martin Sæbye Carøe, Mirza Karamehmedović, Pierre Maréchal Abstract Regularizing a linear ill-posed operator equation can be achieved by manipulating the spectrum of the operator’s pseudo-inverse. Tikhonov regularization and spectral cutoff are well-known techniques within this category. This paper introduces an interpolating formula that defines a one-parameter family of regularizations, where Tikhonov and spectral cutoff methods are represented as limiting cases. By adjusting the interpolating parameter taking into account the specific operator equation under consideration, it is possible to mitigate the limitations associated with both Tikhonov and spectral cutoff regularizations. The proposed approach is demonstrated through numerical simulations in the fields of signal and image processing. 1 Introduction We consider a general linear ill-posed operator equation Tf=g, (1) in which T\colon F\to G is a bounded linear operator from F to G , where F and G are infinite dimensional separable Hilbert spaces. In a number of real world applications, T is such that \inf\left\{\mskip 2.0mu\|\mskip 1.0muTf\mskip 1.0mu\|\vphantom{\big|}\mskip 2.0mu\left|\vphantom{\bigl|}\vphantom{\|\mskip 1.0muTf\mskip 1.0mu\|\vphantom{\big|}\,f\in(\mathop{\mathrm{ker}}T)^{\perp},\;\|\mskip 1.0muf\mskip 1.0mu\|=1}\right.\mskip 2.0mu\,f\in(\mathop{\mathrm{ker}}T)^{\perp},\;\|\mskip 1.0muf\mskip 1.0mu\|=1\mskip 2.0mu\right\}=0. (2) When T is injective, an assumption which will be in force throughout, Condition ( 2 ) boils down to \inf\left\{\mskip 2.0mu\|\mskip 1.0muTf\mskip 1.0mu\|\vphantom{\big|}\mskip 2.0mu\left|\vphantom{\bigl|}\vphantom{\|\mskip 1.0muTf\mskip 1.0mu\|\vphantom{\big|}\|\mskip 1.0muf\mskip 1.0mu\|=1}\right.\mskip 2.0mu\|\mskip 1.0muf\mskip 1.0mu\|=1\mskip 2.0mu\right\}=0. (3) The latter condition results in ill-posedness, meaning that: (i) the range \mathop{\mathrm{ran}}T of T is not closed in G ; (ii) the densely defined pseudo-inverse T^{\dagger}\colon\mathop{\mathrm{ran}}T+\mathop{\mathrm{ker}}T^{*}\to F is unbounded, so that the minimum-norm least squares solution to the linear equation Tf=g does not depend continuously on the data g . The purpose of regularization theory is to provide approximate solutions to ( 1 ) that depend continuously on the data, so as to avoid instability in the inversion process. See [ 1 ] and the references therein for a thorough treatment of regularization. The main objective of this paper is to bridge the gap between two of the most frequently used regularization methods, namely the Tikhonov regularization technique and the so-called spectral cutoff method. We shall propose a family of regularization techniques depending on some interpolating parameter that encompasses both Tikhonov regularization and the spectral cutoff as special (extreme) cases. The proposed filters can be naturally included in learning schemes [ 1 ] for further, data-driven refinement. 2 A family of regularization schemes 2.1 Spectral regularization Prior to defining our interpolating family of regularization schemes, we establish a general theorem on spectral methods (see Theorem 2 below). This theorem is already well-known, but our approach to its proof is new in that we make use of the singular value expansion of general bounded operators. More precisely, we shall make use of the following theorem. Theorem 1 . Let T\colon F\to G be an injective bounded linear operator, where F and G are real Hilbert spaces. There then exist 1. a Borel space (\mathscr{M},\mathscr{B},\mu) with completely separable topology, 2. an unitary operator V\colon L^{2}(\mathscr{M},\mathscr{B},\mu)\to F and an isometry W\colon L^{2}(\mathscr{M},\mathscr{B},\mu)\to G , 3. an essentially bounded measurable function \sigma\colon\mathscr{M}\to\mathds{R} that is strictly positive \mu -almost everywhere, such that T=W[\sigma]V^{*} , in which [\sigma] denotes the operator of multiplication by \sigma . Moreover, \mathop{\mathrm{ran}}W=\overline{\mathop{\mathrm{ran}}T} . See [ 5 , Theorem 3] . The following diagram illustrates the singular value expansion exhibited in the last theorem: {\lx@inpgf@ignorespaces F} {\lx@inpgf@ignorespaces G} {\lx@inpgf@ignorespaces L^{2}(\mathscr{M},\mathscr{B},\mu)} {\lx@inpgf@ignorespaces L^{2}(\mathscr{M},\mathscr{B},\mu)} \scriptstyle{\lx@inpgf@ignorespaces T} \scriptstyle{\lx@inpgf@ignorespaces V} \scriptstyle{\lx@inpgf@ignorespaces[\sigma]} \scriptstyle{\lx@inpgf@ignorespaces W} Under Condition ( 3 ), \mathop{\mathrm{ran}}T is not closed. By [ 5 , Theorem 4] , this implies that \sigma is not bounded away from zero. On the other hand, since \mathop{\mathrm{ran}}W=\overline{\mathop{\mathrm{ran}}T} , \mathop{\mathrm{ker}}T^{*}=(\mathop{\mathrm{ran}}W)^{\perp}=\mathop{\mathrm{ker}}W^{*}. Clearly, the injectivity of T implies that of W , which in turn implies that W^{\dagger}=(W^{*}W)^{-1}W^{*}=W^{*} . As can be easily seen, the following factorizations hold: \displaystyle T^{*} \displaystyle= \displaystyle V[\sigma]W^{*}, \displaystyle T^{*}T \displaystyle= \displaystyle V[\sigma^{2}]V^{*}, \displaystyle T^{\dagger}=(T^{*}T)^{-1}T^{*} \displaystyle= \displaystyle V[\sigma^{-1}]W^{*}. Recall that a family (R_{\alpha}) of bounded operators from G to F is said to be a regularization of T^{\dagger} if there exists a parameter choice rule \begin{array}[]{lcll}\displaystyle\alpha\colon&\displaystyle\mathds{R}_{+}\times G&\longrightarrow&\displaystyle\mathds{R}_{+}\setminus\{0\}\\[0.86108pt] &\displaystyle(\delta,g^{\delta})&\longmapsto&\displaystyle\alpha(\delta,g^{\delta})\end{array} such that (1) \sup\left\{\mskip 2.0mu\|\mskip 1.0mu\alpha(\delta,g^{\delta})\mskip 1.0mu\|\mskip 2.0mu\left|\vphantom{\bigl|}\vphantom{\|\mskip 1.0mu\alpha(\delta,g^{\delta})\mskip 1.0mu\|g^{\delta}\in G,\;\|\mskip 1.0mug^{\delta}-g\mskip 1.0mu\|\leq\delta}\right.\mskip 2.0mug^{\delta}\in G,\;\|\mskip 1.0mug^{\delta}-g\mskip 1.0mu\|\leq\delta\mskip 2.0mu\right\}\to 0 as \delta\downarrow 0 ; (2) \sup\left\{\mskip 2.0mu\|\mskip 1.0muR_{\alpha(\delta,g^{\delta})}g^{\delta}-T^{\dagger}g\mskip 1.0mu\|\mskip 2.0mu\left|\vphantom{\bigl|}\vphantom{\|\mskip 1.0muR_{\alpha(\delta,g^{\delta})}g^{\delta}-T^{\dagger}g\mskip 1.0mu\|g^{\delta}\in G,\;\|\mskip 1.0mug^{\delta}-g\mskip 1.0mu\|\leq\delta}\right.\mskip 2.0mug^{\delta}\in G,\;\|\mskip 1.0mug^{\delta}-g\mskip 1.0mu\|\leq\delta\mskip 2.0mu\right\}\to 0 as \delta\downarrow 0 ; Recall also that (R_{\alpha}) is a regularization of T^{\dagger} if (R_{\alpha}) converges pointwise to T^{\dagger} on its domain \mathscr{D}(T^{\dagger})=\mathop{\mathrm{ran}}T+(\mathop{\mathrm{ran}}T)^{\perp}=\mathop{\mathrm{ran}}T+\mathop{\mathrm{ker}}T^{*}. See [ 6 , Proposition 3.4] . The following result is well-known; however, we here propose a novel proof: Theorem 2 . Let T\colon F\to G be an injective bounded operator with singular value expansion T=W[\sigma]V^{*} as in Theorem 1 . Assume that \sigma is not bounded away from zero, so that the inverse problem Tf=g is ill-posed. Let q\colon\mathds{R}_{+}^{*}\times\mathds{R}_{+}\to\mathds{C} be such that (A1) for every (\alpha,\sigma)\in\mathds{R}_{+}^{*}\times\mathds{R}_{+} , |\mskip 1.0muq(\alpha,\sigma)\mskip 1.0mu|\leq M for some positive constant M , (A2) for every \sigma\in\mathds{R}_{+} , |\mskip 1.0muq(\alpha,\sigma)\mskip 1.0mu|\leq c_{\alpha}\sigma , in which c_{\alpha} is some positive constant. Then R_{\alpha}:=V[\sigma^{-1}q(\alpha,\sigma)]W^{*} is well-defined and bounded, and \|\mskip 1.0muR_{\alpha}\mskip 1.0mu\|\leq c_{\alpha} . Moreover, if (A3) for every \sigma\in\mathds{R}_{+} , \lim_{\alpha\downarrow 0}q(\alpha,\sigma)=1 , then (R_{\alpha}) is a regularization of T^{\dagger} . Proof. Let g\in\mathscr{D}(T^{\dagger}) and let \bar{g} be its projection onto the closure of the range of T . Observe that, since g belongs to the domain of T^{\dagger} , its projection \bar{g} must actually belong to the range of T . Hence \bar{g}=Tf for some f\in F , from which we deduce that [\sigma^{-1}]W^{*}\bar{g}=[\sigma^{-1}]W^{*}W[\sigma]V^{*}f=V^{*}f\in L^{2}(\mathscr{M},\mathscr{B},\mu). By Assumption (A1), [q(\alpha,\sigma)][\sigma^{-1}]W^{*}g=[q(\alpha,\sigma)]V^{*}f also belongs to L^{2}(\mathscr{M},\mathscr{B},\mu) , which in turn implies that V[q(\alpha,\sigma)][\sigma^{-1}]W^{*}g=:R_{\alpha}g is well-defined. Under Assumption (A2), we have, for every g\in G , \displaystyle\left\|\mskip 2.0muR_{\alpha}g\vphantom{\bigl|}\mskip 2.0mu\right\|^{2} \displaystyle= \displaystyle\left\|\mskip 2.0muV[\sigma^{-1}q(\alpha,\sigma)]W^{*}g\vphantom{\bigl|}\mskip 2.0mu\right\|^{2} \displaystyle= \displaystyle\left\|\mskip 2.0mu[\sigma^{-1}q(\alpha,\sigma)]W^{*}g\vphantom{\bigl|}\mskip 2.0mu\right\|^{2} \displaystyle\leq \displaystyle\left\|\mskip 2.0mu\sigma^{-1}q(\alpha,\sigma)\vphantom{\bigl|}\mskip 2.0mu\right\|_{\infty}^{2}\left\|\mskip 2.0muW^{*}g\vphantom{\bigl|}\mskip 2.0mu\right\|^{2} \displaystyle= \displaystyle\left\|\mskip 2.0mu\sigma^{-1}q(\alpha,\sigma)\vphantom{\bigl|}\mskip 2.0mu\right\|_{\infty}^{2}\left\|\mskip 2.0mug\vphantom{\bigl|}\mskip 2.0mu\right\|^{2} \displaystyle\leq \displaystyle c_{\alpha}^{2}\left\|\mskip 2.0mug\vphantom{\bigl|}\mskip 2.0mu\right\|^{2}, in which the second equality is due to the unitarity of V and the third equality is due to the fact that W is an isometry (so that W^{*}W=I , where I denotes the identity). The first assertion in the theorem follows. Next, let f^{\dagger}:=T^{\dagger}g and f_{\alpha}:=R_{\alpha}g . From the definition of R_{\alpha} and the formula for T^{\dagger} , we readily see that f^{\dagger}-f_{\alpha}=V\big[\sigma^{-1}(1-q(\alpha,\sigma))\big]W^{*}g=V\big[1-q(\alpha,\sigma)\big][\sigma^{-1}]W^{*}\bar{g}=V\big[1-q(\alpha,\sigma)\big]V^{*}f. Therefore, using the unitarity of V , \left\|\mskip 2.0muf^{\dagger}-f_{\alpha}\vphantom{\bigl|}\mskip 2.0mu\right\|^{2}=\left\|\mskip 2.0mu\big[1-q(\alpha,\sigma)\big]V^{*}f\vphantom{\bigl|}\mskip 2.0mu\right\|_{L^{2}(\mathscr{M},\mathscr{B},\mu)}^{2}=\int\left|\mskip 2.0mu1-q(\alpha,\sigma)\vphantom{\bigl|}\mskip 2.0mu\right|^{2}\big(V^{*}f(\sigma)\big)^{2}\,\mathrm{d}\mu(\sigma). Finally, under Assumption (A3), the function \sigma\mapsto\left|\mskip 2.0mu1-q(\alpha,\sigma)\vphantom{\bigl|}\mskip 2.0mu\right|^{2} converges pointwise to zero, and Lebesgue’s dominated convergence theorem then implies that f_{\alpha}\to f^{\dagger} as \alpha\downarrow 0 . ∎ Notice that in the above theorem, q is allowed to take complex values. Notice also that q(\alpha,\cdot) need only be defined on the range of \sigma . The latter theorem generalizes Theorem 4.9 in [ 4 ] , in which compactness of T was assumed. This special case now appears as a corollary. If we let T be a compact operator, then the singular value expansion takes the form Tx=\sum_{n=1}^{\infty}\sigma_{n}(g_{n}\otimes f_{n})f=\sum_{n=1}^{\infty}\sigma_{n}\left\langle\vphantom{\bigl|}\mskip 2.0muf_{n}\mskip 2.0mu,\mskip 2.0muf\mskip 2.0mu\right\rangle g_{n}, in which the \sigma_{n} are the so-called singular values, (f_{n}) is a Hilbert basis of F and (g_{n}) is a Hilbert basis of \overline{\mathop{\mathrm{ran}}T} . This is a particular case of Theorem 1 , in which the Borel space is l^{2}_{\mathds{R}} , the space of square summable real sequences, endowed with the counting measure. It can be easily checked that

Read the complete text