Neural operators for solving nonlinear inverse problems
Otmar Scherzer [email protected], Thi Lan Nhi Vu [email protected], Jikai Yan [email protected] · 2025
Read Neural operators for solving nonlinear inverse problems by Otmar Scherzer [email protected], Thi Lan Nhi Vu [email protected], Jikai Yan [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-19347.txt.
Introduction
Otmar Scherzer, Thi Lan Nhi Vu, and Jikai Yan analyze neural operators as stand-ins inside a classic fix for ill-posed problems. Their 2025 paper studies operator equations where the rule itself is never written down: only input-output training pairs reveal it. Neural operators can learn such rules even in endless dimensions, which suits inverse problems well.
Tikhonov regularization does the solving, with the learned operator as surrogate. The analysis balances three error sources: how well the network mimics the rule, the strength of the penalty, and the noise in the data. The team also widens the known approximation results to rougher function spaces that inverse problems demand. Network shape and training get a hard look, and numerical trials close the paper.
Catalog record
| CREATOR | Otmar Scherzer [email protected], Thi Lan Nhi Vu [email protected], Jikai Yan [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-19347
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Neural operators for solving nonlinear inverse problems Otmar Scherzer [email protected], Thi Lan Nhi Vu [email protected], Jikai Yan [email protected] Abstract We consider solving a probably infinite dimensional operator equation, where the operator is not modeled by physical laws but is specified indirectly via training pairs of the input-output relation of the operator. Neural operators have proven to be efficient to approximate operators with such information. In this paper, we analyze Tikhonov regularization with neural operators as surrogates for solving ill-posed operator equations. The analysis is based on balancing approximation errors of neural operators, regularization parameters, and noise. Moreover, we extend the approximation properties of neural operators from sets of continuous functions to Sobolev and Lebesgue spaces, which is crucial for solving inverse problems. Finally, we address the problem of finding an appropriate network structure of neural operators. \newpagestyle headers \headrule \sethead [ 1][ Authors][]1 \setfoot 1 Faculty of Mathematics University of Vienna Oskar-Morgenstern-Platz 1 A-1090 Vienna, Austria 2 Johann Radon Institute for Computational and Applied Mathematics (RICAM) Altenbergerstraße 69 A-4040 Linz, Austria 3 Christian Doppler Laboratory for Mathematical Modeling and Simulation of Next Generations of Ultrasound Devices (MaMSi) Oskar-Morgenstern-Platz 1 A-1090 Vienna, Austria 1. Introduction In this paper, we consider nonlinear inverse problems , which are formulated as finding the solution of a nonlinear operator equation F[{\tt x}]={\tt y}\;, (1.1) where the operator F:\mathcal{D}(F)\subseteq{\tt X}\to{\tt Y} is defined on the domain \mathcal{D}(F) , which is a subset of an infinite-dimensional Hilbert space {\tt X} , and maps into a Hilbert space {\tt Y} . Inverse problems are often ill-posed, meaning that their solutions do not depend continuously on the data {\tt y} . Specifically, if {\tt y}^{\delta}\to{\tt y} , there is no guarantee that a solution {\tt x}^{\delta} of Equation 1.1 with data {\tt y}^{\delta} (presumably it exists) will converge to a solution of Equation 1.1 . Therefore, a regularization technique needs to be applied to solve Equation 1.1 in a stable manner. One of the most widely studied regularization method is Tikhonov regularization, which approximates a solution of Equation 1.1 by a minimizer {\tt x}^{\alpha\delta} of the quadratic Tikhonov functional \mathbf{T}^{\alpha\delta}[{\tt x}]:=\|F[{\tt x}]-{\tt y}^{\delta}\|_{\tt Y}^{2}+\alpha\|{\tt x}-{\tt x}^{(0)}\|_{\tt X}^{2}\quad\text{over}\quad{\tt x}\in\mathcal{D}(F), (1.2) with \alpha>0 for some fixed point {\tt x}^{(0)}\in\mathcal{D}(F) . It is common to put {\tt x}^{(0)}=0 when dealing with linear operator, and we do the same here. Tikhonov regularization has been generalized to convex regularization, which consists in minimization of \mathbf{T}_{\mathcal{R}}^{\alpha\delta}[{\tt x}]:=\|F[{\tt x}]-{\tt y}^{\delta}\|_{\tt Y}^{2}+\alpha\mathbf{R}[{\tt x}]\quad\text{over}\quad{\tt x}\in\mathcal{D}(F), (1.3) where \mathbf{R}:{\tt X}\to[0,\infty] is a functional, typically convex and proper. The most important generalized variational regularization methods are total variation minimization (see [ 26 ] ) and sparsity regularization (see [ 13 ] ). A general convex regularization functional is often associated with a formulation in a Banach space (see, for instance, [ 27 , 29 ] ). We do not consider these generalizations, because the considered simple examples have been evaluated more thoroughly in the quadratic setting. Generalizations can, of course, be done, but they lead to technical complications (see [ 24 ] ). For computational purposes, the Tikhonov functional is discretized in the following way: (i) The space {\tt X} is approximated by a sequence of nested subspaces \left\{{\tt X}_{\tt m}:{\tt m}\in\mathds{N}\right\} such that \overline{\bigcup_{{\tt m}\in\mathds{N}}{\tt X}_{\tt m}}=\overline{\lim_{{\tt m}\to\infty}{\tt X}_{\tt m}}={\tt X}\;. (ii) A family of operators \left\{F_{\tt n}:{\tt n}\in\mathds{N}\right\} is constructed to approximate F uniformly in a bounded neighborhood of a solution {\tt x}^{\dagger} of Equation 1.1 . Specifically, there exists a ball \mathcal{B}_{\tt r}({\tt x}^{\dagger}) with radius {\tt r}>0 such that \|F[{\tt x}]-F_{\tt n}[{\tt x}]\|_{\tt Y}\leq\rho_{\tt n}\quad\text{for all}\quad{\tt x}\in\mathcal{D}(F)\cap\mathcal{B}_{\tt r}({\tt x}^{\dagger}), (1.4) where \rho_{\tt n}\to 0 as {\tt n}\to\infty . Discretized Tikhonov regularization consists in approximate minimization of the functional \mathbf{T}_{{\tt m}{\tt n}}^{\alpha\delta}[{\tt x}]:=\|F_{\tt n}[{\tt x}]-{\tt y}^{\delta}\|_{\tt Y}^{2}+\alpha\|{\tt x}-{\tt x}^{(0)}\|_{\tt X}^{2} (1.5) over {\tt X}_{\tt m} . We denote an approximate minimizer of \mathbf{T}_{{\tt m}{\tt n}}^{\alpha\delta} by {\tt x}^{\alpha\delta}_{{\tt m}{\tt n}}\in{\tt X}_{\tt m}\cap\mathcal{D}(F)\;. (1.6) We work with approximate minimizer because, in general, the minimizer of the discrete functional \mathbf{T}_{{\tt m}{\tt n}}^{\alpha\delta} (see Equation 1.5 ) might not exist. In practice, one computes some {\tt x}\in{\tt X} such that \mathbf{T}_{{\tt m}{\tt n}}^{\alpha\delta}[{\tt x}]-\inf_{{\tt X}_{\tt m}}\mathbf{T}_{{\tt m}{\tt n}}^{\alpha\delta}\leq\eta\,, (1.7) which means that we look for an element {\tt x}\in{\tt X} such that \mathbf{T}_{{\tt m}{\tt n}}^{\alpha\delta}[{\tt x}] meets the infimum with a tolerance \eta , for which the magnitude can be analytically specified. Such an element {\tt x}_{{\tt m}{\tt n}}^{\alpha\delta\eta} is referred to as an approximate minimizer. More details can be found in [ 22 , 24 ] . Traditionally, spline spaces have been used for {\tt X}_{\tt m} , and finite element operators have been used for F_{\tt n} (see [ 21 , 22 , 24 ] ). In this setting, discretizations {\tt m} and {\tt n} can be determined such that {\tt x}_{{\tt m}{\tt n}}^{\alpha\delta\eta} is an optimal approximation in {\tt X}_{\tt m} of the minimum-norm solution {\tt x}^{\dagger} of Equation 1.1 . The conceptual difference of neural operators is that they are learned from training data (see Equation 3.4 below). To simplify the analysis, we constrain ourselves to operator approximations rather than to finite-dimensional approximations of {\tt X} . That is, we consider the operator approximation F_{\tt n} defined on {\tt X} rather than on {\tt X}_{\tt m} . This assumption allows us to reduce the technicality of this paper. The central question of this paper is whether the approximate minimizers of the Tikhonov functionals defined on {\tt X} with neural operators F_{\tt n} approximating F , namely, \mathbf{T}_{{\tt n}}^{\alpha\delta}[{\tt x}]:=\|F_{\tt n}[{\tt x}]-{\tt y}^{\delta}\|_{\tt Y}^{2}+\alpha\|{\tt x}-{\tt x}^{(0)}\|_{\tt X}^{2}\,, (1.8) are optimal approximations of the regularized solutions of the functional \mathbf{T}^{\alpha\delta} , defined in Equation 1.2 . Neural operators, as used in this paper, are defined as DeepONet in [ 20 ] . The idea of neural operator traces back to [ 9 , 10 ] , where the concepts of learning functionals and operators were first developed. Building on the DeepONet framework and inspired by the physics-informed neural networks [ 25 ] , other types of neural operators have been developed in [ 30 ] . In parallel with DeepONet-based implementations, the Fourier-neural operator has been introduced in [ 19 ] . One of the difficulties associated with neural operators is that quantitative error estimates are not as advanced as those for finite difference and finite element approximation operators. Therefore, in turn, quantitative regularization theory, as established for classical approximation methods as in [ 21 , 22 , 24 ] , needs to be developed, which is a concern of this paper. In particular, we concentrate on simple examples to explain the technical challenges: (i) Examples of inverse problems: First, we recall two examples of inverse problems, originally proposed in [ 14 ] , which demonstrate the optimal interactions between discretizations {\tt m} , {\tt n} , noise \delta and the regularization parameter \alpha . We consider these examples first in the classic setting with finite element approximations F_{\tt n} (see Section 2 ), and subsequently with neural operators learned from training samples (see Section 5 and Section 6 ). (ii) Challenges of neural operators: We recall the definition of neural operators from [ 20 ] and highlight some challenges when applying them as part of a regularization