Spotlight, priorsketching and Bayesian approximation error paradigms

D Calvetti, E Somersalo · 2026

Read Spotlight, priorsketching and Bayesian approximation error paradigms by D Calvetti, E Somersalo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-26254.txt.

Introduction

Calvetti and Somersalo compared two ways to handle model error in large inverse problems. In such problems, a cheap stand-in model takes the place of a costly full model. The Bayesian approximation error method and spotlight inversion by orthogonal projection both cut clutter, yet the pair showed the two are close kin without being the same. Worked cases in X-ray tomography and electrical impedance tomography showed the shared clutter control and a tie to random sketching schemes.

Catalog record

CREATORD Calvetti, E Somersalo
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60059
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.26254

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Spotlight, priorsketching and Bayesian approximation error paradigms D Calvetti, E Somersalo Abstract A way to lower computational cost in large scale inverse problems and problems depending on poorly known model parameters is to replace the detailed model by an approximate one. Inverse problems are typically ill-posed, and the model discrepancy introduced by using approximate models often shows up in the computed solutions as disturbing artifacts or blurring. In this article, we consider two methods of addressing certain types of modeling errors, the Bayesian approximation error (BAE) method and linear algebraic spotlight inversion to suppress clutter in the computational model by orthogonal projections. Through the process of analyzing the two approaches, we show that they turn out to be closely related but not equivalent, and we highlight a connection to sketching schemes in randomized linear algebra. The similarities between the methods and their successful suppression of most of the clutter effects is elucidated with two computed examples, one addressing of X-ray tomography and the other electrical impedance tomography. 1 Introduction A common challenge in computational inverse problems is to strike a balance between the accuracy and complexity of the computational models for the forward problem. This is especially the case for forward models based on ordinary or partial differential equations when the unknowns to be estimated are distributed parameters. It is well known that capturing the detailed features of distributed parameters requires dense discretization, leading to a high dimensional representation that may make the inverse solvers very costly, as typically repeated evaluations of the forward model are required. Another source of modeling errors that needs to be addressed in a suitable manner is the dependence of the forward model on poorly known parameters, referred to as nuisance parameters in the statistics literature, specifying, e.g., the geometric shape of the domain, to which the observed quantity may have a high sensitivity. Nuisance parameters can be included as part of the unknown to be estimated from the data, however this may complicate the inverse problems, e.g., when the data depend linearly on the unknowns of primary interest but non-linearly on the nuisance parameters. One way to overcome the curse of dimensionality is to replace the detailed model with computationally less expensive surrogate models of lower dimensionality. Similarly, unknown model parameters may be replaced by fixed values that are believed to represent in some mean sense the reality. It has been shown that resorting to a less accurate forward model introduces a model discrepancy that can be viewed as a modeling error in the data. Due to the inherent ill-posedness of inverse problems, in the inversion process errors in the data may be enhanced by the ill-conditioning, significantly degrading the computed solutions. Modeling errors are typically quite different from observation errors, often being characterized by nonzero mean and strong correlation among some of the components, which is a reason why neglecting to address their presence may result in the presence of annoying artifacts in the solution. Therefore compensating for the modeling error introduced when replacing the forward model with an approximate models is a very important topic in the computed solution of inverse problems. The Bayesian framework for inverse problems [ 14 , 7 ] , where all unknowns are modeled as random variables, provides a natural environment to address the modeling errors. Bayesian approximation error (BAE) analysis was originally introduced in [ 14 , 15 ] , and its effectiveness was illustrated in a wide range of inverse problems; see, e.g., [ 1 , 21 , 20 ] [ 12 , 19 , 9 , 13 ] . The idea proposed in [ 15 ] is to generate a sample of realizations of the approximation error by means of drawing first a sample from the prior density of the unknown of primary interest and possible nuisance parameters, and computing the differences between the outputs of the accurate and the approximate model. The statistics of the approximation error sample can then be used to adjust the likelihood based on the approximate forward model to account for the approximation error. This step requires only applications of the forward models, and can be costly due to the computational complexity of the accurate model, however, it can be done offline and only once, akin to the training of machine learning models. A different approach for dealing with nuisance parameters in linear inverse problems was recently proposed in [ 4 ] , where the observation model is regarded as a linear combination of a term depending linearly on the variable of interest and another with linear dependence on the nuisance parameter. Ideally, the part of no interest, referred to as clutter in the radar literature, can be cleansed by an orthogonal projection, aiming the spotlight on the portion of interest and reducing the problem to a linear observation model independent of the nuisance parameter. In the context of non-linear models, the projection idea was considered in [ 11 ] . While model reduction by spotlighting is not equivalent to the model reduction compensated by Bayesian approximation error analysis, there is a clear overlap between the two approaches, as pointed out in [ 4 ] . The main aim of this article is to investigate in further detail the relationship between the two approaches. The remainder of the paper is organized as follows. In section 2 we review the Bayesian approximation error approach, and outlining how the formalism can be used in the likelihood to compensate for using an approximate forward operator, and subsequently, we provide an overview of the spotlight inversion. The similarities and differences between the two model reduction approaches are analyzed in section 3, where we first interpret the approximation error as clutter, then interpret the clutter as approximation error. In subsection 3.3 we show that the spotlight inversion can be seen as a draconian version of the Bayesian approximation error adjustment of the likelihood, in which data matching is considered only in the orthogonal complement of the subspace of the approximation error. In the process of setting up the machinery for approximation error modeling, we draw some parallels between the Bayesian error modeling and sketching methods that are popular in randomized linear algebra, introducing the concept of priorsketching . The Bayesian approximation error approach and spotlight inversion are employed in section 4 in two computed examples. The first computed example is an X-ray tomography problem in two dimensions, where the portion of interest is a subset of the domain representing the target in the imaging domain. The model reduction in this case is obtained by using a fine discretization only for the region of interest and a much coarser one in the remaining part of the domain. The physics informed prior used to estimate the modeling error is based on the logit transformation of a Gaussian prior and tuned according to the a prior beliefs about the solution. The second example considers an electrical impedance tomography (EIT) problem with poorly known geometry of the domain. In this case the clutter is due to the unknown variation of the geometry of the target, and while it cannot be interpreted directly in the spotlight inversion framework as a separate contribution from a nuisance parameter, we show that

Read the complete text