Deep Gaussian Process Priors for Bayesian Image Reconstruction
Jonas Latz, Aretha L. Teckentrup, Simon Urbainczyk · 2024
Read Deep Gaussian Process Priors for Bayesian Image Reconstruction by Jonas Latz, Aretha L. Teckentrup, Simon Urbainczyk (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-10248.txt.
Introduction
Jonas Latz, Aretha Teckentrup, and Simon Urbainczyk wrote this 2024 paper on honest uncertainty in image reconstruction. Rebuilding an image from indirect data is guesswork, and knowing how unsure the guess is guides real decisions. The Bayesian approach treats the image as a random function, starts from a prior belief, and updates it with the data.
Plain priors fail here, since real images shift character across scales and places. Deep Gaussian processes fix that with a layered structure that adapts as it goes. The price is hard sampling: the math runs through huge, dense matrices that change with every draw. The paper tackles that sampling problem for deep process priors. The goal is sharper reconstructions that carry trustworthy error bars, not just a single best picture.
Catalog record
| CREATOR | Jonas Latz, Aretha L. Teckentrup, Simon Urbainczyk |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 105 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-10248
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Deep Gaussian Process Priors for Bayesian Image Reconstruction Jonas Latz, Aretha L. Teckentrup, Simon Urbainczyk Abstract In image reconstruction, an accurate quantification of uncertainty is of great importance for informed decision making. Here, the Bayesian approach to inverse problems can be used: the image is represented through a random function that incorporates prior information which is then updated through Bayes’ formula. However, finding a prior is difficult, as images often exhibit non-stationary effects and multi-scale behaviour. Thus, usual Gaussian process priors are not suitable. Deep Gaussian processes, on the other hand, encode non-stationary behaviour in a natural way through their hierarchical structure. To apply Bayes’ formula, one commonly employs a Markov chain Monte Carlo (MCMC) method. In the case of deep Gaussian processes, sampling is especially challenging in high dimensions: the associated covariance matrices are large, dense, and changing from sample to sample. A popular strategy towards decreasing computational complexity is to view Gaussian processes as the solutions to a fractional stochastic partial differential equation (SPDE). In this work, we investigate efficient computational strategies to solve the fractional SPDEs occurring in deep Gaussian process sampling, as well as MCMC algorithms to sample from the posterior. Namely, we combine rational approximation and a determinant-free sampling approach to achieve sampling via the fractional SPDE. We test our techniques in standard Bayesian image reconstruction problems: upsampling, edge detection, and computed tomography. In these examples, we show that choosing a non-stationary prior such as the deep GP over a stationary GP can improve the reconstruction. Moreover, our approach enables us to compare results for a range of fractional and non-fractional regularity parameter values. 1 Introduction Gaussian processes (GPs) have become a popular tool to represent uncertainty in spatial objects, e.g., in hydrology [ 68 , 21 ] , climate modelling [ 7 , 48 , 67 , 69 ] , and medical imaging [ 53 , 65 ] . GPs combine a number of desirable properties: To start with, GPs are well understood theoretically. See, e.g., [ 1 , 74 ] as an introduction, as well as [ 76 , 81 ] for recent convergence results. Moreover, they offer the flexibility to model a wide range of spatial phenomena. This flexibility is mainly due to the wide range of covariance functions that can be used to construct a Gaussian process. These covariance functions are often parametric and, thus, allow the user to set quantities such as correlation length, marginal variance, and regularity of the GP realisations directly. Due to their theoretical simplicity and flexibility, they are especially popular as prior distributions in Bayesian inverse problems with linear forward operator and Gaussian noise. In this specific case, the associated posterior distribution is given by a closed-form expression and does not rely on Monte Carlo sampling. The same closed-form expression is also used for GP regression. GPs present multiple computational challenges when employed in large-scale estimation problems. The closed-form expression used in GP regression requires the inversion of a matrix describing the observation covariance. This is often a computational bottleneck. In the context of Monte Carlo sampling, it is often necessary to decompose high-dimensional covariance matrices to sample approximations of GPs. Different solution strategies have been proposed to mitigate these problems, depending on the application and the GP’s covariance function. For instance, a common practice for representing Matérn-type Gaussian processes is to see them as the solution to a stochastic partial differential equation (SPDE) [ 88 , 48 ] . This approach enables the use of state-of-the-art solvers for partial differential equations (PDEs) to speed up the evaluation of the GP regression mean and the sampling of the GP. The SPDE approach mainly profits from the locality of the differential operators and the sparsity of the associated system matrices. Further notable techniques to reduce computational effort include circulant embedding [ 20 , 36 ] , adaptive cross-approximation [ 31 , 32 , 42 ] , hierarchical matrices [ 27 , 40 ] , truncated Karhunen-Loève expansions [ 70 , 66 , 14 ] , sparse Gaussian processes [ 82 , 73 ] , and Vecchia approximation [ 39 , 2 ] . The importance of uncertainty quantification has been recognised in a variety of different contexts, especially also in image reconstruction. Image reconstruction problems usually suffer from a combination of lack of data, observational noise, and instability. Bayesian inversion has recently gained popularity as an alternative to variational inversion that allows for accurate uncertainty quantification in the estimates. Appropriate prior distributions in imaging are, e.g., total variation priors [ 62 ] (although not discretisation-invariant [ 45 ] ), Cauchy [ 51 , 78 ] or other \alpha -stable priors [ 79 , 9 ] , hierarchical Horseshoe and Student’s t priors [ 22 , 83 , 71 ] , and machine-learning-based priors [ 46 , 47 ] . Image reconstruction problems are typically linear and, thus, Gaussian process priors are a natural choice [ 65 , 13 , 78 ] . Unfortunately, commonly used GP models, such as Matérn-type GPs, describe stationary behaviour in the object to be reconstructed and images of interest show multi-scale behaviour: they contain largely flat, constant areas as well as areas of small-scale details such as edges and texture, which, at the same time, are not captured well by a usual covariance function. Observations and ground truth. GP regression mean for \rho=0.03 and \rho=0.3 . Figure 1 : One-dimensional GP regression example with two correlation length values. We illustrate this last point in a small, one-dimensional example. The aim is to reconstruct the ground truth step function shown in the left plot in Figure 1 . We have access to noisy observations of this ground truth, indicated as red crosses in the same plot. We perform Gaussian process regression using a Matérn kernel ( 4 ) with \nu=5/2 and two different values for the correlation length: \rho=0.03 and \rho=0.3 . The resulting regression mean functions are shown on the right. For \rho=0.03 , we capture the jump of the function at x=0.5 as a steep slope in our regression mean function. However, the noise that pollutes the observations is visible as oscillations in the actually flat area of the function. This makes sense intuitively, as the small value correlation length implies that we expect small-scale features in the function. For the choice of the larger correlation length \rho=0.3 , we make the reverse observation: The discontinuity at x=0.5 is very smooth, whereas the regression mean is hardly affected by the observation noise reconstructing well the flat parts of the function. In this case, we would profit from a covariance function that can represent multiple length scales in different areas of the domain. These areas and the associated length scales are unknown and need to be identified as well. In this work, we turn to deep Gaussian processes [ 23 , 19 , 57 , 64 ] as a natural way to construct non-stationary spatial processes. The denoising problem shown in Figure 1 is just one example of the image reconstruction problems we consider throughout this work. We more generally study image reconstruction problems that are given through associated inverse problems. We consider inverse problems of the form, \displaystyle Au^{\dagger}+\varepsilon^{\dagger}=d^{\mathrm{obs}}, (1) where