SELF-SUPERVISED CONFORMAL PREDICTION WITH EQUIVARIANT BOOTSTRAPPING FOR IMAGE UNCERTAINTY QUANTIFICATION Henry J. Aldridge, Tobías I. Liaudat, Marcelo Pereyra, Jason D. McEwen Abstract Inverse problems are ubiquitous in modern scientific studies and involve recovering an underlying signal from noisy observations often transformed by a measurement operator. These problems are frequently ill-posed, particularly in imaging, leading to multiple plausible solutions and considerable uncertainty in reconstructed images. In fields like the physical and biological sciences, accurate uncertainty quantification (UQ) is critical for trustworthy scientific analyses and confident diagnoses. Current UQ methods for imaging often fall short; they can be inaccurate, or require unavailable or difficult-to-acquire ground truth data for calibration, which can introduce hidden biases due to distribution shifts between calibration and observed data. We introduce a UQ approach that leverages equivariant bootstrapping to generate heuristic coverages by exploiting data symmetries. We then refine these coverages through a conformal prediction calibration step, while crucially employing a self-supervised approach to avoid the need for ground truth calibration data. We demonstrate this method with weak lensing mass-mapping, where we aim to reconstruct the convergence field from shear measurements of distant galaxies weakly-lensed by gravitational fields. Mass-mapping in particular benefits from the self-supervised approach, as simulating calibration data is expensive and relies on specific cosmological models that could introduce biases in downstream cosmological inference tasks. 1.  Introduction Inverse imaging problems Inverse imaging is the task of reconstructing an image {x^{\star}}\in\mathbb{R}^{n} from a noisy observation {y}\in\mathbb{R}^{m} that is a realisation of some stochastic process usually arising from a noisy acquisition process. We consider linear inverse imaging problems of the form {y}=\mathbf{A}{x^{\star}}+{\epsilon}, (1) where \mathbf{A}\in\mathbb{R}^{m\times n} is a forward operator that models our measurement process and {\epsilon}\sim\mathcal{N}(0,\Sigma) is additive Gaussian noise with covariance matrix \Sigma . Inverse imaging problems are associated with substantial reconstruction uncertainty due to ill-posed inverse mappings and noisy measurements, which can admit many plausible image reconstructions. Reliable uncertainty quantification (UQ) in high-dimensional inverse problems is critical in imaging domains like medical diagnostics and astronomy, where uncertainty is tied to diagnoses or downstream scientific analysis. Existing UQ methods in inverse imaging problems often generate heuristic uncertainties that lack accuracy guarantees, or require ground truth data for calibration. We present a general method for performing image uncertainty quantification in a self-supervised manner and demonstrate it for the task of dark matter mass-mapping. High-dimensional uncertainty quantification Despite strong progress with regards to recovering point estimates of {x^{\star}} , particularly with the advent of modern deep learning frameworks [ 17 ] , estimating accurate and calibrated uncertainties in high dimensions remains a challenge. Existing approaches to UQ are typically formulated with a Bayesian statistical framework. These methods often exploit a physics-based likelihood term and employ different choices of prior models to regularise the ill-posed inverse problem. These priors can rely on simple assumptions like Gaussianity or sparsity in a given wavelet basis, or be data-driven and learned from large datasets of images. In either case, a recent study has shown that, in high dimensions, the probabilities of such models are poorly calibrated when confronted with a frequentist validation test [ 34 ] . Conformal prediction [ 2 , 1 ] provides a statistically rigorous approach to calibrate uncertainties without assumptions on the error distribution and regardless of reconstruction method. Nevertheless, it relies on the availability of a set of exchangeable ground truth calibration data. In many applications, ground truth data are unavailable, expensive to simulate, or prone to distribution shifts relative to real observations. To ensure robustness in deployment, we must reduce reliance on ground-truth calibration data and move towards self-supervised methods. A self-supervised approach to conformal prediction has recently been shown to provide accurate UQ consistent with its supervised counterpart in imaging problems with Gaussian noise statistics [ 8 ] and Poisson noise statistics [ 33 ] . Given only a set of measurements and their reconstructions, the method utilises Stein’s Unbiased Risk Estimator (SURE) [ 29 ] to provide an unbiased estimate of the mean squared error (MSE) between the unknown ground truth and the reconstructed images. Conformal prediction sets are constructed from quantile estimates of the MSE across the set of image reconstructions. Meanwhile, supervised conformalisation procedures have been applied to calibrate heuristic uncertainties, such as in [ 3 , 6 , 14 , 15 ] . Such approaches may generate per-pixel uncertainties and lead to more compact prediction sets. Equivariant bootstrapping [ 31 ] provides a framework for generating per-image UQ, independent of the reconstruction method. The approach leverages symmetries in the imaging task to generate compact confidence regions in situations that are highly ill-posed due to large nullspaces of the forward operator. In CARB [ 6 ] , the equivariant bootstrapping approach was combined with a conformal prediction step to calibrate the resulting UQ. However, the method still relies on the availability of a calibration dataset, which may not be possible to obtain in a realistic setting, and no self-supervised approach has been explored. Contributions Our approach aims to combine the method-agnostic uncertainty quantification of the equivariant bootstrapping with a self-supervised SURE-based conformal prediction step. We follow [ 6 ] in using Risk-Controlling Prediction Sets (RCPS) [ 5 , 3 ] , a conformal prediction approach that provides guaranteed coverage to a user-specified level of error, to calibrate the confidence regions provided by equivariant bootstrapping. Notably, the proposed UQ framework is fully self-supervised, requiring no ground truth calibration data and therefore avoiding distribution shifts. We demonstrate the method for weak gravitational lensing mass-mapping, a cosmological inverse imaging problem that aims to reconstruct the dark matter convergence field from noisy shear observations of distant galaxies. Existing UQ methods for mass-mapping often rely on simulated data for training or calibration, which may introduce hidden biases when exposed to real observations. Our self-supervised approach avoids this issue while providing statistically rigorous uncertainty quantification. We continue this article by introducing the weak gravitational lensing mass-mapping inverse problem in Section 1.1 . In Section 2 we present our proposed self-supervised UQ framework. In Section 3 we demonstrate the method for weak lensing mass-mapping and we conclude with final remarks in Section 4 . 1.1  The weak gravitational lensing mass-mapping inverse problem We demonstrate our proposed method with a cosmological application based on weak gravitational lensing, which probes the distribution of dark matter from galaxy observations. The photons emitted by these distant galaxies are weakly lensed by the gravitational potential of intervening matter (predominantly dark matter). By measuring the ellipticities of these galaxies, we obtain an estimate of the cosmic shear map, which constitutes the observation of the mass-mapping inverse problem. The convergence map, describing the extent of magnification of an object in that area of the sky, can then be inferred from the observed shear and forms a key component of modern cosmological analyses [ 16 ] . Large scale surveys such as the ongoing Euclid space mission [ 23 ] and the Vera C. Rubin Observatory [ 37 ] will provide vast amounts of data for unprecedented precision levels of cosmological analysis. It is therefore imperative that UQ for weak lensing mass-mapping is accurate to avoid biases in the estimation of cosmological parameters. Existing UQ approaches are often tied to specific sets of cosmological parameters by the training of data-driven prior models on simulated data [ 24 , 35 ] or by performing conformal prediction with a set of simulated calibration data [ 14 , 15 ] . These methods are therefore prone to exhibit hidden biases when exposed to distribution shifts in the observational data. Other mass-mapping methods with UQ do not rely on simulation-trained models, but they rely on simple priors like sparsity in a wavelet domain [ 21 ] or Gaussian assumptions [ 36 ] . These choices of priors are not complex enough to faithfully represent the underlying convergence field and can also provide uncalibrated probabilities. In mass-mapping, we aim to recover the convergence map \kappa\in\mathbb{R}^{m} from the observed shear map \gamma\in\mathbb{C}^{m} . The forward measurement process can be recast as a convolution with a lensing operator in the Fourier domain, along with additive Gaussian noise dependent on the standard deviation of galaxy ellipticities and number of galaxies observed per pixel. Following the formalism of ( 1 ), our inverse problem can be expressed as {\gamma}=\mathbf{F}^{-1}\mathbf{DF}{\kappa}+{\epsilon}\qquad\text{where}\qquad\mathbf{D}=\frac{k_{x}^{2}-k_{y}^{2}+2ik_{x}k_{y}}{k_{x}^{2}+k_{y}^{2}}. (2) Here, \mathbf{D} is our Fourier-domain lensing operator for Cartesian co-ordinates x,y parametrising the sky, \mathbf{F} and \mathbf{F}^{-1} are Fourier and inverse Fourier transforms, k_{x} and k_{y} are the Fourier frequencies and \epsilon\sim\mathcal{CN}(0,\Sigma) with \epsilon\in\mathbb{C}^{m} , where \Sigma is diagonal. The forward operator, \mathbf{A}=\mathbf{F}^{-1}\mathbf{DF} , is almost full-rank since only the DC Fourier mode is unobservable. For more detail on weak gravitational lensing and mass-mapping, see [ 4 , 16 ] . The classical approach to solving ( 2 ) is known as Kaiser-Squires [ 12 ] and involves simply inverting the lensing operator and applying a smoothing operation. Kaiser-Squires leads to poor reconstructions due to amplification of noise in the inversion resulting in loss of small-scale structure when subsequently smoothed. Research into more advanced reconstruction methods is ongoing; modern approaches typically involve wavelet sparsity regularisation [ 13 , 21 , 19 , 22 , 20 , 28 ] and deep learning [ 10 , 26 , 24 , 35 ] . Our method-agnostic UQ framework provides calibrated uncertainty estimations and complements the ongoing research of powerful reconstruction-methods. For the sake of demonstrating our approach, we use the simple but widely adopted Kaiser-Squires method for reconstruction. 2.  Methodology We propose a UQ framework for inverse imaging problems that generates statistically rigorous per-image measures of uncertainty via a self-supervised conformalisation step. By considering a bootstrapping approach, in a method-agnostic framework we can generate compact heuristic per-image uncertainties without requiring training data. Straightforward parametric bootstrapping explores the variability of a reconstruction model for a given image reconstruction. Given some observation {y} , we generate an estimate {\hat{x}(y)} using our reconstruction method of choice. Then, we generate a set of N_{B} bootstrap observations \{{\tilde{y}_{i}(\hat{x})}\}^{N_{B}}_{i=1} from our estimator by passing it through the stochastic process y\sim P(\mathbf{A}x^{\star}) described by ( 1 ), where P(\cdot) represents the noise distribution. We pass the bootstrap observations through our chosen reconstruction method to generate N_{B} bootstrap samples \{{\tilde{x}(\tilde{y}_{i})}\}^{N_{B}}_{i=1} . We then compute a set of non-conformity scores \{s({\tilde{x}}_{i},{\hat{x}(y)})\}^{N_{B}}_{i=1} between each bootstrap sample and estimator, e.g. whole-image statistics such as the MSE or pixel-wise residuals. By considering the region for which the top \alpha -quantile has a score s less than q_{\alpha} , we construct confidence regions \mathcal{C}_{\alpha}({\hat{x}})=\{x:s(x,\hat{x}(y))