Variational Sparse Paired Autoencoders (vsPAIR) for Inverse Problems and Uncertainty Quantification
Jack Michael Solomon †,, Rishi Leburu, Matthias Chung · 2026
Read Variational Sparse Paired Autoencoders (vsPAIR) for Inverse Problems and Uncertainty Quantification by Jack Michael Solomon †,, Rishi Leburu, Matthias Chung (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02948.txt.
Introduction
Reconstructing hidden quantities from noisy measurements, with honest doubt, is the goal of Jack Michael Solomon and 2 co-authors in a 2026 paper. Such inverse problems appear across science and engineering. Point figures alone are not enough when decisions depend on how confident the rebuilding is.
Their architecture, vsPAIR, pairs two variational autoencoders. One encodes the observations. The other encodes the quantity of interest, using sparse codes that concentrate information into identifiable factors. A learned map connects the two latent spaces. Tests cover blind inpainting, computed tomography, and recovering a heat formula's starting state. The system solved all three while giving interpretable, ordered doubt figures at fast use speed.
Catalog record
| CREATOR | Jack Michael Solomon †,, Rishi Leburu, Matthias Chung |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 99 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-02948
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Variational Sparse Paired Autoencoders (vsPAIR) for Inverse Problems and Uncertainty Quantification Jack Michael Solomon †,, Rishi Leburu, Matthias Chung Abstract Inverse problems are fundamental to many scientific and engineering disciplines; they arise when one seeks to reconstruct hidden, underlying quantities from noisy measurements. Many applications demand not just point estimates but interpretable uncertainty. Providing fast inference alongside uncertainty estimates remains challenging yet desirable in numerous applications. We propose the Variational Sparse Paired Autoencoder (vsPAIR) to address this challenge. The architecture pairs a standard VAE encoding observations with a sparse VAE encoding quantities of interest, connected through a learned latent mapping. The variational structure enables uncertainty estimation, the paired architecture encourages interpretability by anchoring QoI representations to clean data, and sparse encodings provide structure by concentrating information into identifiable factors rather than diffusing across all dimensions. To validate the effectiveness of our proposed architecture, we conduct experiments on blind inpainting and computed tomography, demonstrating that vsPAIR is a capable inverse problem solver that can provide interpretable and structured uncertainty estimates. Keywords: Machine Learning, Inverse Problems, Uncertainty Quantification, Generative Modeling † † footnotetext: † : Corresponding author, direct questions to [email protected] . 1 Introduction Inverse problems are central to scientific and engineering inference: from indirect and noisy measurements, one seeks to reconstruct hidden quantities that generated the data. Let \mathcal{X} denote the space of unknowns (e.g., parameters or fields) and \mathcal{Y} the space of observables, connected through a forward operator F:\mathcal{X}\to\mathcal{Y} . Measurements are modeled as y=F(x)+\varepsilon, where \varepsilon represents measurement noise or model error taking values in \mathcal{Y} . Because small perturbations in y may induce large changes in the admissible x , such problems are typically ill-posed in the sense of Hadamard [ 23 ] . Classical approaches address ill-posedness by introducing regularization or statistical priors. Variational methods such as Tikhonov, total variation, and sparsity-promoting penalties [ 66 , 24 ] stabilize the solution through explicit constraints, while Bayesian formulations interpret both x and y as random variables and infer the posterior p(x\mid y) via Bayes’ theorem [ 11 ] . Although these approaches provide strong theoretical guarantees, they require repeated evaluation of F and careful tuning of regularization parameters, which becomes computationally demanding in high-dimensional or nonlinear settings. More recently, there has been a shift towards data-driven approaches. Such approaches use parameterized neural networks to learn various attributes of the underlying inverse problem. End-to-end methods learn direct mappings F^{\leftarrow}:\mathcal{Y}\rightarrow\mathcal{X} from paired samples (x,y) [ 31 , 69 ] . Prior learning methods employ a data-driven prior: plug-and-play methods incorporate pretrained denoisers as implicit priors within optimization schemes [ 64 , 55 ] , and learned methods use regularization techniques to replace hand-crafted penalties with trainable functionals [ 22 , 44 ] . Hybrid methods such as algorithm unrolling interpret iterative solvers as neural networks with learnable parameters [ 2 , 49 ] . Various other methodologies exist and have been successful in a variety of applications [ 16 ] . Learning latent representations of data offers a complementary regularization strategy. Rather than prescribing a hand-crafted regularizer, one learns low-complexity latent representations directly from data and performs inversion in this learned space. Autoencoders and their probabilistic extensions, variational autoencoders (VAEs) [ 35 ] , capture intrinsic manifolds of high-dimensional data and thus serve as implicit priors. Standard autoencoders impose a low-dimensional bottleneck on the deterministic latent representation which typically has the effect of reducing high frequency variations [ 26 , 65 ] . Early works leveraged this regularizing property of under-complete autoencoders for applications in denoising [ 65 , 7 ] . This later inspired the use of autoencoders as an end-to-end approach [ 4 ] . The implicit regularizing properties of autoencoders have also made them attractive for prior-learning where the learned distribution over the latent space captures the variability of plausible solutions and serves as a low-dimensional manifold constraint for reconstruction [ 41 ] . Recent work on paired autoencoders [ 15 , 25 , 16 ] and latent-twin architectures [ 18 ] extends this idea by coupling encoders and decoders in both \mathcal{X} - and \mathcal{Y} -domains, learning mappings between latent spaces that emulate both the forward and inverse operators. However, dense latent codes can entangle information, obscure uncertainty, and overfit small datasets. A major drawback of many of the referenced approaches above is the lack of uncertainty quantification (UQ). In a Bayesian sense, UQ approximates the posterior p(x\mid y) , not merely a point estimate [ 11 ] . Many applications demand this: in medical imaging, clinicians must distinguish pathology from reconstruction artifacts; in seismic inversion, uncertainty informs drilling risk; in autonomous systems, calibrated confidence is safety-critical. Score-based diffusion methods address UQ through iterative posterior sampling [ 13 , 57 , 34 ] . Sample diversity reflects posterior uncertainty, but repeated network evaluations at inference sacrifice the speed of amortized approaches. The deterministic methods discussed above, including paired autoencoders, offer fast inference but lack the probabilistic structure necessary for UQ. This motivates frameworks combining amortized inference with built-in probabilistic structure for efficient uncertainty estimation. Sparse latent representations that correspond to interpretable features would additionally clarify which data characteristics drive reconstruction, and interpretable UQ. Contributions. We propose the Variational Sparse Paired Autoencoder (vsPAIR), a framework combining probabilistic inference, sparsity and paired latent mappings for uncertainty-aware inversion. The architecture encodes observations y via a standard VAE and sparse representations of quantities of interest x via a sparse VAE (sVAE), with a learned mapping connecting the two latent spaces. The sparse encoding reflects the assumption that observations are driven by few dominant factors, yielding interpretable latent codes while regularizing reconstruction. The variational structure enables posterior approximation for UQ. The key contributions of this work are as follows: 1. The vsPAIR framework with probabilistic latent structure, enabling both fast amortized inference and interpretable uncertainty quantification. 2. Theoretical analysis of our framework in a reduced setting, justifying its use in uncertainty quantification. 3. Experimental validation on ill-posed inverse problems–blind inpainting and computed tomography (CT)–demonstrating that vsPAIR can achieve interpretable and structured uncertainty quantification alongside competitive reconstruction. Structure of the paper. Section 2 reviews classical and learning-based formulations of inverse problems, including autoencoders and paired latent mappings. Section 3 introduces the vsPAIR framework: the paired architecture, and theoretical analysis of uncertainty quantification under simplifying assumptions. Finally, Section 4 and Section 5 present numerical demonstrations on blind inpainting and CT, followed by concluding remarks. The introduction of sparsity in the QoI autoencoder presents technical challenges which are discussed and addressed in Appendix A . Notation and Setting. Let X denote the quantity of interest (QoI) and Y the observation, interpreted as random variables with a joint distribution (X,Y) absolutely continuous with respect to Lebesgue measure, thus admitting a joint density p(x,y) [ 19 ] . We use p for true distributions and q for variational approximations. Notation is summarized in Table 1 . Symbol Description X,Y,Z Random variables for QoI, observation, and latent codes x,y,z Samples from respective distributions p(\cdot) , q(\cdot) True and approximate (variational) distributions q_{\phi_{x}}(z\mid x) Variational encoder for QoI with trainable parameters \phi_{x} q_{\theta_{x}}(x\mid z) Probabilistic decoder for QoI with trainable parameters \theta_{x} q_{\phi_{y}}(z\mid y) , Variational encoder for observations with trainable parameters \phi_{y} q_{\theta_{y}}(y\mid z) Probabilistic decoder for