Dual-space posterior sampling for Bayesian inference in constrained inverse problems

Ali Siahkoohi, Kamal Aghazade, Ali Gholami · 2026

Read Dual-space posterior sampling for Bayesian inference in constrained inverse problems by Ali Siahkoohi, Kamal Aghazade, Ali Gholami (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-00393.txt.

Introduction

Siahkoohi, Aghazade, and Gholami sample posterior beliefs for inverse problems ruled by hard physical laws, such as the wave equation in seismic imaging. Noisy, partial data leave many models plausible, yet hard laws resist standard sampling priors. Their dual space scheme turns laws into penalties through an augmented Lagrangian, tightening them step by step with multiplier updates. Pairing alternating direction splitting with a particle sampler lets far off models still improve. Tests on a toy problem and seismic benchmarks show physical uncertainty estimates that tighten as data grow.

Catalog record

CREATORAli Siahkoohi, Kamal Aghazade, Ali Gholami
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE86825
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.00393

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Dual-space posterior sampling for Bayesian inference in constrained inverse problems Ali Siahkoohi, Kamal Aghazade, Ali Gholami Abstract Inverse problems constrained by partial differential equations are often ill-conditioned due to noisy and incomplete measured data or inherent non-uniqueness of the problem. A prominent example is full waveform inversion, which estimates Earth’s subsurface properties by fitting seismic measurements subject to the wave equation, where the ill-conditioning is inherent to noisy, band-limited, finite-aperture measured data and the presence of shadow zones. Casting the inverse problem into a Bayesian framework allows for a more comprehensive description of its solution, where instead of a single estimate, a distribution of plausible solutions—the posterior distribution—characterizes the non-uniqueness and can be sampled to quantify uncertainty. However, there is no clear procedure for translating hard physical constraints, such as the wave equation, into prior distributions that are amenable to existing sampling techniques. To address this challenge, we perform posterior sampling in the dual space using an augmented Lagrangian formulation, which translates hard constraints into penalties amenable to sampling algorithms, while ensuring their exact satisfaction. We achieve this by seamlessly integrating the alternating direction method of multipliers (ADMM) with Stein variational gradient descent (SVGD)—a particle-based sampling method—where the constraint is relaxed at each iteration and the multiplier updates progressively enforce constraint satisfaction. This enables posterior sampling in the presence of hard constraints while inheriting the favorable conditioning properties of dual-space solvers, where partial constraint relaxation allows productive updates even when the current model is far from the true solution. We validate the method on a stylized Rosenbrock conditional inference problem and on frequency-domain full waveform inversion for a Gaussian anomaly model and the Marmousi II benchmark, demonstrating well-calibrated uncertainty estimates and posterior contraction with increasing data coverage. 1 Introduction Quantifying uncertainty in the solution of inverse problems is of fundamental importance in many areas of science and engineering. In geophysical applications such as seismic imaging [ 61 ] , the goal is to determine the subsurface structure of the Earth from surface measurements of seismic waves. Due to the inherent ill-posedness of the problem—arising from noisy, band-limited, finite-aperture measured data and the presence of shadow zones—different models of the subsurface may explain the observed data equally well. Relying on a single estimate of the subsurface properties ignores this non-uniqueness and may lead to overconfident interpretations that fail to capture the true range of plausible solutions. Bayesian inference provides a principled framework for characterizing this non-uniqueness by representing the solution as a probability distribution—the posterior—conditioned on the observed data [ 57 , 55 ] . Sampling from the posterior yields an ensemble of models that collectively describe the range of plausible solutions and enable quantification of uncertainty in derived quantities such as confidence intervals and event probabilities. However, generating samples from the posterior in high-dimensional geophysical inverse problems remains a computational challenge [ 15 ] , as each sample requires evaluating the forward model, which for wave-based problems involves solving a partial differential equation [ 35 , 20 , 45 , 17 , 76 ] . A further challenge arises when the inverse problem is naturally posed as a constrained optimization problem—where the PDE relating model parameters to data must be satisfied as a hard constraint rather than being eliminated through direct solves. Full waveform inversion (FWI) is a paradigmatic example: the seismic wavefields are governed by the wave equation, and any model estimate must be consistent with this physics. Wavefield reconstruction methods [ 59 , 60 , 47 ] exploit this structure by reformulating the constrained problem using a penalty approach, in which both the model parameters and the wavefields are treated as independent variables. These methods often yield better-conditioned subproblems and improved convergence behavior compared to conventional reduced-space formulations that enforce the PDE exactly at every iteration. However, achieving accurate satisfaction of the wave equation at convergence remains challenging in purely penalty-based approaches, as large penalty parameters are typically required, which can introduce severe ill-conditioning. In contrast, augmented Lagrangian formulations [ 2 , 22 , 38 ] alleviate this difficulty by combining penalty terms with Lagrange multipliers, enabling progressive and precise enforcement of the PDE constraint while maintaining improved numerical stability. These dual approaches yield better conditioned subproblems and faster convergence compared to conventional reduced-space methods that enforce the PDE exactly at each iteration. However, extending these favorable properties from deterministic inversion to Bayesian inference requires a systematic procedure for translating hard PDE constraints into a sampling framework—a procedure that has remained largely unexplored. The idea of relaxing PDE constraints has proven fruitful in other fields as well—in weather forecasting, weak-constraint four-dimensional variational data assimilation [ 21 ] similarly relaxes the dynamical model constraint to improve conditioning and enable uncertainty estimation. In the context of seismic inverse problems, 19 relaxed the PDE constraint by introducing the wavefields as auxiliary variables and showed that the resulting extended posterior can be well-approximated by a Gaussian distribution centered at the MAP estimate. While this Gaussian approximation enables efficient sampling via the randomize-then-optimize method [ 8 ] and avoids the cost of Markov chain Monte Carlo (MCMC) [ 24 ] , it has two fundamental limitations: (i) it relies on the posterior being approximately Gaussian, which precludes the characterization of multimodal or strongly non-Gaussian uncertainty that is common in complex geological settings; and (ii) it requires computing the MAP estimate and implicitly constructing the posterior covariance, which couples the sampling quality to the accuracy of a local quadratic approximation around a single mode. Recent variational approaches based on normalizing flows [ 54 , 67 ] or structured variational families [ 73 , 75 ] address some of these limitations but require either training neural networks or restricting the variational family to a parametric form. In this work, we address these limitations by proposing ADMM-SVGD, a method that combines the alternating direction method of multipliers (ADMM) with Stein variational gradient descent (SVGD) to perform posterior sampling in the dual space. Like 19 , we relax the PDE constraint and exploit the favorable conditioning of the extended formulation; however, instead of approximating the posterior as Gaussian, we represent it nonparametrically through an ensemble of interacting particles that are evolved toward the target distribution via SVGD. This particle-based representation makes no distributional assumptions and can capture multimodal posteriors, non-Gaussian tails, and complex correlation structures that a Gaussian approximation would miss. A second key difference is that, rather than fixing the penalty parameter a priori, we employ multiplier updates that progressively enforce the PDE constraint over the course of the iterations, ensuring exact constraint satisfaction at convergence without requiring a careful upfront calibration of the penalty. The augmented Lagrangian formulation admits a natural probabilistic interpretation: for fixed Lagrange multipliers, it defines an unnormalized distribution over the model that evolves as the multipliers are updated, converging to the true posterior as the constraint is progressively enforced. The resulting algorithm inherits both the favorable conditioning of dual-space solvers and the uncertainty quantification capability of particle-based sampling methods. To validate the proposed framework, we consider three problems of increasing complexity. First, we consider conditional inference on the Rosenbrock distribution—a stylized nonlinear constrained problem where we compare ADMM-SVGD against standard SVGD (without the ADMM decomposition) to isolate the effect of the

Read the complete text