Sampling through iterated approximation: Gradient-free and multi-fidelity Bayesian inference via transport
Daniel Sharp, Bart van Bloemen Waanders, Youssef Marzouk · 2026
Read Sampling through iterated approximation: Gradient-free and multi-fidelity Bayesian inference via transport by Daniel Sharp, Bart van Bloemen Waanders, Youssef Marzouk (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-12448.txt.
Introduction
Sharp, van Bloemen Waanders, and Marzouk sample posteriors by steps, with transport tools. Their targets may involve costly models, no usable gradients, sharp peaks, and strong non-Gaussian shape. Annealing blends geometric tempering with multi-fidelity models to bridge prior and posterior in stages. Transport stand-ins learn each stage's distribution without target gradients at all. An importance scheme recycles costly model runs across stages by reweighing them. Tests on PDE inverse problems show sharp accuracy gains at low dimension.
Catalog record
| CREATOR | Daniel Sharp, Bart van Bloemen Waanders, Youssef Marzouk |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 111269 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.12448
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Sampling through iterated approximation: Gradient-free and multi-fidelity Bayesian inference via transport Daniel Sharp, Bart van Bloemen Waanders, Youssef Marzouk Abstract We develop an iterative framework for Bayesian inference problems where the posterior distribution may involve computationally intensive models, intractable gradients, significant posterior concentration, and pronounced non-Gaussianity. Our approach integrates: (i) a generalized annealing scheme that combines geometric tempering with multi-fidelity modeling; (ii) expressive measure transport surrogates for the intermediate annealed and final target distributions, learned variationally without evaluating gradients of the target density; and, (iii) an importance-weighting scheme to combine multiple quadrature rules, which recycles and reweighs expensive model evaluations as successive posterior approximations are built. Our scheme produces both a quadrature rule for computing posterior expectations and a transport-based approximation of the posterior from which we can easily generate independent Monte Carlo samples. We demonstrate the efficiency and accuracy of our approach on low-dimensional but strongly non-Gaussian Bayesian inverse problems involving partial differential equations. keywords Bayesian inference, measure transport, transport maps, importance sampling, annealing, multi-fidelity. † † runningheads: Sampling through iterated approximation / D. Sharp, B. van Bloemen Waanders, Y. Marzouk MSC 62F15, 62L99, 65M32 1 Introduction Bayesian inference uses observational data and prior knowledge to learn or ‘calibrate’ the parameters of a mathematical model. Commonly, a scientist or engineer prescribes a computational simulation realizing the model, i.e., mapping parameters to predicted observations, and this simulation is embedded in a likelihood function that represents the conditional distribution of the data. A prior probability distribution encodes knowledge about the parameter values; this distribution is updated, via the likelihood, to produce a posterior distribution on the parameters of interest. The computational task of Bayesian inference is to characterize this posterior distribution—for instance, by estimating posterior expectations of arbitrary test functions. Modern methods for Bayesian computation typically grapple with three key challenges: First, the likelihood may be computationally expensive to query. Second, gradients and higher-order derivatives of this likelihood may be unavailable or computationally intractable. Third, observational data may favor narrow and geometrically complex regions of the parameter space; in this sense, the data are informative and the likelihood is strongly concentrated with respect to the prior. In this paper, we introduce new computational Bayesian inference techniques for problems where all three of these challenges are central. Our focus is on problems where evaluations of the underlying simulation (and hence the likelihood) are expensive, such that one can afford at most a few hundred such queries, perhaps much less. The question of where in the parameter space to make these queries then becomes crucial, but the answer is complicated by the combination of posterior concentration and complex geometry. Designing queries according to the prior “wastes” model evaluations in regions of vanishing posterior probability, but placing queries in regions of high posterior probability requires not only finding these regions but describing their structure. We must therefore develop methods that capture strong non-Gaussianity, e.g., well-separated posterior modes or sharp concentration around nonlinear ridge-like structures. And while our black-box simulations do not permit gradient evaluations, these simulations often admit lower-fidelity approximations. Thus, we seek an inference framework that naturally exploits multiple model fidelities if they are available. The core computational contribution of this paper is a novel iterative approach that uses multiple model fidelities and efficient query design to effectively neutralize the core challenges of Bayesian inference described above. In particular, our approach combines annealing, quadrature, multiple importance sampling, and variational approximations of the posterior {\pi} . In a given iteration {j} , we first choose a target distribution {{\pi}_{{j}}} using tempering (less concentrated than {\pi} ) and low-fidelity modeling (cheaper to evaluate than {\pi} ). We then use \widetilde{{\pi}}_{{j}-1} , the previous iteration’s target approximation, to generate new samples or quadrature points, and apply multiple importance sampling to discretize an expectation over the current target {{\pi}_{{j}}} . This process draws from and augments a dataset of model evaluations accumulated over previous iterations. The resulting discretization allows us to evaluate and minimize an objective function whose minimizer is {\widetilde{{\pi}}_{{j}}} , a variational approximation of {{\pi}_{{j}}} . The iterations then continue. In related importance sampling methods, practitioners often select simple distribution approximations (which we also call surrogates ) {\widetilde{{\pi}}_{{j}}} , e.g., Gaussians or Gaussian mixtures, at the cost of high sampling bias and inefficiency; these issues are exacerbated by posterior concentration and complex geometry. In contrast, we use a flexible and robust measure transport approach to capture non-Gaussian behavior [ 101 , 85 , 4 , 1 , 83 , 30 , 64 ] . Moreover, our approach builds transport-based surrogates without the gradient evaluations typically required to use transport in Bayesian inference [ 10 , 30 ] .Additionally, rather than using only multi-fidelity modeling or only tempering, we combine the two into a generalized annealing process . By integrating these notions of annealing with a versatile method to re-use evaluations of \pi , our approach makes particularly efficient use of expensive model evaluations, tailoring them to the geometric features of the posterior. Furthermore, our iterative scheme has a built-in robustness, described below, that mitigates the impact of a poor target approximation at any intermediate step. Synthesizing these methods yields a sequential inference approach that largely parallelizes and minimizes model evaluations, adaptively approximates the target distribution, and learns a normalized posterior density surrogate from which we sample exactly—all without gradients of the unnormalized target density. 1.1 Related work To put our contributions in context, we outline previous methods and the extent to which they address the three challenges stated in the opening paragraph. There is of course an enormous literature on Markov chain Monte Carlo (MCMC) methods in Bayesian computation [ 69 , 43 , 11 , 67 ] . The first MCMC methods for expensive likelihoods trained offline surrogates for the forward model, typically by minimizing a prior-weighted approximation error [ 66 , 65 , 31 , 67 ] . While broadly effective, these methods deteriorate under high posterior concentration [ 61 ] . Other methods have incorporated multiple model fidelities in the proposal process, via delayed acceptance schemes or multiple interacting chains [ 45 , 17 , 82 ] . A different class of methods create and refine surrogates for the forward model or likelihood function online, i.e., as MCMC iterations proceed [ 20 , 18 , 112 , 25 ] possibly incorporating multi-fidelity data [ 108 ] . While all of these methods may reduce the number of expensive model evaluations, they do not necessarily ameliorate the problem of geometry. Samplers focused on challenging non-Gaussian target geometry typically require considerable information about the target density, e.g., repeated gradient and possibly Hessian evaluations [ 63 ] . Alternatively, one can attempt to “neutralize” difficult geometry of the target in various ways. Parallel tempering and simulated annealing are widely used to mitigate concentration or promote mixing between modes. More modern methods use measure transport to transform the target distribution into a distribution that is easier to sample [ 80 , 1 , 37 ] or, in the opposite direction, use transport to create a biasing distribution in importance sampling (IS) or a proposal in a Metropolis independence sampler [ 70 , 72 , 37 , 86 ] . The latter methods actually straddle the line