Bayesian Covariance Uncertainty for Adaptive Pilot-Sampling Termination in Multi-fidelity Uncertainty Quantification
Thomas E. Coons, Aniket Jivani, Xun Huan · 2025
Read Bayesian Covariance Uncertainty for Adaptive Pilot-Sampling Termination in Multi-fidelity Uncertainty Quantification by Thomas E. Coons, Aniket Jivani, Xun Huan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-18490.txt.
Introduction
Thomas Coons, Aniket Jivani, and Xun Huan present a 2025 paper on knowing when a cheap rehearsal has taught you enough. Engineers quantify uncertainty by Monte Carlo sampling, but high-fidelity models make each sample pricey. Multi-fidelity methods blend cheap and dear models, and their best blend depends on a covariance matrix estimated from pilot samples.
Too few pilot runs poison the blend; too many starve the final estimate. The authors wrap the pilot stage in a Bayesian frame that tracks covariance uncertainty itself, using a flexible prior that stays computable as samples accumulate. A loss rule then splits the cost of stopping early into accuracy loss versus saved budget. Demonstrated on control variate estimators, the framework suits any scheme that must rehearse before performing.
Catalog record
| CREATOR | Thomas E. Coons, Aniket Jivani, Xun Huan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 90 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-18490
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Bayesian Covariance Uncertainty for Adaptive Pilot-Sampling Termination in Multi-fidelity Uncertainty Quantification Thomas E. Coons, Aniket Jivani, Xun Huan Abstract Monte Carlo integration becomes prohibitively expensive when each sample requires a high-fidelity model evaluation. Multi-fidelity uncertainty quantification methods mitigate this by combining estimators from high- and low-fidelity models, preserving unbiasedness while reducing variance under a fixed budget. Constructing such estimators optimally requires the model-output covariance matrix, typically estimated from pilot samples. Too few pilot samples lead to inaccurate covariance estimates and suboptimal estimators, while too many consume budget that could be used for final estimation. We propose a Bayesian framework to quantify covariance uncertainty from pilot samples, incorporating prior knowledge and enabling probabilistic assessments of estimator performance. A central component is a flexible γ \gamma -Gaussian prior that ensures computational tractability and supports efficient posterior projection under additional pilot samples. These tools enable adaptive pilot-sampling termination via an interpretable loss criterion that decomposes variance inefficiency into accuracy and cost components. While demonstrated here in the context of approximate control variates (ACV), the framework generalizes to other multi-fidelity estimators. We validate the approach on a monomial benchmark and a PDE-based Darcy flow problem. Across these tests, our adaptive method demonstrates its value for multi-fidelity estimation under limited pilot budgets and expensive models, achieving variance reduction comparable to baseline estimators with oracle covariance. Keywords Monte Carlo \cdot approximate control variates \cdot variance reduction \cdot surrogate modeling 1 Introduction Estimating the expected value of a function is a central task in uncertainty quantification (UQ). While alternatives such as quadrature and Quasi Monte Carlo exist, Monte Carlo (MC) integration remains the standard approach, especially in high-dimensional settings. However, MC can become prohibitively expensive when each sample requires a high-fidelity model evaluation (e.g., solving a partial differential equation (PDE) on fine discretizations). Replacing the high-fidelity model with a surrogate model can reduce cost but typically introduces bias. Multi-fidelity UQ methods provide a more powerful alternative: by intelligently combining estimators from high- and low-fidelity models, they preserve unbiasedness while reducing variance under a fixed computational budget. A variety of multi-fidelity estimators have proven effective, including multilevel Monte Carlo (MLMC) Giles 2008 , multi-fidelity Monte Carlo (MFMC) Peherstorfer et al. 2016 , multilievel best linear unbiased estimators (MLBLUE) Schaden and Ullmann 2020 , approximate control variates (ACV) Gorodetsky et al. 2020 ; Bomarito et al. 2022 , and grouped ACV (GACV) Gorodetsky et al. 2024 . All of these sampling-based estimators are parameterized by weights and a sample allocation, obtained by solving an optimization problem for a given budget. Crucially, this optimization requires the covariance matrix of the model outputs, which is generally unknown a priori . The standard remedy is pilot sampling : evaluate all models on an independent set of inputs, estimate the covariance empirically, then optimize the weights and sample allocation. Pilot sampling, however, introduces a fundamental trade-off: • Taking too few samples results in inaccurate covariance estimates, which in turn leads to suboptimal weights and sample allocation. • Taking too many samples produces accurate covariance estimates, but leaves insufficient budget for the final estimation. For example, the left panel of Figure 1 illustrates an optimal region of estimator variance versus pilot budget (out of a fixed total budget equivalent to 200 pilot samples). In addition, the predicted estimator error using too few pilot samples can underestimate the true estimator variance by orders of magnitude, creating overconfidence in estimator quality. For example, the right panel of Figure 1 highlights this effect. Despite their importance, these issues are rarely examined, and no general framework exists for quantifying covariance uncertainty for multi-fidelity UQ. To our knowledge, the only existing published work that proposed a solution to this trade-off is Xu et al. 2022 , which relies on an asymptotic analysis of a non-optimal estimator (see Section 2.2 ). Alternative strategies include exchanging pilot sampling for ensemble estimation Pham and Gorodetsky 2022 while ignoring covariance uncertainty, or fixing weights at suboptimal values that avoids dependence on covariance information Chakroborty et al. 2024 . In contrast, we directly incorporate covariance uncertainty, enabling a flexible and general approach to adaptive pilot-sampling termination in finite-sample regimes. Figure 1: Example (see Section 5.1 for details) illustrating ACV estimator variance (left) and variance-prediction error (right) across different pilot-sample sizes. The black dashed line indicates the variance of the single-fidelity MC estimator, while the gray dashed line indicates the ACV variance under exact covariance knowledge (oracle case). We address two key questions: 1. How can we quantify uncertainty in covariance estimates obtained from pilot samples? 2. How can we adaptively decide when to terminate pilot sampling under a given budget? Our approach is Bayesian. We treat the model-output covariance as an uncertain parameter and perform Bayesian inference conditioned on pilot data to obtain a posterior over covariance matrices. At each pilot iteration, we use the posterior to evaluate an expected-loss criterion that measures the inefficiency from additional pilot samples. We terminate pilot sampling once further pilot samples are projected to decrease efficiency. After termination, the posterior also provides a probabilistic assessment of estimator error, in contrast to point predictions common in prior work. The main contributions of this work are: e propose a Bayesian approach to quantify the uncertainty in covariance estimation from pilot samples, enabling the incorporation of prior knowledge of the model covariance and a probabilistic assessment of estimator performance. • We develop a \gamma -Gaussian prior for correlation matrices (extending the initial formulation of Archakov and Hansen 2021 ) and design efficient methods to project posteriors under additional pilot samples, applicable to both this prior and the inverse Wishart distribution. This capability is essential for incorporating covariance uncertainty into adaptive pilot-sampling termination. • We introduce an interpretable loss function that decomposes into accuracy and cost components, and use it to guide adaptive pilot-sampling termination. • We validate the method on a monomial benchmark problem and a PDE-based Darcy flow application. These contributions provide a principled and general framework for adaptive pilot sampling across a wide range of multi-fidelity estimation settings. While this paper focuses on ACV for concreteness, our developments can also be applied to other estimators such as MLBLUE and GACV. Our code is available at: https://github.com/tcoonsUM/bayes_mfuq . The remainder of this paper is organized as follows. Section 2 reviews ACV estimators and related work. Section 3 introduces Bayesian inference for covariance matrices, including the new \gamma -Gaussian prior. Section 4 presents the expected-loss criterion and the adaptive termination algorithm. Section 5 demonstrates the method on benchmark and PDE-based problems. Section 6 concludes. 2 Background and related work In this section, we provide background on multi-fidelity estimation using ACV estimators and review related work on balancing pilot sampling and estimation costs. 2.1 Approximate control variate estimators Consider a mapping \boldsymbol{Q}=f_{0}(\boldsymbol{Z}) , where \boldsymbol{Z}\in\mathbb{R}^{n_{z}} is a random vector and \boldsymbol{Q}\in\mathbb{R} is a scalar random variable. 1 1 1 We use boldface to denote random quantities, and non-bold symbols to denote their realizations and other non-random quantities. The expected value \mathbb{E}[\boldsymbol{Q}] is typically estimated using the standard MC estimator: \displaystyle\mathbb{E}\left[\boldsymbol{Q}\right]\approx\boldsymbol{\hat{Q}}_{0}(\boldsymbol{z})=\frac{1}{N}\sum^{N}_{j=1}f_{0}(\boldsymbol{Z}^{(j)}), (1) where \boldsymbol{z}=[\boldsymbol{Z}^{(1)},\ldots,\boldsymbol{Z}^{(N)}] is the set of independent and identically distributed (i.i.d.) random samples following p(Z) . 2 2 2 Formally, the probability density is written as p_{\boldsymbol{Z}}(\boldsymbol{Z}=Z) , but for brevity