Langevin Bi-fidelity Importance Sampling for Failure Probability Estimation
Nuojin Cheng, Alireza Doostan · 2025
Read Langevin Bi-fidelity Importance Sampling for Failure Probability Estimation by Nuojin Cheng, Alireza Doostan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-17796.txt.
Introduction
Nuojin Cheng and Alireza Doostan improve gauges of failure probability, a core task in work on uncertainty. Importance sampling gauges such values with good speed. But its accuracy rests a lot on the biasing distribution that is picked. A poor pick can swell the error a lot, most of all for rare failures.
Their method, Langevin bi-fidelity importance sampling, leans on a cheaper low-fidelity surrogate model and its derivatives. Sampling methods of Langevin type, based on the score function, make new samples guided by the surrogate. The method cuts the mean square error of failure gauges by a lot. Gains are clearest in high-dimensional input spaces and when high-fidelity runs are scarce. The team tests the method on two fake functions and two real uses.
Catalog record
| CREATOR | Nuojin Cheng, Alireza Doostan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-17796
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Langevin Bi-fidelity Importance Sampling for Failure Probability Estimation Nuojin Cheng, Alireza Doostan Abstract Estimating failure probability is a key task in the field of uncertainty quantification. In this domain, importance sampling has proven to be an effective estimation strategy; however, its efficiency heavily depends on the choice of the biasing distribution. An improperly selected biasing distribution can significantly increase estimation error. One approach to address this challenge is to leverage a less expensive, lower-fidelity surrogate. Building on the accessibility to such a model and its derivative on the random uncertain inputs, we introduce an importance sampling-based estimator, termed the Langevin bi-fidelity importance sampling (L-BF-IS), which uses score-function-based sampling algorithms to generate new samples and substantially reduces the mean square error (MSE) of failure probability estimation. The proposed method demonstrates lower estimation error, especially in high-dimensional input spaces and when limited high-fidelity evaluations are available. The L-BF-IS estimator’s effectiveness is validated through experiments with two synthetic functions and two real-world applications governed by partial differential equations. These real-world applications involve a composite beam, which is represented using a simplified Euler-Bernoulli equation as a low-fidelity surrogate, and a steady-state stochastic heat equation, for which a pre-trained neural operator serves as the low-fidelity surrogate. Journal: TBA 1 Introduction Uncertainty ubiquitously appears in many real-world applications, such as weather forecasting, financial modeling, healthcare decision-making, and engineering design. In computational modeling, uncertainty is often represented by a random vector, defined within a specific probability distribution based on prior knowledge or observation data. One of the key goals of uncertainty quantification (UQ) is to estimate the probability of a device or system failure based on model outputs, also known as the quantity of interest (QoI). There are many methods to solve this problem, including the first-order reliability method (FORM) [ 1 , 2 ] and its extension to the second order [ 3 ] . Other works involve the Monte Carlo sampling method [ 4 ] . However, the standard Monte Carlo method faces the challenge of slow convergence relative to sample size, especially when the probability of the failure event is small. In practical scenarios, model evaluation demands substantial computational resources, limiting the Monte Carlo method’s feasibility. Consequently, there is significant interest in enhancing the convergence of the Monte Carlo method by reducing the number of model evaluations, primarily achieved by reducing the variance of estimators. Variance reduction in Monte Carlo estimators can be primarily approached in two ways. The first method involves control variates [ 5 , 6 , 7 ] , which uses correlated random variables to adjust the original estimator based on the covariance between the control and target variables. This adjustment yields a new estimator with reduced variance, provided the appropriately chosen control variable is well-correlated with the target variable. Despite its widespread application in UQ, the efficient control variate method is contingent on the availability of highly correlated control variables with known (or cheap to evaluate) mean and accurate covariance estimation, limiting its applicability. The second method is importance sampling (IS), which is the focus of this work. IS samples the input random variables following a different probability distribution (referred to as biasing distribution) to emphasize the regions that significantly impact the estimation. This approach effectively reduces the estimator variance and focuses on crucial input space areas, proving particularly useful in scenarios involving rare events or tail probability estimations. The critical challenge in IS is constructing a suitable biasing distribution, a task complicated by limited access to model outputs under the UQ setting. Several studies have examined the construction of biasing distributions specifically tailored for failure probability estimation. Adaptive importance sampling techniques, such as those in [ 8 , 9 , 10 , 11 ] , tune the biasing density within a parameterized family by adaptively finding the optimal density under the cross entropy criteria. Papaioannou et al. [ 12 ] discuss the application of sequential importance sampling (SIS) for estimating the probability of failure in structural reliability analysis. Initially developed for exploring posterior distributions and estimating normalizing constants in Bayesian inference, SIS involves a sequential reweighting operation that progressively shifts samples from the prior to the posterior distribution. This work was later adapted using the ensemble Kalman filter [ 13 ] and consensus sampling [ 14 ] . However, these methods may require extensive forward model computations, limiting their practical applicability. To mitigate the computational burdens associated with high-fidelity (HF) models, adopting a “low-fidelity” (LF) model proves advantageous. This model, for instance, derived from the same solver but employing a coarser grid or an approximate surrogate function—either based on fixed basis functions or data-driven—offers reduced accuracy in exchange for significantly lower computational cost. This approach, often named bi-fidelity or multi-fidelity, has been integrated into many of the aforementioned methods. For instance, Li et al. [ 15 ] utilized surrogates of the limit state function as low-fidelity models to enhance adaptive importance sampling [ 16 ] . Similarly, Wagner et al. [ 17 ] extended sequential importance sampling to multi-level cases where coarse grid solutions serve as low-fidelity models. Peherstorfer et al. [ 18 ] proposed the multi-fidelity importance sampling method (MF-IS), which constructs the biasing distribution by applying a Gaussian mixture model to inputs whose LF evaluations indicate potential failures, suggesting that inputs failing under LF conditions are likely to fail under HF conditions as well. This strategy preserves the unbiased nature of the importance sampling estimator and does not confine the format of the LF model. Subsequent extensions of this framework [ 19 , 20 , 21 ] have integrated a collection of different estimators and explored the balance between computation and accuracy. However, the aforementioned multi-fidelity methods using polynomial chaos surrogates or based on Gaussian mixture models are known for their rapidly growing complexity with the increase in the dimension of the inputs, denoted as D . Moreover, identifying the number of failure clusters for the Gaussian mixture model poses challenges without prior knowledge. In response to the identified challenges, a recent work by Cui et al. [ 22 ] introduced a deep importance sampling method. This method is notable for its biasing distribution construction with linear complexity \mathcal{O}(D) . This was achieved through the push-forward of a reference distribution under a series of order-preserving transformations, each shaped by a squared tensor-train decomposition. While this method offers theoretical and numerical advancements over [ 18 ] , challenges related to the training of neural networks and its associated optimization error persist. In practical applications, low-fidelity models often possess additional properties and information that can be leveraged. For instance, when a low-fidelity model is a simplified model, such as the Euler-Bernoulli equation for beam deflections [ 23 , 24 ] , its explicit formulation facilitates simple forward evaluation at minimal cost and provides derivative information. Similarly, when the low-fidelity model is a data-driven surrogate model, the recent development of auto-differentiation-enabled libraries [ 25 , 26 ] produces derivatives of the forward surrogate map. These examples highlight the potential of utilizing additional knowledge from low-fidelity models to construct more effective biasing distributions for importance sampling estimators. In this work, we introduce a new importance sampling estimator, named Langevin Bi-fidelity Importance Sampling (L-BF-IS). By leveraging a new parameterization of the biasing