Bi-fidelity Interpolative Decomposition for Multimodal Data Journal: Elsevier

Murray Cutforth, Tiffany Fan, Tony Zahtila, Alireza Doostan, Eric Darve · 2025

Read Bi-fidelity Interpolative Decomposition for Multimodal Data Journal: Elsevier by Murray Cutforth, Tiffany Fan, Tony Zahtila, Alireza Doostan, Eric Darve (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-12243.txt.

Introduction

Murray Cutforth and 4 co-authors tackle cheaper simulation for problems that can jump between distinct behaviors, in a 2025 paper. Multi-fidelity methods mix many cheap low-fidelity runs with a few costly high-fidelity ones. One such method, bi-fidelity interpolative decomposition, builds a reduced basis from the cheap data to approximate the expensive results.

The authors show that method can fail when responses are multimodal and which mode appears is random. They introduce an extension designed for that case. Their motivating example is a laser-ignited methane-oxygen rocket combustor studied over uncertain inputs, where behavior splits in a bifurcation-like way in parts of the parameter space. Handling that split correctly matters for uncertainty studies, design exploration, and optimization that rely on trustworthy approximations.

Catalog record

CREATORMurray Cutforth, Tiffany Fan, Tony Zahtila, Alireza Doostan, Eric Darve
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-12243

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bi-fidelity Interpolative Decomposition for Multimodal Data Journal: Elsevier Murray Cutforth, Tiffany Fan, Tony Zahtila, Alireza Doostan, Eric Darve Abstract Multi-fidelity simulation is a widely used strategy to reduce the computational cost of many-query numerical simulation tasks such as uncertainty quantification, design space exploration, and design optimization. The reduced basis approach based on bi-fidelity interpolative decomposition is one such approach, which identifies a reduced basis, along with an interpolation rule in that basis, from low-fidelity samples to approximate the corresponding high-fidelity samples. However, as illustrated in the present study, when the model response is multi-modal and mode occupancy is stochastic, the assumptions underpinning this approach may not hold, thus leading to inaccurate estimates. We introduce the multi-modal interpolative decomposition method using bi-fidelity data, an extension tailored for this use case. Our work is motivated by a complex engineering application: a laser-ignited methane-oxygen rocket combustor evaluated over uncertain input parameters, exhibiting a bifurcation-like phenomenon in some regions of parameter space. Unlike the standard bi-fidelity interpolative decomposition approach, the proposed method can approximate a dataset of high-fidelity simulations for 16% of the cost, while maintaining relatively high correlation (0.70–0.90) with parameter sensitivities. 1 Introduction Computational cost is a ubiquitous limiting factor in the simulation of realistic physical and engineering systems, particularly when evaluated over a large input parameter space as is required in many-query tasks such as uncertainty quantification (UQ) Doostan and Iaccarino 2009 , Doostan and Owhadi 2011 , Zhang 2021 , design optimization Queipo et al. 2005 , and inverse problems Hasanoğlu and Romanov 2021 . The strategy of multi-fidelity modeling Peherstorfer et al. 2018 , Ng and Eldred 2012 , Giles 2015 has emerged to address this, where two or more different fidelity levels are combined, exploiting correlation between levels. Lower-fidelity in this context means a cheaper but less accurate model, such as using a data-driven surrogate model, reducing resolution, or using simplified governing equations. Among multi-fidelity UQ techniques, this work utilizes the bi-fidelity interpolative decomposition (bi-fidelity ID) introduced in Doostan et al. 2016 , Hampton et al. 2018 , a linear algebra-based technique closely related to Doostan et al. 2007 , Narayan et al. 2014 , Newberry et al. 2022 . This approach identifies a reduced basis, along with an interpolation rule in that basis, from a collection of low-fidelity samples and approximates the high-fidelity output at the same set of parametric inputs using a small number of high-fidelity model evaluations. The bi-fidelity ID procedure is based on the assumption that an identical interpolation rule applies to both fidelity levels. While successful in many single-mode contexts, Fairbanks et al. 2020 , Fairbanks et al. 2017 , Skinner et al. 2019 , Pinti et al. 2022 , such an assumption can fail for multi-modal or bifurcating systems, where regions in the input space may exhibit qualitatively distinct solution “clusters” (or “branches”) and cluster membership (branch occurrence) is stochastic. In these cases, naïvely transferring a single interpolation rule from the low-fidelity data may produce large approximation errors in the high-fidelity predictions. This paper presents an extension of the bi-fidelity ID approach tailored for data arising from multi-modal or bifurcating responses driven by stochasticity. The main idea is to incorporate a mixture-model view of the low- and high-fidelity data, which allows conditional interpolation weights to be employed. By conditioning the high-fidelity interpolation on the actual cluster (or mode) identified in a small subset of high-fidelity data, one can avoid mismatches of the low-fidelity and high-fidelity basis elements that lead to large approximation errors. The method, termed multi-modal ID , retains the efficiency of a column-based bi-fidelity approach while extending it to cases where distributions of the quantity of interest (QOI), conditioned on the realization of random inputs, may present multiple solution modes, each requiring a distinct cluster in the low-rank representation. The method description and numerical experiments consider the specific case of a bifurcating solution (two clusters); however, we note that the approach can be straightforwardly extended to more than two clusters. We organize the paper as follows. After providing a survey of related bi-fidelity and low-rank approximation techniques, we present in Section 3 the existing bi-fidelity interpolative decomposition framework. Section 3.3 then introduces the proposed multi-modal ID approach, including conditions under which it is valid and an algorithmic description. Numerical examples in Section 4 illustrate that the multi-modal ID drastically improves approximation quality in multi-modal scenarios. 2 Related Work Multi-fidelity surrogate modeling The idea of exploiting multiple model fidelities for efficient uncertainty quantification has been extensively explored in the literature. Early techniques focused on co-kriging Kennedy and O’Hagan 2000 , Le Gratiet and Garnier 2014 , Le Gratiet 2013 . Another popular approach is polynomial chaos expansion, in which polynomial bases are combined across fidelities Ng and Eldred 2012 , Palar et al. 2016 , Newberry et al. 2022 . More recently, neural network-based representations have become popular, including adaptations for multi-fidelity data such as the neural surrogate model in Meng and Karniadakis 2020 , De et al. 2020 , Motamed 2020 , De and Doostan 2022 , and the bi-fidelity variational auto-encoder in Cheng et al. 2024 . While neural network-based models are valuable tools, linear methods such as the proposed method still have their niche due to vastly reduced compute and data requirements. Interpolative decomposition and low-rank approximation ID is a low-rank matrix factorization which is distinguished by the fact that one factor consists of a subset of columns from the original data matrix, which is a useful feature in downstream tasks – the truncated singular value decomposition, which provides the optimal reconstruction Eckart and Young 1936 does not have this attribute. There exists a large number of randomized algorithms for the efficient computation of the ID Liberty et al. 2007 , and this remains an area of active research, e.g., Dong et al. 2023 . In the multi-fidelity setting, the idea of utilizing a low-rank ID was introduced by Doostan et al. Doostan et al. 2016 . The multi-fidelity ID is closely related to the approaches presented in Doostan et al. 2007 , Narayan et al. 2014 , Newberry et al. 2022 . In subsequent work Hampton et al. 2018 , an a posteriori error estimate is derived to assess the utility of a pair of low- and high-fidelity models in producing accurate bi-fidelity data. Stochastic extensions and mixture models Several authors have investigated ways of blending clustering or classification ideas with low-dimensional subspace approximation. The clustered reduced-order modeling approach in Kaiser et al. 2014 decomposes the solution manifold into separate regions or modes, each with its own reduced basis. The classification and cluster-based basis function approach to reduced order modeling in Xiong et al. 2022 is also similar. However, none of the above approaches leverages multi-fidelity data. 3 Methodology 3.1 Bi-fidelity ID We begin by restating the bi-fidelity ID algorithm introduced in Doostan et al. 2016 . The quantity of interest (QOI) is denoted as \bm{v}(\bm{\xi})\in\mathbb{R}^{M} , where \bm{\xi}\in\mathbb{R}^{d} is a vector of random inputs with known probability density. We are interested in low-rank approximations to \bm{v}(\bm{\xi}) : \bm{v}(\bm{\xi})\approx\sum_{l=1}^{r}\bm{v}(\bm{\xi}_{l})c_{l}(\bm{\xi}), (1) where it is assumed that a rank r\ll M representation produces an accurate estimate of \bm{v}(\bm{\xi}) . The approach is based on measuring the (discretized) QOI using

Read the complete text