MAGPI: Multifidelity-Augmented Gaussian Process Inputs for Surrogate Modeling from Scarce Data

Atticus Rex, Elizabeth Qian, David Peterson · 2026

Read MAGPI: Multifidelity-Augmented Gaussian Process Inputs for Surrogate Modeling from Scarce Data by Atticus Rex, Elizabeth Qian, David Peterson (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-22050.txt.

Introduction

Rex and co-authors propose MAGPI, a way to train Gaussian process surrogates when data is scarce. Surrogates can stand in for costly models, but scarce training data makes them shaky. Cheap low-fidelity models can supply extra data. MAGPI uses low-fidelity outputs as added input features for the high-fidelity model. The high-fidelity model is conditioned on all low-fidelity predictions. The design borrows from cokriging but keeps the low cost of autoregressive estimators. Tests show better accuracy at lower cost than prior methods.

Catalog record

CREATORAtticus Rex, Elizabeth Qian, David Peterson
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59815
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.22050

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MAGPI: Multifidelity-Augmented Gaussian Process Inputs for Surrogate Modeling from Scarce Data Atticus Rex, Elizabeth Qian, David Peterson Abstract Supervised machine learning describes the practice of fitting a parameterized model to labeled input-output data. Supervised machine learning methods have demonstrated promise in learning efficient surrogate models that can (partially) replace expensive high-fidelity models, making many-query analyses, such as optimization, uncertainty quantification, and inference, tractable. However, when training data must be obtained through the evaluation of an expensive model or experiment, the amount of training data that can be obtained is often limited, which can make learned surrogate models unreliable. However, in many engineering and scientific settings, cheaper low-fidelity models may be available, for example arising from simplified physics modeling or coarse grids. These models may be used to generate additional low-fidelity training data. The goal of multifidelity machine learning is to use both high- and low-fidelity training data to learn a surrogate model which is cheaper to evaluate than the high-fidelity model, but more accurate than any available low-fidelity model. This work proposes a new multifidelity training approach for Gaussian process regression which uses low-fidelity data to define additional features that augment the input space of the learned model. The approach unites desirable properties from two separate classes of existing multifidelity GPR approaches, cokriging and autoregressive estimators. Numerical experiments on several test problems demonstrate both increased predictive accuracy and reduced computational cost relative to the state of the art. 1 Introduction Many scientific and engineering decisions depend on repeated physical experiments or evaluations of a computational model. This is known as many-query analysis, which arises in optimization [ 37 ] , uncertainty quantification [ 89 ] , and inverse problems [ 10 , 60 ] . In many practical settings, evaluating such experiments or computational models is expensive, making many-query analysis intractable. Obtaining cheap, accurate surrogate models is often required to enable many-query analysis in complex applications. This work focuses on learning surrogate models from labeled input-output data via supervised machine learning [ 77 , 35 , 65 ] . We consider an expensive experiment or simulation to be a function which maps known system inputs to some unknown quantity of interest (QoI) . This function is referred to as the high-fidelity model and is considered to be the most accurate representation of the true system available. When high-fidelity data are plentiful, standard supervised learning algorithms can train reliable surrogate models [ 78 ] . However when high-fidelity data are scarce, the trained surrogate model can suffer from overfitting, poor generalization, inability to capture complex nonlinear behavior, and high model uncertainty [ 76 , 27 , 63 ] . To combat this data scarcity problem, cheaper approximations of the high-fidelity model, known as low-fidelity models, may be used to generate more training data. Low-fidelity models may arise from simplifying assumptions (e.g., switching from a 3-D spatial model to a 2-D or 1-D model, enforcing steady-state conditions, or linearizing about an equilibrium), or the use of lower resolution discretizations. The goal of multifidelity machine learning is to combine high- and low-fidelity data to train a surrogate model with higher accuracy than any low-fidelity model, but lower cost than the high-fidelity model [ 52 , 59 , 14 , 6 , 21 , 31 , 32 , 42 , 29 ] . Beyond machine learning, multifidelity approaches have been developed for uncertainty quantification [ 18 , 19 , 51 , 20 , 66 , 57 ] , statistical inference [ 56 , 50 , 8 , 9 , 7 , 79 ] , and optimization [ 33 , 58 , 36 , 41 , 70 , 16 , 87 , 3 , 86 ] . In this work, we select candidate surrogate models from Gaussian distributions of functions, known as Gaussian processes (GPs) [ 63 ] . GP regression (also known as kriging) is a probabilistic supervised learning technique which emerged from geostatistics in the 20th century as a way to approximate nonlinear functions from data [ 38 , 45 , 34 , 48 , 30 , 63 ] . An important limitation of GP regression is that with N training data points, the cost to train an exact GP regression model grows at a rate of \mathcal{O}(N^{3}) , the result of solving a size- N linear system [ 63 ] . Another challenge in GP regression is choosing the hyperparameters that define the Gaussian distribution of functions from which we choose a surrogate model. This practice, known as hyperparameter optimization, is usually iterative, requiring an \mathcal{O}(N^{3}) linear solve at each iteration [ 64 ] . Recent work modifies the standard form of GPs as defined in [ 63 ] to estimate vector-valued functions [ 46 , 22 , 2 , 5 ] , handle high-dimensional inputs [ 84 , 92 , 68 , 75 , 81 ] , choose optimal hyperparameters [ 64 , 4 , 40 , 72 , 69 ] , incorporate non-Gaussian priors [ 49 , 39 , 13 , 64 ] , and handle large amounts of training data [ 67 , 80 , 74 , 15 , 82 , 61 , 12 ] . GP-based multifidelity surrogate modeling approaches can typically be classified as either cokriging or autoregressive. Cokriging estimators take the form of multi-output GPs [ 34 , 24 , 46 , 22 ] . This approach fits a joint Gaussian distribution to all levels of fidelity simultaneously, but incurs large offline training and online prediction costs when the number of training data points is large (which is likely the case at lower fidelity levels). Additionally, cokriging methods require a unique kernel covariance function to describe each pair of fidelity levels, causing the hyperparameter count to grow at a rate of \mathcal{O}(K^{2}) , where K is the number of levels of fidelity. This often results in poor-conditioning of the kernel matrices in offline training and hyperparameter optimization [ 2 ] . To reduce the number of kernel hyperparameters, many works employ linear models of coregionalization (LMCs) which use linear combinations of shared kernels to relate the levels of fidelity [ 17 , 22 ] . While LMCs reduce computational complexity, they also limit the high-fidelity surrogate model form to linear combinations of the low-fidelity models. Encoding the inputs with Deep Neural Networks (DNNs) as described in [ 62 ] allows for expressive kernels, but does not provide accurate uncertainty estimates in online prediction and still requires the inversion of large multi-output kernel matrices. As an alternative to cokriging, autoregressive estimators train separate fidelity-specific surrogate models and then combine them to form a multifidelity model. The method described by Kennedy & O’Hagan in [ 34 ] uses a linear mapping between fidelity levels and corrects for nonlinear discrepancies with a GP at each level. This technique is known as a “first-order autoregressive" strategy. Since its publication, many extensions to the Kennedy O’Hagan predictor have emerged, including formulations for autoregressive DNNs instead of GPs [ 73 ] and the use of advanced experimental design methods [ 91 , 90 , 85 ] . The nonlinear autoregressive GP (NARGP) approach described in [ 53 ] uses a general nonlinear function to map one level of fidelity to the next-highest

Read the complete text