Should We Simultaneously Calibrate Multiple Computer Models?
Jonathan Tammer Eweis-Labolle, Tyler Johnson, Xiangyu Sun, Ramin Bostanabad · 2025
Read Should We Simultaneously Calibrate Multiple Computer Models? by Jonathan Tammer Eweis-Labolle, Tyler Johnson, Xiangyu Sun, Ramin Bostanabad (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18176.txt.
Introduction
Jonathan Tammer Eweis-Labolle, Tyler Johnson, Xiangyu Sun, and Ramin Bostanabad ask whether engineers should tune several computer models at once instead of one by one. Designers often hold a shelf of models of the same system, cheap rough ones and costly precise ones, and in the past calibrated each separately against trusted data. The authors build a probabilistic framework, based on tailored neural networks, that calibrates any number of models at the same time.
The framework handles models with several outputs and differing parameter sets, learns a probability distribution for every calibration parameter, and trains against all data sources at once. It also shapes a readable latent space where model-form errors can be spotted. Tests on analytic and engineering problems show joint calibration can improve predictive accuracy. Its weakness is identifiability: in higher-dimensional input spaces, parameters can trade off against each other unless physics pins them down.
Catalog record
| CREATOR | Jonathan Tammer Eweis-Labolle, Tyler Johnson, Xiangyu Sun, Ramin Bostanabad |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-18176
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Should We Simultaneously Calibrate Multiple Computer Models? Jonathan Tammer Eweis-Labolle, Tyler Johnson, Xiangyu Sun, Ramin Bostanabad Abstract † † footnotetext: * Joint First Authors † † footnotetext: † Corresponding Author: [email protected] Abstract In an increasing number of applications designers have access to multiple computer models which typically have different levels of fidelity and cost. Traditionally, designers calibrate these models one at a time against some high-fidelity data (e.g., experiments). In this paper, we question this tradition and assess the potential of calibrating multiple computer models at the same time. To this end, we develop a probabilistic framework that is founded on customized neural networks (NNs) that are designed to calibrate an arbitrary number of computer models. In our approach, we (1) consider the fact that most computer models are multi-response and that the number and nature of calibration parameters may change across the models, and (2) learn a unique probability distribution for each calibration parameter of each computer model, (3) develop a loss function that enables our NN to emulate all data sources while calibrating the computer models, and (4) aim to learn a visualizable latent space where model-form errors can be identified. We test the performance of our approach on analytic and engineering problems to understand the potential advantages and pitfalls in simultaneous calibration of multiple computer models. Our method can improve predictive accuracy, however, it is prone to non-identifiability issues in higher-dimensional input spaces that are normally constrained by underlying physics. Keywords: Model Calibration; Multi-fidelity Modeling; Uncertainty Quantification; Probabilistic Neural Networks; Inverse Problems; Manifold Learning; Data Fusion. 1 Introduction Computer models are increasingly employed in the design of complex systems for which direct observations may be scarce [ 1 , 2 , 3 , 4 , 5 , 6 , 7 ] . Such models are typically built to simulate a range of expected behaviors — for instance, a given finite element (FE) model can simulate a wide variety of materials, loading conditions, failure modes, and so on [ 8 ] . This flexibility typically relies on having calibration parameters which must be tuned (i.e., calibrated) against some experimental or observational data such that the model’s output matches the behavior of the true system as closely as possible before the model is used in design. To contextualize the calibration problem and some of its challenges, consider simulating the tension test (with fracture) of a metallic alloy via the FE method. There are a number of constitutive laws available such as Gurson-Tvergaard-Needleman (GTN) and J2 plasticity which can be used to model the material behavior. These laws not only have varying degrees of accuracy and cost, but also have shared and disparate tuning parameters [ 9 ] . While parameters such as Young’s modulus, Poisson’s ratio, and yield stress all have physical significance and exist in both laws, others account for issues such as mesh-dependency or missing physics and hence are specific to each constitutive law. Hence, in this problem, our goal is to match limited experimental data by calibrating the parameters of each constitutive law, i.e., we want the resulting FE models to perform well and avoid overfitting. As reviewed in Section 2 , existing calibration approaches have a few common characteristics. For instance, they all rely on surrogate models such as Gaussian processes (GPs) or neural networks (NNs) to reduce the data collection costs while increasing the efficiency of exploring (or sampling from) the parameter search space. In the relevant literature, the target/true system is typically referred to as the high-fidelity (HF) source while computer models (which require calibration) are generally considered as low-fidelity (LF) sources. With this terminology in mind, we note that existing methods almost always work in a bi-fidelity setting where a single LF source is calibrated using limited samples from an HF source. Given the availability of multiple LF sources in most engineering applications, a natural question arises: Can we calibrate these LF sources simultaneously? Answering this question is challenged by the fact that LF sources typically have (1) a different number of calibration parameters which may or may not have physical meanings, (2) varying degrees of fidelity where it is generally more costly to sample from the more accurate LF sources, and (3) multiple responses. Our goal in this paper is to design a framework that simultaneously calibrates multiple LF sources regardless of their accuracy/fidelity levels or the number/nature of their calibration parameters. We build our framework via NNs and use it to study the potential benefits and drawbacks of simultaneous calibration of multiple LF sources. The rest of the paper is organized as follows: We provide some literature review in Section 2 and introduce our approach in Section 3 . We assess the performance of our approach on two examples in Section 4 and then provide further discussions and concluding remarks in Sections 5 and 6 , respectively. 2 Related Works Gaussian Processes: Many calibration frameworks leverage GPs because they are probabilistic surrogates (i.e., emulators) that are easy to fit, interpretable, and robust to overfitting [ 10 , 11 , 12 , 13 ] . GPs provide priors over function spaces by assuming that the observations follow a multivariate normal distribution (MVN) whose mean vector and covariance matrix are constructed via the GP’s parametric mean function and kernel (aka covariance function). Given some input-output pairs, a GP can be easily trained via maximum likelihood estimation (MLE) [ 14 ] . GP-based Calibration: GPs can be used for calibration either directly or as an integral part of structured frameworks. A prominent example of the latter is the work of Kennedy and O’Hagan (KOH) [ 15 ] who leverage GPs to additively relate a computer model to the corresponding physical system: \eta^{h}{\left(\boldsymbol{x}{}\right)}=\eta^{l}{\left(\boldsymbol{x}{},\boldsymbol{\theta}{}^{*}\right)}+\delta{\left(\boldsymbol{x}{}\right)} (1) where \boldsymbol{x}{} are the system inputs, \boldsymbol{\theta}{}^{*} are the true calibration parameters, and \eta^{l}(\cdot) , \eta^{h}{}(\cdot) , and \delta(\cdot) are GP emulators of the LF source, HF source, and discrepancy/bias function, respectively. The parameters of these GPs as well as \boldsymbol{\theta} can be estimated via fully [ 16 , 17 ] or modular [ 18 , 19 , 20 , 21 , 22 ] Bayesian inference. Although this method has been successfully applied to many applications [ 23 , 24 , 18 ] , it only accommodates bi-fidelity problems, suffers from identifiability issues, scales poorly to high-dimensional problems, and imposes an additive nature on the bias [ 15 , 16 , 25 , 26 ] . KOH’s method has been extended in a number of important directions that address some of these issues by, e.g., using multi-response data to reduce non-identifiability issues [ 27 , 28 , 22 ] or by using principal component analysis to enable scalability to high-dimensional outputs [ 29 ] . Recent works have used GPs directly for calibration by reformulating their kernel [ 11 , 13 ] . The main idea of these works is to augment the input space via a categorical source-indicator variable that is internally converted to some quantitative latent variables which are then passed to the kernel. The addition of this categorical variable also allows for the direct inclusion of calibration parameters in the kernel as unknown variables which are estimated either deterministically or probabilistically during training. This approach does not