Gaussian mixture models for model improvement

Paolo Villani, Daniel Andres Arcones, Jörg F. Unger, Martin Weiser · 2026

Read Gaussian mixture models for model improvement by Paolo Villani, Daniel Andres Arcones, Jörg F. Unger, Martin Weiser (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-15101.txt.

Introduction

Villani and co-authors use Gaussian mixture models to find where a simulation model goes wrong. Engineers must trade physical fidelity against practicality, so gaps between simulation and measurement persist even after calibration. Their non-intrusive method maps sensor readings to clusters of physical parameters. The clusters expose systematic discrepancies and model bias, which point to targeted fixes. The setup is Bayesian and uses expectation-maximization. Tests include a toy example and a real study of heat transfer in a concrete bridge.

Catalog record

CREATORPaolo Villani, Daniel Andres Arcones, Jörg F. Unger, Martin Weiser
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58401
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.15101

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Gaussian mixture models for model improvement Paolo Villani, Daniel Andres Arcones, Jörg F. Unger, Martin Weiser Abstract Modeling complex physical systems such as they arise in civil engineering applications requires finding a trade-off between physical fidelity and practicality. Consequently, deviations of simulation from measurements are ubiquitous even after model calibration due to the model discrepancy, which may result from deliberate modeling decisions, ignorance, or lack of knowledge. If the mismatch between simulation and measurements are deemed unacceptable, the model has to be improved. Targeted model improvement is challenging due to a non-local impact of model discrepancies on measurements and the dependence on sensor configurations. Many approaches to model improvement, such as Bayesian calibration with additive mismatch terms, gray-box models, symbolic regression, or stochastic model updating, often lack interpretability, generalizability, physical consistency, or practical applicability. This paper introduces a non-intrusive approach to model discrepancy analysis using mixture models. Instead of directly modifying the model structure, the method maps sensor readings to clusters of physically meaningful parameters, automatically assigning sensor readings to parameter vector clusters. This mapping can reveal systematic discrepancies and model biases, guiding targeted, physics-based refinements by the modeler. The approach is formulated within a Bayesian framework, enabling the identification of parameter clusters and their assignments via the Expectation-Maximization (EM) algorithm. The methodology is demonstrated through numerical experiments, including an illustrative example and a real-world case study of heat transfer in a concrete bridge. Keywords: model deficiency, model improvement, mixture models MSC 2020: 62F15, 62H30, 62P30, 93B30 1 1 footnotetext: Freie Universität Berlin, Arnimallee 6, 14195 Berlin 2 2 footnotetext: Zuse Institute Berlin, Takustr. 7, 14195 Berlin 3 3 footnotetext: Bundesanstalt für Materialforschung und -prüfung, Unter den Eichen 87, 12205 Berlin 1 Introduction and state of the art Modeling complex physical systems is inherently challenging because the appropriate level of detail, both on the level of the geometry and on the level of the physical phenomena to be considered, depends on the specific problem setup and the quantity of interest. Most models are parameterized, and these parameters are closely tied to the simplifications in the model. For example, representing a reinforced concrete bridge as an isotropic material effectively homogenizes the properties of concrete and reinforcement to an average value that depends on the actual geometry and is therefore unknown. Consequently, identifying suitable model parameters based on experimental data is a critical step in developing a reliable model [ 16 , 30 ] . Once the parameters have been identified, the next step is to compare simulation results with experimental measurements to validate the model. If the model is found to be deficient, i.e. not to reproduce the observed measurements within their expected measurement error range, one can either focus on uncertainty quantification or on model improvement. Uncertainty quantification accepts the deficient model but aims at providing a good estimate of the achieved accuracy. If the model is to be used for making predictions, it is of vital importance to also quantify the prediction errors. This is, e.g., the goal of embedding methods [ 2 , 3 , 27 ] and stochastic model updating [ 5 , 23 ] . Here, a stochastic model is built with an output distribution that matches the distribution of observations sufficiently well. This is achieved by replacing deterministic model parameters by random variables and identifying their distributions. Such methods are most appropriate for situations where multiple, nominally identical but randomly varying systems are to be described by a single model, but are also used for uncertainty quantification in the case of model form uncertainty. These methods are non-intrusive, but limited to situations where the measurements lie close to the output manifold of the deterministic forward model. In contrast, model improvement approaches aim at refining the model such that it can reproduce the measurements better. This is, however, far from straightforward. Discrepancies between simulated predictions and measurements are often not directly linked to errors at the same local position in the model; they may originate elsewhere, depending on the governing equations and sensor configuration. Determining why a discrepancy occurs and which part of the model requires refinement is usually an iterative process based on trial and error and expert judgment. Approaches to treat model form uncertainty and to improve simulation models based on some observations or measurements are manifold. Common to all is that they rely on an enrichment of the simulation model in one way or the other. In a seminal paper, Kennedy and O’Hagan [ 18 ] propose to include an additive model response mismatch term with a Gaussian process prior, and to identify it in a Bayesian setting along with the original model parameters. Plumlee [ 24 ] proposes a variant where the mismatch term is orthogonal to the model response surface, arguing that as much as possible of the observations should be explained by the original model and not by the mismatch term. Essentially, this amounts to a sequential identification of the model parameters and the mismatch term. This is a straightforward and non-intrusive method, which, however, neither provides an improved physical model understanding nor allows predicting model states or responses not directly related to the available observations. A more fine-grained control over the mismatch term, at the expense of a more intrusive approach, is obtained by gray box models, where mismatch terms are added to individual constitutive equations in a PDE model [ 6 ] . Still, the interpretability of the results and their generalization capabilities strongly depend on the level of detail of the model mismatch terms. Methods aiming directly at extending the model by interpretable and physically consistent terms include symbolic regression [ 19 , 28 ] and the more recent sparsity-constrained dictionary search [ 7 , 8 , 10 , 29 ] . These approaches rely on finding the simplest (by number of additional terms in the model equations) extension by selecting the most suitable terms from a potentially huge dictionary. While providing excellent interpretability and true discovery potential, they suffer from the need to define the dictionary in the first place, from its combinatorically growing size, and from the need to have a solver at hand that is able to cope with all these extensions, or arbitrary subsets, at once. Consequently, this kind of approach is highly intrusive. Less intrusive are attempts to learn from data just particular aspects of the model, such as constitutive laws [ 4 , 13 , 22 ] , with the risk of missing the real cause of model deficiency. Mixture models haven been used widely, in particular in social sciences and economics, to identify models where the unobserved association to a certain subgroup of the sample determines the statistical properties of the observation [ 21 , 31 ] , including outlier detection [ 1 ] and image smoothing [ 25 ] . The focus is generally on the identification of the latent subgroups as cofounding factors, and selecting an appropriate number of subgroups through model comparison [ 14 ] . Related, but less firmly grounded in stochastic models, are mixture of experts approaches [ 15 ] which aim to combine multiple models to construct a better overall model. Many of the previously discussed approaches for model improvement or error detection attempt

Read the complete text