Single- to multi-fidelity history-dependent learning with uncertainty quantification and disentanglement: application to data-driven constitutive modeling

Jiaxiang Yi, Bernardo P. Ferreira, Miguel A. Bessa · 2025

Read Single- to multi-fidelity history-dependent learning with uncertainty quantification and disentanglement: application to data-driven constitutive modeling by Jiaxiang Yi, Bernardo P. Ferreira, Miguel A. Bessa (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-13416.txt.

Introduction

Jiaxiang Yi, Bernardo Ferreira, and Miguel Bessa wrote a 2025 paper on learning material behaviour from data of mixed quality, with honest error bars. Materials remember their past: response depends on history, not just current load. Data may come as one clean source or many grades, clean or noisy.

Their ladder of models climbs from a plain network to a Bayesian recurrent one that handles many fidelities. It splits doubt into model error and data noise, and can even learn the noise's shape. Tests on material modelling cases show accurate fits with sound uncertainty, a must for design work where a wrong stiffness is not a rounding error.

Catalog record

CREATORJiaxiang Yi, Bernardo P. Ferreira, Miguel A. Bessa
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE108 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-13416

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Single- to multi-fidelity history-dependent learning with uncertainty quantification and disentanglement: application to data-driven constitutive modeling Jiaxiang Yi, Bernardo P. Ferreira, Miguel A. Bessa Abstract Data-driven learning is generalized to consider history-dependent multi-fidelity data, while quantifying epistemic uncertainty and disentangling it from data noise (aleatoric uncertainty). This generalization is hierarchical and adapts to different learning scenarios: from training the simplest single-fidelity deterministic neural networks up to the proposed multi-fidelity variance estimation Bayesian recurrent neural networks. The versatility and generality of the proposed methodology is demonstrated by applying it to different data-driven constitutive modeling scenarios that include multiple fidelities with and without aleatoric uncertainty (noise). The method accurately predicts the response and quantifies model error while also discovering the noise distribution (when present). This opens opportunities for future real-world applications in diverse scientific and engineering domains; especially, the most challenging cases involving design and analysis under uncertainty. K eywords Bayesian recurrent neural networks, Mean and variance estimation networks, Uncertainty quantification and disentanglement, Multi-fidelity modeling, Constitutive modeling 1 Introduction Data-driven learning focuses on the use of machine learning methods to learn non-trivial models from data. Although these models can include Physics constraints [ 1 , 2 ] , in general, they require large quantities of data [ 3 ] . Unfortunately, creating large datasets with high-fidelity (HF) data can be challenging, as it involves high-throughput or a vast number of parallel low-throughput experiments or simulations. By definition, HF datasets require costly simulations or experiments that are time-consuming or resource-intensive to conduct. 1 1 1 This article associates “cost” to time and other resources (computational or experimental) that are needed to run a computer simulation or a physical experiment, such that a sample can be collected into a dataset. High cost implies that it is time-consuming or resource-intensive to generate a large dataset. Conversely, low-fidelity (LF) datasets can be generated faster but have higher error and can be stochastic (noisy). In practice, multi-fidelity (MF) datasets may be necessary to balance the advantages and disadvantages of each fidelity. Without loss of generality, the accuracy-efficiency paradox addressed by MF modeling will be illustrated in this article by focusing on data-driven constitutive modeling of materials. Although the idea of using neural networks as material models can be traced back to the early 90s [ 4 ] , it remained largely dormant for more than two decades. However, the advent of high-performance automatic differentiation libraries and high-throughput data generation strategies, such as simulations of representative volume elements (RVEs) 2 2 2 Recall that an RVE is a sufficiently large domain of a material that is representative of that material’s mechanical behavior, i.e., it leads to the same response even after randomizing the microstructure [ 5 ] . of materials, were shown to create sufficiently large datasets for training accurate models [ 5 ] . This can be achieved by finite element analyses of thousands of RVEs when they are composed of elastic or hyperelastic materials [ 6 ] , but it becomes more challenging when they undergo history-dependent phenomena such as plasticity because the simulations are slower [ 5 ] . A viable pathway is to consider faster simulation methods, e.g., the self-consistent clustering analysis (SCA) [ 7 ] , at the expense of lower accuracy (lower fidelity). Once a sufficiently large dataset is available, recurrent neural networks have been found to learn the complete history-dependent constitutive behavior of materials [ 8 ] . Since then, several researchers followed data-driven strategies to learn constitutive models for a wide range of materials, e.g., [ 9 , 10 , 11 , 12 , 13 ] , including their use to accelerate topology optimization [ 14 ] . Figure 1 exemplifies five different methods of generating datasets with different fidelities, and organizes them according to three characteristics: error, cost, and noise. As indicated in the figure, data can be collected from physical experiments but also from synthetic experiments via deterministic (noiseless) or stochastic (noisy) computer simulations 3 3 3 Stochastic computer simulations can simulate a noisy response, e.g., by randomizing the microstructure in a material domain while keeping the same descriptors of geometry, constituent properties and boundary conditions. . In addition, computer simulations can be divided into two types: direct numerical simulations (DNSs) and reduced order models (ROMs) . Figure 1: Schematic summarizing different data generation methods for discovering the constitutive behavior of materials. Each method and corresponding dataset from which it originates is organized according to cost, noise, and accuracy. A method or a dataset is considered to have high-fidelity (HF) if it has lower error than another method, which is considered to have low-fidelity (LF) . Experiments are usually the most expensive and slowest method to acquire data (high cost), but provide the lowest error, despite the presence of some noise (aleatoric uncertainty). A deterministic direct numerical simulation ( \overline{\text{DNS}} ) is obtained in this work by finite element analysis (FEA) of a representative volume element (RVE) , i.e., a sufficiently large material domain that generates noiseless data. A stochastic DNS ( \widetilde{\text{DNS}} ) is obtained by FEA of a stochastic volume element (SVE) , i.e., a smaller material domain that is faster to simulate but generates noisy data. A deterministic reduced order model ( \overline{\text{ROM}} ) is obtained by self-consistent clustering analysis (SCA) of an RVE (noiseless data with lower-fidelity than FEA but faster to acquire). And lastly, a stochastic ROM ( \widetilde{\text{ROM}} ) is obtained by SCA of an SVE (noisy data with the lowest fidelity and fastest acquisition time). Usually, the most accurate but least efficient method of data collection is to perform a real experiment of the material (indicated by a black circle in Figure 1 ). Data collected from experiments has low error, high cost, and low noise. Noise is illustrated as the shaded black average stress-strain response in the right part of Figure 1 , and it arises from testing different specimens with the same geometry, properties, and boundary conditions. Experimental data is usually scarce and may not be available in sufficient quantity to train a neural network constitutive law [ 15 ] . In addition to conducting real experiments, performing a deterministic DNS (denoted as \overline{\text{DNS}} ) of a material is the best way to collect high-fidelity data. Deterministic DNSs have low error, high cost, and no noise (no aleatoric uncertainty), and they aim to simulate the experimental response as closely as possible. Figure 1 illustrates this type of simulation in magenta. A deterministic DNS is typically obtained by finite element analysis (FEA) of an RVE. A stochastic DNS (denoted as \widetilde{\text{DNS}} ) of a material provides a simple way to reduce cost when compared to a deterministic DNS because it considers a smaller material domain that is no longer representative. Such material domains are usually called stochastic volume elements (SVEs) because randomization of the microstructure leads to different responses (indicated in orange in Figure 1 ). Therefore, a stochastic DNS has noise and typically higher error than a deterministic DNS, but leads to faster data collection. Typically, DNSs are not sufficiently efficient to create large enough databases when the material undergoes history-dependent phenomena like plasticity deformation, even when considering SVEs instead of RVEs. In that case, reduced-order models (ROMs) must be

Read the complete text