Discovering uncertainty: Gaussian constitutive neural networks with correlated weights
Jeremy A. McCulloch, Ellen Kuhl · 2025
Read Discovering uncertainty: Gaussian constitutive neural networks with correlated weights by Jeremy A. McCulloch, Ellen Kuhl (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-12679.txt.
Introduction
Jeremy McCulloch and Ellen Kuhl present Gaussian constitutive neural networks that learn material laws with uncertainty. Engineers need not just a predicted response, but its spread across samples. Standard constitutive networks give only the mean response of a material.
Their network treats weights as linked random values with clear meaning. It needs fewer parameters and trains more simply than Bayesian versions. On biaxial test data it found a sparse four-term model. The model also revealed how its parameters vary together. Material constants come out as distributions, not single points. That spread helps judge risk in design with real materials. The method keeps physical laws exact while adding honest doubt.
Catalog record
| CREATOR | Jeremy A. McCulloch, Ellen Kuhl |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-12679
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Discovering uncertainty: Gaussian constitutive neural networks with correlated weights Jeremy A. McCulloch, Ellen Kuhl Abstract When characterizing materials, it can be important to not only predict their mechanical properties, but also to estimate the probability distribution of these properties across a set of samples. Constitutive neural networks allow for the automated discovery of constitutive models that exactly satisfy physical laws given experimental testing data, but are only capable of predicting the mean stress response. Stochastic methods treat each weight as a random variable and are capable of learning their probability distributions. Bayesian constitutive neural networks combine both methods, but their weights lack physical interpretability and we must sample each weight from a probability distribution to train or evaluate the model. Here we introduce a more interpretable network with fewer parameters, simpler training, and the potential to discover correlated weights: Gaussian constitutive neural networks. We demonstrate the performance of our new Gaussian network on biaxial testing data, and discover a sparse and interpretable four-term model with correlated weights. Importantly, the discovered distributions of material parameters across a set of samples can serve as priors to discover better constitutive models for new samples with limited data. We anticipate that Gaussian constitutive neural networks are a natural first step towards generative constitutive models informed by physical laws and parameter uncertainty. Our source code, data, and examples are available at https://github.com/LivingMatterLab/CANN. ∎ 1 Motivation Standard constitutive models predict the stress in a material from its deformation holzapfel_2000 , but do not provide error bars for this estimate or characterize the probability distribution of the stress. Knowing the uncertainty of a model prediction is particularly important for biological and surgical materials, which are used in finite element simulations to predict outcomes of a surgical procedure or disease progression updegrove_simvascular_2017 ; fletcher_development_2014 . The accuracy of these finite element simulations is intrinsically limited by the accuracy of the underlying constitutive model peirlinck_2024 . Furthermore, experimental data for biological materials often display large error bars budday_mechanical_2017 ; sommer_biomechanical_2015 , mainly caused by the inherent inter-patient variability, but also by varying boundary effects from inconsistent experimental settings miller_method_2005 . Existing constitutive machine learning methods such as constitutive artificial neural networks linka_new_2023 , EUCLID flaschel_automated_2023 , and neural ordinary differential equations tac_data-driven_2024 can discover constitutive models that accurately predict the mean stress response , but typically do not quantify the variance of the stress fuhg_2024 . Recent studies have discovered constitutive models for the average across several samples compared to each individual sample, and emphasize need for a unified model that takes uncertainty into account vervenne_constitutive_2025 . To use constitutive models with confidence, we need interpretable and validated models that can not only accurately predict the mean stress response but also characterize the variance of the stress. 1.1 Constitutive Modeling A hyperelastic constitutive model is a function that predicts the local stress in a material given its local deformation. The global deformation of a material is defined by its deformation map \bm{x}=\bm{\varphi}(\bm{X}) that maps a point \bm{X} in the reference configuration to a point \bm{x} in the deformed configuration. The local deformation is measured by the deformation gradient \bm{F}=\nabla_{{\rm{\bf{X}}}{}}\bm{\varphi}(\bm{X}) and the right Cauchy-Green deformation tensor \bm{C}=\bm{F}^{\rm{t}}\cdot\bm{F} . The local stress in a material is defined by its Piola stress \bm{P} . While a generic Cauchy-elastic constitutive model can express the Piola stress as \bm{P}=\bm{f}(\bm{F}) for any function \bm{f} , hyperelastic constitutive models restrict the Piola stress to the derivative of a scalar potential \bm{P}=\partial\psi(\bm{F})/\partial\bm{F} . Various approaches have been used to model the strain energy function \psi , including classical continuum-mechanics-based approaches and machine-learning-based approaches such as constitutive neural networks. 1.2 Constitutive Neural Networks Constitutive neural networks combine classical constitutive modeling approaches with modern machine learning techniques to automatically discover interpretable constitutive models that satisfy physical constraints linka_new_2023 . The classical method of discovering a constitutive model consists of selecting a model from a library of phenomenological models and then optimizing the parameters of that model. This process requires domain expertise, is iterative, and is potentially time-consuming linka_new_2023 . Neural networks offer a solution that can approximate any nonlinear function cybenko_approximation_1989 given sufficient training data and minimal human input; however, standard fully-connected neural networks fail to extrapolate to unseen loading conditions, and can violate known physical constraints such as polyconvexity or material symmetry buganza_2025 . Physics-informed neural networks offer a method of incorporating physical constraints into neural networks by introducing an additional term into the loss function raissi_physics-informed_2019 . However, physics-informed neural networks do not exactly satisfy physical laws unless the physics-informed loss is zero. Constitutive neural networks use carefully chosen activation functions and model architectures to ensure that physical constraints are satisfied by construction, regardless of the model weights. These physical constraints include polyconvexity, material objectivity, and symmetry. Different constitutive neural network architectures are used depending on the type of material, with specific models developed for isotropic materials pierre_principal-stretch-based_2023 , transversely isotropic materials vervenne_constitutive_2025 , and inelastic materials holthusen_theory_2024 ; boes_accounting_2024 ; for orthotropic meshes, a model has been developed that has eight isotropic terms and six anisotropic terms mcculloch_automated_2024 . This orthotropic constitutive neural network represents the strain energy as a function of the first and second invariants, I_{1}=\bm{C}:\bm{I} and I_{2}=\frac{1}{2}[\,I_{1}^{2}-\bm{C}:\bm{C}\,] , as well as three mixed invariants, I_{4w}=\bm{w}\cdot\bm{C}\cdot\bm{w} , I_{4s_{I}}=\bm{s}_{I}\cdot\bm{C}\cdot\bm{s}_{I} , and I_{4s_{II}}=\bm{s}_{II}\cdot\bm{C}\cdot\bm{s}_{II} . The unit vector \bm{w} is the direction of the stiffest fiber, and the unit vectors \bm{s}_{I} and \bm{s}_{II} are offset from \bm{w} by 60 degrees in each direction. These invariants are raised to the first and second powers and either identity or exponential activation functions are applied. The complete strain energy function in terms of the internal and external weights w_{i} and w_{i}^{*} takes the following form, \begin{array}[]{l@{\hspace*{.10cm}}c@{\hspace*{.10cm}}l@{\hspace*{.04cm}} l@{\hspace*{.04cm}}l@{\hspace*{.04cm}}l@{\hspace*{.00cm}} l@{\hspace*{.04cm}}l@{\hspace*{.04cm}}l@{\hspace*{.04cm}} l@{\hspace*{.04cm}}l@{\hspace*{.00cm}}l}\psi\hfil\hskip 2.84544pt&=\hfil\hskip 2.84544pt&w_{1}\hfil\hskip 1.13791pt&w_{1}^{*}\hfil\hskip 1.13791pt&[I_{1}\hfil\hskip 1.13791pt&-3]\hfil\hskip 0.0pt&+\hfil\hskip 1.13791pt&w_{2}\hfil\hskip 1.13791pt&[\,\exp(w_{2}^{*}\hfil\hskip 1.13791pt&[I_{1}\hfil\hskip 1.13791pt&-3]\hfil\hskip 0.0pt&)-1]\\ \hfil\hskip 2.84544pt&+\hfil\hskip 2.84544pt&w_{3}\hfil\hskip 1.13791pt&w_{3}^{*}\hfil\hskip 1.13791pt&[I_{1}\hfil\hskip 1.13791pt&-3]^{2}\hfil\hskip 0.0pt&+\hfil\hskip 1.13791pt&w_{4}\hfil\hskip 1.13791pt&[\,\exp(w_{4}^{*}\hfil\hskip 1.13791pt&[I_{1}\hfil\hskip 1.13791pt&-3]^{2}\hfil\hskip 0.0pt&)-1]\\ \hfil\hskip 2.84544pt&+\hfil\hskip 2.84544pt&w_{5}\hfil\hskip 1.13791pt&w_{5}^{*}\hfil\hskip 1.13791pt&[I_{2}\hfil\hskip 1.13791pt&-3]\hfil\hskip 0.0pt&+\hfil\hskip 1.13791pt&w_{6}\hfil\hskip 1.13791pt&[\,\exp(w_{6}^{*}\hfil\hskip 1.13791pt&[I_{2}\hfil\hskip 1.13791pt&-3]\hfil\hskip 0.0pt&)-1]\\ \hfil\hskip 2.84544pt&+\hfil\hskip 2.84544pt&w_{7}\hfil\hskip 1.13791pt&w_{7}^{*}\hfil\hskip 1.13791pt&[I_{2}\hfil\hskip 1.13791pt&-3]^{2}\hfil\hskip 0.0pt&+\hfil\hskip 1.13791pt&w_{8}\hfil\hskip 1.13791pt&[\,\exp(w_{8}^{*}\hfil\hskip 1.13791pt&[I_{2}\hfil\hskip 1.13791pt&-3]^{2}\hfil\hskip 0.0pt&)-1]\\ \hfil\hskip 2.84544pt&-\hfil\hskip 2.84544pt&w_{9}\hfil\hskip 1.13791pt&w_{9}^{*}\hfil\hskip 1.13791pt&[I_{4w}\hfil\hskip 1.13791pt&-1]\hfil\hskip 0.0pt&+\hfil\hskip 1.13791pt&w_{9}\hfil\hskip 1.13791pt&[\,\exp(w_{9}^{*}\hfil\hskip 1.13791pt&[I_{4w}\hfil\hskip 1.13791pt&-1]\hfil\hskip 0.0pt&)-1]\\ \hfil\hskip 2.84544pt&+\hfil\hskip 2.84544pt&w_{10}\hfil\hskip 1.13791pt&w_{10}^{*}\hfil\hskip 1.13791pt&[I_{4w}\hfil\hskip 1.13791pt&-1]^{2}\hfil\hskip 0.0pt&+\hfil\hskip 1.13791pt&w_{11}\hfil\hskip 1.13791pt&[\,\exp(w_{11}^{*}\hfil\hskip 1.13791pt&[I_{4w}\hfil\hskip 1.13791pt&-1]^{2}\hfil\hskip 0.0pt&)-1]\\ \hfil\hskip 2.84544pt&-\hfil\hskip 2.84544pt&w_{12}\hfil\hskip 1.13791pt&w_{12}^{*}\hfil\hskip 1.13791pt&[I_{4s}\hfil\hskip 1.13791pt&-1]\hfil\hskip 0.0pt&+\hfil\hskip 1.13791pt&w_{12}\hfil\hskip 1.13791pt&[\,\exp(w_{12}^{*}\hfil\hskip 1.13791pt&[I_{4s}\hfil\hskip 1.13791pt&-1]\hfil\hskip 0.0pt&)-1]\\ \hfil\hskip 2.84544pt&+\hfil\hskip 2.84544pt&w_{13}\hfil\hskip 1.13791pt&w_{13}^{*}\hfil\hskip 1.13791pt&[I_{4s}\hfil\hskip 1.13791pt&-1]^{2}\hfil\hskip 0.0pt&+\hfil\hskip 1.13791pt&w_{14}\hfil\hskip 1.13791pt&[\,\exp(w_{14}^{*}\hfil\hskip 1.13791pt&[I_{4s}\hfil\hskip 1.13791pt&-1]^{2}\hfil\hskip 0.0pt&)-1]\,.\end{array} By using the chain rule, we can obtain an analytical expression for the Piola stress, \bm{P}=\partial\psi(\bm{F})/\partial\bm{F} , in terms of the deformation gradient \bm{F} and the weights w_{i} and w_{i}^{*} . In a perfectly homogeneous and shear-free biaxial extension test the deformation gradient \bm{F}={\rm{diag}}\,\{\,\lambda_{1},\lambda_{2},(\lambda_{1}\lambda_{2})^{-1}\,\} and the Piola stress \bm{P}={\rm{diag}}\,\{\,P_{11},P_{22},0\,\} , remain diagonal, where \lambda_{1} and \lambda_{2} are the biaxial stretches. The only non-zero stress components are the two normal stresses P_{11} and P_{22} in the two loading directions, P_{11}\!=\!\mbox{$\sum_{i=1}^{N}$}w_{i}f_{i}(\bm{F};w_{i}^{*})-p\;\mbox{and}\;P_{22}\!=\!\mbox{$\sum_{i=1}^{N}$}g_{i}(\bm{F};w_{i}^{*})-p, where p=2(\lambda_{1}\lambda_{2})^{-2}\,\partial\psi/\partial I_{1}+2(\lambda_{1}^{-2}+\lambda_{2}^{-2})\,\partial\psi/\partial I_{2} is the pressure term to satisfy the incompressibility condition, N=14 is the number of network terms, and f_{i}\,(\bm{F};w_{i}^{*})=\frac{1}{w_{i}}\,\frac{\partial\psi_{i}}{\partial F_{11}}\quad\mbox{and}\quad g_{i}\,(\bm{F};w_{i}^{*})=\frac{1}{w_{i}}\,\frac{\partial\psi_{i}}{\partial F_{22}} are functions of only F_{11} or F_{22} and of the internal weights w_{i}^{*} . To train a constitutive neural network, we typically use a numerical optimizer to find the weights w_{i} and w_{i}^{*} that minimize the loss function. A typical loss function is the mean squared error between the model predicted stress