MCMC Informed Neural Emulators for Uncertainty Quantification in Dynamical Systems

Heikki Haario, Zhi-Song Liu, Martin Simon, Hendrik Weichelcor1 · 2026

Read MCMC Informed Neural Emulators for Uncertainty Quantification in Dynamical Systems by Heikki Haario, Zhi-Song Liu, Martin Simon, Hendrik Weichelcor1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-10987.txt.

Introduction

Heikki Haario and coauthors decouple uncertainty quantification from neural network design. They feed the distribution of model parameters into training through Markov chain Monte Carlo, not by sampling network weights. Blind sampling of parameters can waste long training runs on unphysical values. Their approach lets a cheap surrogate match the physical model's uncertainty at far lower cost. They show a quantile emulator and an autoencoder-based network that gives whole trajectory paths for other parameter values. Analysis ties performance loss to distribution mismatch.

Catalog record

CREATORHeikki Haario, Zhi-Song Liu, Martin Simon, Hendrik Weichelcor1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE84523
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.10987

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MCMC Informed Neural Emulators for Uncertainty Quantification in Dynamical Systems Heikki Haario, Zhi-Song Liu, Martin Simon, Hendrik Weichelcor1 Abstract Neural networks are a commonly used approach to replace physical models with computationally cheap surrogates. Parametric uncertainty quantification can be included in training, assuming that an accurate prior distribution of the model parameters is available. Here we study the common opposite situation, where direct screening or random sampling of model parameters leads to exhaustive training times and evaluations at unphysical parameter values. Our solution is to decouple uncertainty quantification from network architecture. Instead of sampling network weights, we introduce the model-parameter distribution as an input to network training via Markov chain Monte Carlo (MCMC). In this way, the surrogate achieves the same uncertainty quantification as the underlying physical model, but with substantially reduced computation time. The approach is fully agnostic with respect to the neural network choice. In our examples, we present a quantile emulator for prediction and a novel autoencoder-based ODE network emulator that can flexibly estimate different trajectory paths corresponding to different ODE model parameters. Moreover, we present a mathematical analysis that provides a transparent way to relate potential performance loss to measurable distribution mismatch. keywords Neural Emulators ,MCMC ,AutoEncoders ,Uncertainty Quantification ,Neural ODE ,Attention Mechanism † † corresponding: Corresponding author 1 Introduction Neural networks are increasingly used as emulators, i.e., surrogates for computationally intensive simulation models in physics and chemistry. Beyond accelerating simulations, they can also incorporate complex features that are difficult to encode in traditional solvers. A prominent example is Physics-Informed Neural Networks (PINNs), which embed physical laws into the training objective and can serve as fast surrogates using precomputed data 33 ; 42 ; 18 ; 2 . PINNs have been applied to forward and inverse problems in chemical kinetics 15 ; 1 ; 46 ; 6 , physics 19 ; 26 ; 23 , and finance 12 ; 8 ; 16 ; 30 . Despite these successes, integrating principled uncertainty quantification (UQ) into neural emulators remains challenging. A standard approach to UQ is via Bayesian Neural Networks (BNNs) 29 ; 27 , which treat network weights as random variables and approximate posterior uncertainty using methods such as MCMC, variational inference, or Monte Carlo dropout. While powerful, BNNs can be difficult to scale: the weight space is high-dimensional, selecting informative priors is non-trivial, and approximate posteriors may yield miscalibrated uncertainty, especially in regimes with limited data or model misspecification. In this work, we propose an alternative, modular approach to Bayesian UQ for neural emulation: the MCMC Informed Neural Emulator (MINE). The key idea is to decouple Bayesian inference from function approximation. We first perform posterior inference offline using MCMC on the original simulator (or any black-box/legacy model) to obtain samples from the parameter posterior p(\boldsymbol{\theta}\mid\boldsymbol{y}) . We then train deterministic neural surrogates on posterior-informed data, i.e., input–output pairs concentrated in regions of parameter space consistent with the observed data. This approach, related to recent work on training-distribution selection 10 , directly targets the quantity of interest in Bayesian prediction, without requiring Bayesian architectures at inference time. Concretely, we provide two complementary surrogate components: a quantile (interval) emulator and a forward emulator for operator learning. The two components serve different deployment needs: the quantile emulator provides immediate interval estimates which is particularly useful when deterministic, low-latency uncertainty summaries suffice, while the forward emulator enables fast posterior predictive sampling which is useful for downstream stochastic pipelines. This paradigm exploits a practical advantage of Bayesian posterior sampling: MCMC concentrates computation on plausible parameter regions instead of exhaustively covering the full parameter space. To illustrate the scale, consider a simulator with a runtime of one second and 20 parameters, each discretized into 10 values. A brute-force grid would require 10^{20} simulator evaluations, i.e., 10^{20} seconds, which is approximately 3\times 10^{12} years. In contrast, a posterior chain with 10^{5} simulator evaluations takes on the order of a day (about 28 hours at one second per evaluation). The MINE paradigm leverages such posterior samples to reduce the data-generation burden dramatically, while focusing learning on the statistically relevant regions. The MINE paradigm is conceptually distinct from embedding uncertainty directly into the neural network. Unlike BNNs, which attempt to represent uncertainty through probabilistic weight distributions and require posterior approximation in weight space, MINE externalizes uncertainty through Bayesian parameter inference performed offline. Where, e.g., Bayesian PINNs 44 place Bayesian inference inside the surrogate by treating network weights probabilistically and estimating their posterior, we instead run MCMC offline on the simulator’s physical parameters and then train deterministic emulators on posterior-informed data, thus avoiding weight-space sampling at inference time. This approach is complementary to surrogate-assisted inference methods such as using surrogates to accelerate MCMC (assuming that draws from a prior are possible): here, we assume posterior sampling can be performed offline, with minimal prior knowledge such as positivity constraints only, and then amortize Bayesian prediction through deterministic surrogates trained on posterior-informed data. The MINE paradigm can be understood independently from architectural families such as Neural Ordinary Differential Equations (Neural ODEs) 7 ; 28 ; 22 ; 45 ; 48 ; 21 , even though it may utilize these architectures in its realizations. Neural ODEs model continuous-time dynamics via neural-parameterized vector fields and have been used, for example, to emulate chemical reaction systems 39 ; 24 . However, standard Neural ODE formulations do not provide Bayesian UQ natively; Bayesian extensions (e.g., Bayesian Neural ODEs or neural SDE variants) incorporate uncertainty internally but typically require sampling at inference time and can introduce additional computational overhead. In contrast, the MINE framework achieves UQ through offline posterior sampling and trains deterministic emulators on posterior-informed data. The forward emulator realization may use a Neural ODE/neural operator backbone, but the UQ mechanism is architecture-agnostic and lives outside the network. Relative to PINNs, the MINE framework is generally equation-free in training and is particularly suitable when governing equations are unknown, non-differentiable, or when one must interface with black-box simulators. Nevertheless, physics-informed loss terms can be incorporated when available. Finally, compared to Statistics-Informed Neural Networks (SINNs) 17 ; 47 , which aim to reproduce full statistical properties of stochastic trajectories, the MINE paradigm targets Bayesian predictive uncertainty for quantities of interest via posterior-informed training data and produces deterministic outputs at inference time (either conditional on sampled \boldsymbol{\theta} for posterior draws, or directly as quantiles for intervals). A central modeling consideration is what uncertainty is represented . The MINE framework directly captures posterior/parameter uncertainty through p(\boldsymbol{\theta}\mid\boldsymbol{y}) and its propagation to predictions. In addition, any observation noise and stochasticity encoded in the likelihood p(\boldsymbol{y}\mid\boldsymbol{\theta}) can be reflected in the posterior predictive distribution. Like any surrogate approach, MINE also introduces emulator error ; throughout the paper we therefore evaluate both predictive accuracy and uncertainty calibration to assess how closely the emulators match the offline Bayesian reference. Contributions. The main contributions of this work are: 1. We formalize the MCMC Informed Neural Emulator (MINE) paradigm, which decouples Bayesian posterior inference (via MCMC on a simulator) from deterministic function approximation (via neural networks trained on posterior-informed data). We provide a Wasserstein-based stability analysis showing that the deployment risk of any Lipschitz-bounded emulator is controlled by its training risk plus an explicit penalty proportional to the distribution relative to the deployment

Read the complete text