Bayesian inference for ordinary differential equations models with heteroscedastic measurement error
Selva Salimi, David J. Warne, Christopher Drovandi · 2026
Read Bayesian inference for ordinary differential equations models with heteroscedastic measurement error by Selva Salimi, David J. Warne, Christopher Drovandi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-21549.txt.
Introduction
Salimi and co-authors fix a weak spot in Bayesian fitting of ordinary differential equation models: measurement error whose size changes over time. Standard practice assumes constant error variance, which can badly skew parameter estimates when the real error varies. Their two-step framework first fits a heteroscedastic Gaussian process to estimate the time-varying error. Bayesian inference then uses that error curve inside the likelihood. In simulations and two real applications, the approach gave more reliable estimates and predictive uncertainty than constant-error models.
Catalog record
| CREATOR | Selva Salimi, David J. Warne, Christopher Drovandi |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54743 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.21549
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Bayesian inference for ordinary differential equations models with heteroscedastic measurement error Selva Salimi, David J. Warne, Christopher Drovandi Abstract Ordinary differential equation (ODE) models are widely used to describe systems in many areas of science, including biology, ecology, and epidemiology. To ensure these models provide accurate and interpretable representations of real-world dynamics, it is often necessary to infer parameters from data, which involves specifying the form of the ODE system as well as a statistical model describing the observational process. A popular and convenient choice for the error model is a Gaussian distribution with constant variance (homoscedastic). However, the choice may not be realistic in many systems, since the variance of the observational error may vary over time or have some dependence on the system state (heteroscedastic), reflecting changes in measurement conditions, environmental fluctuations, or intrinsic system variability. Misspecification of the error model can lead to substantial inaccuracies of the posterior estimates of the ODE model parameters and predictions. More elaborate parametric error models could be specified, but this would increase computational cost because additional parameters would need to be estimated within the MCMC procedure and may still be misspecified. In this work we propose a two-step semi-parametric framework for Bayesian parameter estimation of ODE model parameters when there exists heteroscedasticity in the error process. The first step applies a heteroscedastic Gaussian process to estimate the time-dependent error, and the second step performs Bayesian inference for the ODE model parameters using the estimated time-dependent error estimated from step one in the likelihood function. Through a simulation study and two real-world applications, we demonstrate that the proposed approach yields more reliable posterior inference and predictive uncertainty compared to the standard homoscedastic models. Although our focus is on heteroscedasticity, the framework could be applied to handle more complex error processes. Keywords: Time-varying error, Dynamical system modeling, Uncertainty quantification, Semi-parametric inference, Parameter estimation, Markov chain Monte Carlo 1 Introduction Ordinary differential equation (ODE) models are widely applied across scientific disciplines, providing mechanistic descriptions of dynamical systems. Examples include the spread of infectious diseases in populations and cellular dynamics in biological systems ( 1 ; 4 ; 15 ) , interactions in ecological systems ( 29 ; 28 ) , supply-demand dynamics in economic systems ( 32 ) , physics ( 21 ) and classical physical processes such as Newton’s law of cooling ( 6 ) . In each case, the dynamics of the system is determined by its current state together with a set of parameters that describe key features of the process, including rates, carrying capacities, and initial conditions. These parameters are rarely known a priori, and are often not directly measurable, necessitating their estimation from observational data. Reliable parameter estimation is therefore essential for accurate prediction and understanding underlying processes. A general ODE model can be written as \frac{\textrm{d}y}{\textrm{d}t}=h(y,t;\theta)\quad\textrm{for }t>t_{0},\qquad y(t_{0})=y_{0}, (1) where y(t)\in\mathbb{R}^{n} denotes the system state at time t\geq t_{0} , \theta\in\mathbb{R}^{m} is a vector of unknown parameters, h:\mathbb{R}^{n}\times\mathbb{R}^{+}\times\mathbb{R}^{m}\to\mathbb{R}^{n} is a function that defines dynamics of the system, that is the functional dependence of the rate of change on the state, y , time, t , and parameters, \theta , and y_{0} is the initial condition. The observed data are denoted by \{\tilde{y}(t_{i})\}_{i=1}^{N} , where N is the number of observations, t_{i} is the time of the i -th observation, and \tilde{y}(t_{i})\in\mathbb{R}^{d} . Observations are typically linked to the latent state via \tilde{y}(t_{i})=g(y(t_{i}))+\epsilon(t_{i}), (2) where g:\mathbb{R}^{n}\to\mathbb{R}^{d} maps the ODE solution to the same space on which data are observed. Here, d\leq n indicates that the observations may represent fewer dimensions than the system state, and in some cases, none of the state variables may be directly observed. Further, \epsilon(t_{i})\in\mathbb{R}^{d} represents additive measurement error. A standard assumption is that the errors are independent and identically distributed (i.i.d.) according to a Gaussian distribution ( 1 ; 17 ) , \epsilon(t_{i})\overset{\text{iid}}{\sim}\mathcal{N}(0,\sigma^{2}\mathbb{I}), where \mathbb{I} denotes the d\times d identity matrix. In much of the existing literature, this i.i.d. Gaussian assumption is often adopted for analytical and computational convenience. However, real-world measurements may depart from satisfying such simplicity; errors can be heteroscedastic ( 29 ) , non-Gaussian ( 18 ) , or autocorrelated ( 14 ) , due to environmental variability or finite resolution of measuring instruments. Ignoring these complexities can lead to biased parameter estimates and inaccurate uncertainty quantification ( 13 ; 30 ) . Recent work has begun to relax these simplifying assumptions. Non-Gaussian observation models have been explored using generalized linear frameworks ( 18 ) , while temporal dependence has been incorporated via parametric autocorrelation structures in Bayesian ODE models ( 14 ) . Although these approaches extend classical formulations, they typically rely on fully specified parametric error models and impose structural assumptions on the error process. Heteroscedasticity has also emerged as an important practical feature. For example, Warne et al. ( 29 ) consider observation error arising from the monitoring process, highlighting the importance of modeling assumptions and computational complexity in uncertainty quantification. These findings suggest that heteroscedastic error is not a minor complication but a structurally important feature of time-series, motivating a dedicated focus on heteroscedasticity in our framework. Heteroscedasticity can arise in multiple contexts. For example, model misspecification such as omitting relevant variables, assuming an incorrect functional form, or mischaracterizing the deterministic or stochastic nature of the system, can produce residuals whose variance depends on the state of the system ( 19 ) . Similarly, measurement errors can introduce heteroscedasticity, unusually small or large observations can influence the residuals more strongly than typical observations ( 19 ) . Our work develops a framework to address the impact of incorrect measurement error assumptions on parameter estimation and predictive uncertainty in ODE models. Figure 1 illustrates the practical implications of heteroscedasticity. Figure 1 a shows the scenario with relatively few observations. Posterior distributions obtained under the true model, an incorrect homoscedastic model that assumes constant variance, and our proposed approach (introduced in Section 3 ) are largely similar. In this sparse data setting, limited information masks the underlying variability in the error process, making the simplifying constant-variance assumption appear adequate. By contrast, in Figure 1 b, increased observation density exposes the limitations of the homoscedastic assumption. The posterior obtained under constant variance is excessively tight, reflecting overconfident parameter estimates. The true model captures the increasing variability over time, while our approach produces posterior distributions that closely align with the true model and more accurately reflect the variability in the data. Figure 1 : (a) Sparse observations: With few data points, the posterior distributions under homoscedastic and heteroscedastic error assumptions are similar, as limited data provides little information to detect time-varying variance. (b) Dense observations: With more data points, heteroscedastic models capture time-varying error, revealing that homoscedastic assumptions can lead to overconfident or underconfident parameter estimates, particularly in regions of high or low measurement variability. Heteroscedastic models therefore provide more accurate uncertainty quantification across the input space Motivated by these considerations, in this work, we develop a semi-parametric Bayesian inference framework for ODE models that accommodates heteroscedastic measurement error. Our two-step approach leverages heteroscedastic Gaussian processes (HetGP) ( 3 ) to learn the structure of the error process directly from data, separating the mechanistic dynamics from the stochastic variability. Importantly, this