A cautionary tale of model misspecification and identifiability

Alexander P Browning, Jennifer A Flegg, Ryan J Murphy · 2025

Read A cautionary tale of model misspecification and identifiability by Alexander P Browning, Jennifer A Flegg, Ryan J Murphy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-04894.txt.

Introduction

Alexander Browning, Jennifer Flegg, and Ryan Murphy offered in 2025 a cautionary perspective on simplifying biological models to make their parameters identifiable. A simpler model can seem to give sharper estimates, yet the simplification may warp the model so badly that the estimates turn poor. Their focus is mathematical biology, where data are scarce and models are complex.

They show how doubt about model structure can be carried through to doubt about parameters, using a semi-parametric Gaussian process method. Two cases are worked: logistic growth with an unknown crowding function, and a spatial process with time-varying spread. Allowing for structural doubt gave sturdier, more accurate estimates and a better account of what remains unknown.

Catalog record

CREATORAlexander P Browning, Jennifer A Flegg, Ryan J Murphy
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-04894

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A cautionary tale of model misspecification and identifiability Alexander P Browning, Jennifer A Flegg, Ryan J Murphy Abstract Mathematical models are routinely applied to interpret biological data, with common goals that include both prediction and parameter estimation. A challenge in mathematical biology, in particular, is that models are often complex and non-identifiable, while data are limited. Rectifying identifiability through simplification can seemingly yield more precise parameter estimates, albeit, as we explore in this perspective, at the potentially catastrophic cost of introducing model misspecification and poor accuracy. We demonstrate how uncertainty in model structure can be propagated through to uncertainty in parameter estimates using a semi-parametric Gaussian process approach that delineates parameters of interest from uncertainty in model terms. Specifically, we study generalised logistic growth with an unknown crowding function, and a spatially resolved process described by a partial differential equation with a time-dependent diffusivity parameter. Allowing for structural model uncertainty yields more robust and accurate parameter estimates, and a better quantification of remaining uncertainty. We conclude our perspective by discussing the connections between identifiability and model misspecification, and alternative approaches to dealing with model misspecification in mathematical biology. 1 1 footnotetext: Corresponding authors: [email protected] and [email protected]. Keywords: misspecification, identifiability, Gaussian processes, logistic growth, inference 1 Introduction Mathematical models are now routine in the interpretation of biological data. Model parameters, estimated through calibration, provide a quantitative characterisation of behaviour that cannot be directly measured [ 1 , 2 ] : for example, per-capita growth or movement rates in the presence of crowding from population-level data [ 3 , 4 ] . Comparison of parameter estimates between experimental conditions, therapeutic treatments, or species allows practitioners to statistically quantify physiological change. Moreover, the resulting calibrated models can be used for prediction, to validate model assumptions, and in experimental design [ 5 , 6 ] . In the context of experimental data, it is often assumed requisite that models be identifiable and that parameter estimates can be precisely determined. Both structural and practical identifiability analysis are now widely accepted, rightly, as a part of the model development and eventual model calibration workflow. Resolution of non-identifiability, however, remains a challenge. Typical suggestions in the literature are model reduction, reparameterisation, or simplification [ 7 ] ; to increase the quantity or quality of data [ 8 ] ; or to modify the type of measurements that can be observed (for example, to additionally observe spatial information or previously unobserved species) [ 9 ] . A challenge in mathematical biology, however, is that available data are often collected before any analysis, or otherwise that experimental constraints limit the type of measurements that can be observed. Practitioners who wish to resolve identifiability issues are often, therefore, left with little choice but to resort to model simplification. While resolving identifiability and potentially improving the precision of parameter estimates, model simplification can exacerbate model misspecification [ 10 ] . To visualise the effect of model misspecification on parameter inference, consider a process characterised by the generalised logistic growth model for cell density u(t) \derivative{u}{t}=ruf\!\left(\dfrac{u}{K}\right),\qquad f(\hat{u})=\left(1-\hat{u}^{\beta}\right),\qquad u(0)=u_{0}, (1) where f(\hat{u}) is the crowding function and K is the carrying capacity. The specific form of f(\hat{u}) in Eq. 1 is commonly referred to as Richards model [ 11 ] . In our previous work [ 4 ] , we demonstrate that calibration of the full parameter set (r,K,\beta) to data can lead to issues with practical identifiability, manifesting as a strong dependence between the exponent parameter \beta and the low-density growth rate parameter r . It is, however, common practice to assume that density-dependent growth processes follow (at least approximately) the canonical logistic growth model, corresponding to Eq. 1 with fixed \beta=1 . Although not always the result of an identifiability analysis, the resulting simplified model yields improved parameter identifiability and estimate precision, however the introduced misspecification is potentially problematic for parameter estimation accuracy [ 12 ] . Figure 1: Unreliable parameter estimates drawn from an identifiable and misspecified model. Synthetic data generated from Richards model ( Eq. 1 with \beta=2 ) with a range of initial conditions u(0)=u_{0} is calibrated to the misspecified canonical logistic model ( Eq. 1 with \beta=1 ). (a) Synthetic data is produced at the true parameter set (r,K,u_{0},\sigma)=(1,$5\text{\times}{10}^{-3}\text{\,}\mathrm{,}$u_{0},10^{-4}) for various u_{0} (see legend) using Richards model subject to additive Gaussian noise with variance \sigma^{2} . The parameter set (r,K,u_{0},\sigma) is calibrated to the canonical logistic using a Bayesian inference scheme, with model fit at the maximum a posteriori estimate for each initial condition shown. (b) Due to model misspecification, the marginal posterior distributions for the low-density proliferation rate r depend strongly on the initial condition, yet the parameter is practically identifiable in all cases. To continue our demonstration, we consider data collected from a routinely performed cell proliferation assay , where cells are placed in a dish and allowed to grow to carrying capacity. This experiment is often performed to estimate the growth rate of a population of cells. Analogous data are routinely collected throughout biology and ecology [ 4 ] . In Fig. 1 a, we generate synthetic cell density data from Richards model with \beta=2 for a range of initial cell densities. We proceed to calibrate the identifiable logistic model (i.e., misspecified, with \beta=1 ) to the generated data using a standard Bayesian inference approach that we later describe. The resultant model fits are qualitatively excellent ( Fig. 1 a), with the parameter r being practically identifiable for all data sets ( Fig. 1 b). However, misspecification results in a strong dependence between estimates of r and the initial condition, u_{0} . Consequently, any statistical analysis between experiments initiated with different cell densities would incorrectly suggest a physiological difference between cell populations, despite the underlying behaviour being identical. Parameter estimates might be considered precise, but they are not accurate. Issues relating to misspecification can be detected from residual analysis [ 4 , 13 ] or, should a sufficient quantity of data be available, through model validation. Fundamentally, however, issues relating to misspecification can arise from the inability of a (potentially) simple and identifiable model to capture the true underlying dynamics [ 14 ] . Even relaxing assumptions on \beta and calibrating Richards model to cell growth data is potentially problematic: both in terms of the prior that must be placed on the purely phenomenological exponent \beta and the assumed parametric form for the crowding function. Significant effort in recent years has focused on relaxing assumptions related to the functional form of terms in differential equations [ 15 ] . Symbolic regression, a parametric approach, attempts to “learn” the functional form of an ordinary or partial differential equation using a library of potential terms, applying sparse regression to avoid overfitting [ 16 ] . Non-parametric approaches, meanwhile, include those that represent one or more terms using a Gaussian process or a neural network [ 17 , 18 , 19 , 20 , 21 , 22 ] . Recently introduced in the context of differential equation modelling in biology, Biological Informed Neural Networks (BINNs) [ 23 ] constrain neural networks through a biologically informed model structure; for example, a reaction-diffusion equation with density-dependent diffusivity and reaction rate. All the aforementioned approaches alleviate model misspecification; however, they

Read the complete text