Exact identifiability analysis for a class of partially observed near-linear stochastic differential equation models
Alexander P Browning, Michael J Chappell, Hamid Rahkooy, Torkel E Loman, Ruth E Baker · 2025
Read Exact identifiability analysis for a class of partially observed near-linear stochastic differential equation models by Alexander P Browning, Michael J Chappell, Hamid Rahkooy, Torkel E Loman, Ruth E Baker (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-19241.txt.
Introduction
Alexander Browning and co-authors build the first general tools for checking whether a stochastic model's parameters can in principle be pinned down from data. Randomness rules many biological systems, and fitting a random model is pointless if its parameters are not identifiable. Theory for plain, non-random models is mature; for stochastic ones it barely exists. Their 2025 paper fills part of that gap.
The trick is to track the system's statistical moments, which follow a plain recurrence rule. From observed moments alone, the team build equations step by step until identifiable parameter mixes fall out. Tests cover linear and near-linear models in two and many dimensions. Starting values can change the answer, they show, and they map where their method applies.
Catalog record
| CREATOR | Alexander P Browning, Michael J Chappell, Hamid Rahkooy, Torkel E Loman, Ruth E Baker |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-19241
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Exact identifiability analysis for a class of partially observed near-linear stochastic differential equation models Alexander P Browning, Michael J Chappell, Hamid Rahkooy, Torkel E Loman, Ruth E Baker Abstract Stochasticity plays a key role in many biological systems, necessitating the calibration of stochastic mathematical models to interpret associated data. For model parameters to be estimated reliably, it is typically the case that they must be structurally identifiable. Yet, while theory underlying structural identifiability analysis for deterministic differential equation models is highly developed, there are currently no tools for the general assessment of stochastic models. In this work, we present a differential algebra-based framework for the structural identifiability analysis of linear and a class of near-linear partially observed stochastic differential equation (SDE) models. Our framework is based on a deterministic recurrence relation that describes the dynamics of the statistical moments of the system of SDEs. From this relation, we iteratively form a series of necessarily satisfied equations involving only the observed moments, from which we are able to establish structurally identifiable parameter combinations. We demonstrate our framework for a suite of linear (two- and n n -dimensional) and non-linear (two-dimensional) models. Most importantly, we define the notion of structural identifiability for SDE models and establish the effect of the initial condition on identifiability. We conclude with a discussion on the applicability and limitations of our approach, and potential future research directions in this understudied area. 1 1 footnotetext: Corresponding author: [email protected] 1 Introduction Many biological systems are either intrinsically noisy [ 1 , 2 , 3 ] or subject to noisy external forces [ 4 , 5 , 6 , 7 , 8 ] , motivating the application of stochastic mathematical models to interpret any associated data [ 9 , 10 ] . In particular, information about the temporal dynamics of systems observed at statistical equilibrium is often not accessible through deterministic models, but rather encoded in higher-order statistics such as the autocovariance of temporally resolved observations [ 11 , 12 ] . Even within non-equilibrium systems, stochastic models may be able to extract more information about model parameters than their deterministic counterparts [ 13 , 14 , 15 ] . Tools that enable the calibration of stochastic models—and even those that allow for model discovery [ 16 ] —are now widely available [ 17 , 18 , 19 , 20 ] . For stochastic differential equation (SDE) models, methods fall into two general categories: approximate methods, which include among others the linear noise approximation [ 21 ] , the finite state projection [ 22 ] , and approximate Bayesian computation [ 23 ] ; and exact methods [ 24 ] , typically based on a particle filter approach to the exact likelihood [ 25 , 26 , 27 ] . While many of these methods allow for uncertainty quantification—through either a posterior distribution or parameter confidence intervals [ 27 ] —fundamental theoretical questions relating to whether model parameters are identifiable remain unanswered. Specifically, for a parameter to be practically identifiable from a given set of experimental data it should first and necessarily be structurally identifiable : a mathematical property of the model which establishes whether the map from model parameters to model outputs (typically a subset or linear combination of model states that are observed) is injective [ 28 , 29 ] . This question of structural identifiability amounts to asking whether a parameter can be estimated in the limit of infinite, noise-free, data. Theory underlying the structural identifiability of ordinary differential equation (ODE) systems is now highly developed [ 30 ] . Methods developed out of differential algebra (DA) [ 31 , 32 ] involve the algorithmic formulation of a set of input-output equations , a set of necessarily satisfied polynomial equations that depend solely on model parameters, observed system states, and derivatives thereof [ 33 , 34 , 35 ] . These input-output equations provide a map from the parameters (the inputs) to the the set of observations (the outputs). These relations are also analogous to representing a system of first-order ODEs as a system of higher-order ODEs involving only a subset of state variables: in the case of identifiability, involving only state variables that are observed. Necessarily, these equations always involve higher order derivatives, complicating direct extension to stochastic systems that are not differentiable. By ensuring that these polynomials are in some sense monic and hence unique, and if linear independence of the monomial terms can be shown or guaranteed, structurally identifiable parameter combinations can be read off as the set of parameter-dependent coefficients [ 35 ] . Our more recent work [ 36 ] , among others [ 35 , 37 , 38 ] , extends the DA approach to a class of near-linear partial differential equation systems, for which the same methodology broadly applies. Systems of SDEs, on the other hand, cannot be studied in the same way. We partially address this in our previous work [ 14 ] by studying identifiability through an ODE system that describes the time-evolution of the statistical moments of the system of SDEs. This approach is both exact and exhaustive for linear systems of SDEs. For non-linear systems, which are not characterised by a finite number of statistical moments, we resorted to studying an approximate system by applying a series of moment closure approximations. While we demonstrate that the approximate approach can provide useful insight, it remains unclear how well structural identifiability results for the approximate system translate to the exact system. Also ambiguous are the observation regimes and initial conditions under which results from study of the statistical moments apply to individual trajectories. In this work, we present a DA-based framework for an exact structural identifiability analysis of partially observed linear as well as a class of non-linear systems of SDEs. We first, in Section 2 , provide a formal definition of structural identifiability for both deterministic—for which we present a brief didactic example—and, for the first time, stochastic models. Specifically, we define what it means for a stochastic model to be structurally identifiable given a hypothetical joint distribution of model outputs across arbitrary sets of time points (i.e., from observations of sample paths). Given the ubiquity of linear systems throughout both biology and engineering, we begin with a complete analysis of structural identifiability in a general two-dimensional linear Gaussian (i.e., Ornstein-Uhlenbeck) system ( Section 3.1 ). This system is unique in that it possesses an analytical solution, and in that the behaviour is completely characterised by the dynamics of the first two statistical moments. In the case of discrete-time observations, structural non-identifiability could be detected locally through the Fisher information matrix [ 39 , 40 ] . The tractability of this simple system allows us to demonstrate how results constructed through the moment approach [ 14 ] relate to observations of the SDE at statistical equilibrium: the set of observed quantities correspond to an initial condition where the unobserved states are constrained statistically to the stationary distribution conditional to the observed states. We then extend this analysis to provide a non-exhaustive set of structurally identifiable parameter combinations in a partially observed n -dimensional linear Gaussian (i.e., Ornstein-Uhlenbeck) system ( Section 3.2 ). The final linear system we