Accelerated inference for stochastic compartmental models with over-dispersed partial observations
Michael Whitehouse · 2025
Read Accelerated inference for stochastic compartmental models with over-dispersed partial observations by Michael Whitehouse (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-06935.txt.
Introduction
Disease modelers track how an outbreak moves through compartments like susceptible and infected, but they often see only part of the picture. Michael Whitehouse, writing alone in a 2025 paper, speeds up the math for such models. His method handles reports that swing more than chance alone would explain.
The trick treats the chance of a case being reported as a hidden variable and folds it into an approximate likelihood. In large populations, the filter recovers the true hidden states almost exactly. Simulations found honest estimates with order-of-magnitude speed gains over particle methods. He also packages the method in the Stan language and applies it to COVID-19 data from Switzerland.
Catalog record
| CREATOR | Michael Whitehouse |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-06935
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Accelerated inference for stochastic compartmental models with over-dispersed partial observations Michael Whitehouse Abstract An assumed density approximate likelihood is derived for a class of partially observed stochastic compartmental models which permit observational over-dispersion. This is achieved by treating time-varying reporting probabilities as latent variables and integrating them out using Laplace approximations within Poisson Approximate Likelihoods (LawPAL), resulting in a fast deterministic approximation to the marginal likelihood and filtering distributions. We derive an asymptotically exact filtering result in the large population regime, demonstrating the approximation’s ability to recover latent disease states and reporting probabilities. Through simulations we: 1) demonstrate favorable behavior of the maximum approximate likelihood estimator in the large population and time horizon regime in terms of ground truth recovery; 2) demonstrate order of magnitude computational speed gains over a sequential Monte Carlo likelihood based approach and explore the statistical compromises our approximation implicitly makes. We conclude by embedding our methodology within the probabilistic programming language Stan for automated Bayesian inference to develop a model of practical interest using data from the Covid-19 outbreak in Switzerland. Keywords: Stochastic Compartmental models, Over-dispersion, Approximate Inference, Epidemiology. 1 Introduction Compartmental models, initially developed in the seminal works of Mckendrick 1925 ; Kermack and McKendrick 1927 , capture disease outbreak dynamics by dividing a population into distinct disease states we call ‘compartments’. One then defines a transmission model which describes the rate at which individuals transition between compartments through time - in turn, this implicitly characterizes the progression of the disease through the population. In practice this process is noisily observed through testing data, usually cast as random under-reporting of either incidence ( newly infected individuals) or prevalence ( currently infected individuals) counts. Such models can be cast in myriad ways, deterministic, stochastic, continuous, or discrete time, finite population counts, or continuous proportions. The link between the Markov jump process formulation and its corresponding large population limiting deterministic ODE system was formalized by Kurtz 1970 . When coupled with a noisy observation model, likelihoods for ODE transmission models are relatively easy to compute using an ODE solver. This has motivated widespread adoption of the ODE approach in practice. Such an approach, however, ignores the inherent stochasticity governing disease transmission ( King et al. 2015 ) . A complication introduced when using a stochastic transmission model is the need to marginalize over the latent transmission process, which subsequently renders the likelihood intractable. Many simulation based solutions to this issue have been proposed in the literature, approaches include: sequential Monte Carlo (SMC) ( Corbella et al. 2022 ; Koepke et al. 2016 ; Wheeler et al. 2024 ) , Approximate Bayesian Computation ( McKinley et al. 2009 ; Kypraios et al. 2017 ) , Data Augmentation MCMC ( Fintzi et al. 2017 ; Lekone and Finkenstädt 2006 ; Nguyen-Van-Yen et al. 2021 ) . In principle these methods only require the ability to simulate from the model, through in practice they rely on intricate tuning, vast computational power for many repeated simulations, and the construction of sophisticated proposal distributions or summary statistics ( Rimella et al. 2022 ; Prangle 2018 ) . One deterministic approach is the linear noise approximation (LNA) ( Golightly et al. 2023 ) which consists of Gaussian approximations derived from the functional central limit theorem associated with Kurtz 1970 . The recently developed suite of assumed density approximate likelihoods (ADAL) ( Whiteley and Rimella 2021 ; Whitehouse et al. 2023 ; Rimella et al. 2025 ) compose a family of computationally efficient methods for inference in discrete time stochastic compartmental models which exhibit favorable theoretical properties. ADALs are obtained by marginalizing over the latent compartmental model through a combination of recursive expectation propagation ( Minka 2001 ) and assumed density ( Sorenson and Stubberud 1968 ) steps to arrive at deterministic approximations to filtering distributions and the marginal likelihood. In their vanilla form they can be used to fit models with Binomial under-reporting ( Whiteley and Rimella 2021 ) , this is an equi-dispersed observation model in the sense that the variance of a binomial random variable is strictly of the same order as its mean. Such assumptions can lead to problematic inference when confronted with data exhibiting over-dispersion, i.e. an under-reporting distribution with variance significantly larger than its mean, as explored in Section 5.3 and noted in previous studies ( Whitehouse et al. 2023 ; Stocks et al. 2020 ) . The use of ADALs can be extended to over-dispersed observation mechanisms by treating reporting probabilities as time varying random variables, see Section 2.3 for details, and integrating them out by embedding ADALs in an SMC sampler, incurring significant computational cost ( Whitehouse et al. 2023 ) . In this paper we extend the remit of ADALs to models permitting observational over-dispersion without resorting to sampling methods. This is achieved by recursively using Laplace approximations to integrate out the latent reporting rates, resulting in a novel deterministic and computationally simple marginal likelihood approximation. We introduce the class of latent compartmental models considered by this paper in Section 2 . We derive and present an algorithm to compute our approximate filtering distributions and likelihood in Section 3 . In Section 4 we present a result on the asymptotic behavior of our filtering approximations in the large population limit. Through simulations in Section 5 we explore properties of the maximum approximate likelihood estimator in terms of ground truth recovery and benchmark our approximation against an SMC approach. To conclude we perform a comparison of observation mechanisms by embedding our methodology within a probabilistic programming language (PPL) to facilitate automated Bayesian inference. 2 Model 2.1 Notation The set of natural numbers, including 0 , is denoted \mathbb{N}_{0} . The set of non-negative real numbers is denoted \mathbb{R}_{\geq 0} . For an integer m\geq 1 , [m]\coloneqq\{1,\ldots,m\} . Matrices and vectors are denoted by bold upper-case and bold lower-case letters, respectively, e.g., \mathbf{A} and \mathbf{b} , with non-bold upper-case and lower case used for their respective elements A^{(i,j)} , b^{(i)} . All vectors are column vectors unless stated otherwise. We use \mathbf{1}_{m} to denote the vector of m 1 ’s. The indicator function is denoted \mathbb{I}[\cdot] . For \mathbf{x}\in\mathbb{N}_{0}^{m} we define \boldsymbol{\eta}(\mathbf{x})=[x^{(1)}/\mathbf{1}_{m}^{\top}\mathbf{x}\,\cdots\,x^{(m)}/\mathbf{1}_{m}^{\top}\mathbf{x}]^{\top} if \mathbf{1}_{m}^{\top}\mathbf{x}>0 , i.e. \boldsymbol{\eta}(\mathbf{x}) normalizes \mathbf{x} to yield a probability vector; and \boldsymbol{\eta}(\mathbf{x})=\boldsymbol{0}_{m} if \mathbf{1}_{m}^{\top}\mathbf{x}=0 . For \mathbf{x}\in\mathbb{N}_{0}^{m} and \boldsymbol{\lambda}\in\mathbb{R}_{\geq 0}^{m} we write \mathbf{x}\sim\mathrm{Pois}(\boldsymbol{\lambda}) to denote that the elements of \mathbf{x} are independent and element x^{(i)} is Poisson distributed with parameter \lambda^{(i)} . We shall say that such a random vector \mathbf{x} has a “vector-Poisson distribution”. For a probability vector \boldsymbol{\pi} we write \mathrm{Mult}(n,\boldsymbol{\pi}) for the associated multinomial distribution. Similarly, for a random matrix \mathbf{X}\in\mathbb{N}_{0}^{m\times l} and a matrix \boldsymbol{\Lambda}\in\mathbb{R}_{\geq 0}^{m\times l} , we write \mathbf{X}\sim\mathrm{Pois}(\boldsymbol{\Lambda}) when the elements of \mathbf{X} are independent with X^{(i,j)} being Poisson distributed with parameter \Lambda^{(i,j)} . We call \boldsymbol{\lambda} (resp. \boldsymbol{\Lambda} ) the intensity vector (resp. matrix). For a,b,\mu\in\mathbb{R} , a<b and \sigma^{2}>0 we write \mathcal{N}_{[a,b]}(\mu,\sigma^{2}) to denote a normal random variable with mean and variance parameters \mu and \sigma^{2} which is restricted to the support [a,b] . 2.2 Latent compartmental model The transmission model we consider for the remainder of the paper is defined by: m , the number of compartments; n the initial population