A primer on inference and prediction with epidemic renewal models and sequential Monte Carlo

Nicholas Steyn, Kris V. Parag, Robin N. Thompson, Christl A. Donnelly · 2025

Read A primer on inference and prediction with epidemic renewal models and sequential Monte Carlo by Nicholas Steyn, Kris V. Parag, Robin N. Thompson, Christl A. Donnelly (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-18875.txt.

Introduction

Nicholas Steyn, Kris Parag, Robin Thompson, and Christl Donnelly write a practical guide to fitting epidemic models with particle filters in this 2025 paper. Renewal models are a workhorse of outbreak analysis: they rebuild each day's cases from past cases and a reproduction number. They can also project ahead, judge the effect of controls, and estimate the chance an outbreak dies out.

The guide shows how sequential Monte Carlo methods, also called particle filters, carry out the fitting. The authors aim at readers who know basic statistical inference and want working tools. They stress the method's flexibility in handling several biases at once. Along the way they show that known ways of estimating the reproduction number and making projections fall out of the same frame. A companion website holds code and extra worked examples that mirror the paper.

Catalog record

CREATORNicholas Steyn, Kris V. Parag, Robin N. Thompson, Christl A. Donnelly
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-18875

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A primer on inference and prediction with epidemic renewal models and sequential Monte Carlo Nicholas Steyn, Kris V. Parag, Robin N. Thompson, Christl A. Donnelly Abstract Renewal models are widely used in statistical epidemiology as semi-mechanistic models of disease transmission. While primarily used for estimating the instantaneous reproduction number, they can also be used for generating projections, estimating elimination probabilities, modelling the effect of interventions, and more. We demonstrate how simple sequential Monte Carlo methods (also known as particle filters) can be used to perform inference on these models. Our goal is to acquaint a reader who has a working knowledge of statistical inference with these methods and models and to provide a practical guide to their implementation. We focus on these methods’ flexibility and their ability to handle multiple statistical and other biases simultaneously. We leverage this flexibility to unify existing methods for estimating the instantaneous reproduction number and generating projections. A companion website SMC and epidemic renewal models provides additional worked examples, self-contained code to reproduce the examples presented here, and additional materials. † † corresponding: Corresponding author Nicholas Steyn. 1 Introduction Modern epidemiology relies on statistical models to track and project the spread of infectious diseases, inform public health policymaking, and estimate disease burden [ 1 ] . A commonly used model for these purposes is the semi-mechanistic renewal model, which relates past incidence to current incidence through a simple renewal process [ 2 , 3 , 4 ] . While this model is most commonly used for estimating the instantaneous reproduction number R_{t} [ 5 , 6 , 7 ] , it can also be used for generating projections [ 8 , 9 , 6 , 10 ] , estimating elimination probabilities [ 11 , 12 , 13 ] , and modelling the effect of non-pharmaceutical interventions [ 14 , 15 ] , for example. Renewal models are frequently modified to account for various biases and limitations in epidemiological data [ 16 , 17 , 18 , 19 ] . These modifications often necessitate bespoke methods for fitting the model to data, which can be difficult to implement and become increasingly complex with additional modifications. Reviews of reproduction number estimation highlight key practical considerations to bear in mind when fitting the renewal model to epidemiological data. Gostic et al. (2020) [ 20 ] highlight generation interval misspecification, reporting delays, right-truncation due to observation delays, incomplete observation, and smoothing windows as particular concerns. Nash, Nouvellet, & Cori (2022) [ 16 ] identify 54 papers that make modifications to EpiEstim (arguably the most popular R_{t} estimator) to account for such biases. They note delayed and missing reported case data, weekly reporting noise, alternative smoothing methods, imported cases, and temporal aggregation of reported data as common considerations. These adjustments are just as necessary for generating projections and other epidemiological analyses as they are for R_{t} estimation. In this primer, we present a pedagogical overview of how sequential Monte Carlo (SMC) methods [ 21 , 22 ] , which are well established in other contexts, can be used as flexible and general-purpose tools for fitting renewal models to epidemiological data. The overall approach can be viewed as a distillation of the methods employed by Watson et al. (2024) [ 23 ] . We focus on how these methods can handle multiple biases simultaneously and provide a unified framework for a range of tasks including reproduction number estimation and generating projections. SMC methods, often called particle filters, are a class of algorithms that are used to fit general hidden-state models to observed data. They use a collection of samples (called particles) to represent the posterior distribution of “hidden states” at each time step (e.g. the instantaneous reproduction number or daily infection incidence) given some observed data (e.g. reported cases). These particles are projected forward according to a state-space transition model (typically an epidemic model of some kind) and weighted by an observation model (typically representing a noisy observation process). Such methods are particularly powerful, as they only require simulations from the epidemic model, rather than evaluations of a likelihood, allowing for simulation-based inference [ 24 ] . Accounting for the aforementioned delays and biases simply requires incorporating these in the state-space transition and observation models, allowing a wide range of models to be fit using a single framework. Despite being well suited to fitting epidemiological models and having a relatively straightforward and intuitive implementation, and calls for their further use [ 25 ] , SMC methods are not widely used when fitting epidemic renewal models. They have seen greater use in fitting compartmental models [ 26 , 27 , 28 , 28 , 29 , 30 , 31 , 32 ] , while examples of their application to agent-based models [ 33 ] , Hawkes processes [ 34 ] , and renewal models [ 35 , 23 , 36 ] are more limited. This discrepancy likely arises from the Markovian nature of many compartmental models, a property which is leveraged by many popular SMC methods, whereas the renewal model is explicitly non-Markovian. We are aware of two reviews of SMC methods in epidemiology [ 37 , 38 ] , both of which are high quality and provide complementary information to this primer, though neither covers methods applicable to the renewal model. To aid comparison with these papers, a discussion of similarities and differences with this primer is provided online . Methods for fitting renewal models that feature comparable flexibility typically rely on Hamiltonian Monte Carlo (HMC) [ 6 , 39 , 40 ] (as implemented in Stan [ 41 ] ), often coupled with an approximate Gaussian process state-space model (such as in EpiNow2 [ 6 ] , which is available as a plug-and-play software package). However, HMC-based methods do not support discrete state spaces or parameters, can be comparatively computationally intensive, and cannot be updated online as new data are observed. Additionally, Gaussian process approximations introduce significant mathematical complexity. Our goal is to enable a researcher to rapidly implement their own methods, ensuring they understand the process from start to finish. An alternative flexible approach is the Laplacian P-spline method of EpiLPS [ 42 ] , though its fully Bayesian implementation is also gradient-based, again limiting it to continuous state spaces and parameters, and the mathematical complexity of this method is also high. Finally, approximate Bayesian computation methods could also be used to fit renewal models, although (as for SMC) the literature is largely focused on compartmental models [ 43 , 44 ] . We aim to familiarise the reader with both the discrete-time renewal model and SMC methods. We provide simple implementations of SMC-type algorithms, including a bootstrap filter with fixed-lag resampling and a particle marginal Metropolis-Hastings (PMMH) algorithm, for fitting renewal models to data. Their use is demonstrated in several epidemiologically interesting scenarios using national data from the COVID-19 pandemic in Aotearoa New Zealand. We also provide guidance on model evaluation and comparison. Our aim is not to provide a model for every scenario, but to equip the reader with the tools to construct and fit their own models. This paper contains the technical details needed to construct and fit discrete-time epidemic renewal models with SMC methods, consolidating

Read the complete text