Improved Disease Outbreak Detection from Out-of-sequence measurements Using Markov-switching Fixed-lag Particle Filters
Conor Rosato, Joshua Murphy, Siân E. Jenkins, Paul Horridge, Alessandro Varsi, Martyn Bull, Alessandro Gerada, Alex Howard, Veronica Bowman, Simon Maskell · 2025
Read Improved Disease Outbreak Detection from Out-of-sequence measurements Using Markov-switching Fixed-lag Particle Filters by Conor Rosato, Joshua Murphy, Siân E. Jenkins, Paul Horridge, Alessandro Varsi, Martyn Bull, Alessandro Gerada, Alex Howard, Veronica Bowman, Simon Maskell (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-01639.txt.
Introduction
Conor Rosato and co-authors improve outbreak detection when data arrives out of order. Particle filters estimate hidden epidemic states well. Real reports often land late or out of sequence. That disorder can throw off a filter's state.
Their method adds Markov-switching regimes for endemic and outbreak phases. A fixed-lag particle filter handles the late data. Regime switches let the model jump modes as an outbreak starts. Earlier, cleaner detection helps health teams act while spread is still small. Out-of-sequence handling is built in, not patched on, which matters when labs report cases days late during a fast-moving outbreak.
Catalog record
| CREATOR | Conor Rosato, Joshua Murphy, Siân E. Jenkins, Paul Horridge, Alessandro Varsi, Martyn Bull, Alessandro Gerada, Alex Howard, Veronica Bowman, Simon Maskell |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-01639
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Improved Disease Outbreak Detection from Out-of-sequence measurements Using Markov-switching Fixed-lag Particle Filters Conor Rosato, Joshua Murphy, Siân E. Jenkins, Paul Horridge, Alessandro Varsi, Martyn Bull, Alessandro Gerada, Alex Howard, Veronica Bowman, Simon Maskell Abstract Abstract Particle filters (PFs) have become an essential tool for disease surveillance, as they can estimate hidden epidemic states in nonlinear and non-Gaussian models. In epidemic modelling, population dynamics may be governed by distinct regimes such as endemic or outbreak phases which can be represented using Markov-switching state-space models. In many real-world surveillance systems, data often arrives with delays or in the wrong temporal order, producing out-of-sequence (OOS) measurements that pertain to past time points rather than the current one. While existing PF methods can incorporate OOS measurements through particle reweighting, these approaches are limited in their ability to fully adjust past latent trajectories. To address this, we introduce a Markov-switching fixed-lag particle filter (FL-PF) that resimulates particle trajectories within a user-specified lag window, allowing OOS measurements to retroactively update both state and model estimates. By explicitly reevaluating historical samples, the FL-PF improves the accuracy and timeliness of outbreak detection and reduces false alarms. We also show how to compute the log-likelihood within the FL-PF framework, enabling parameter estimation using Sequential Monte Carlo squared (SMC 2 ). Together, these contributions extend the applicability of PFs to surveillance systems where retrospective data are common, offering a more robust framework for monitoring disease outbreaks and parameter inference. Author summary Early detection of disease outbreaks is essential for minimising both health and societal impacts. Our goal is to develop a statistical framework that serves as an early warning system for identifying disease outbreaks by fusing multiple streams of surveillance measurement data. In disease monitoring, data might be delayed, irregularly spaced, or arrive in OOS order, leading to challenges in timely analysis and response. We propose to use a FL-PF to provide daily estimates of the probability of the presence of an outbreak based on these asynchronous data. We show that through extensive simulation experiments, when compared with a standard PF, the FL-PF can provide more accurate estimates with fewer false-alarms. Additionally, our framework allows for efficient parameter estimation of the models with SMC 2 . The code for this paper can be found https://github.com/j-j-murphy/FLEPI. 1 Introduction Syndromic surveillance is a method of monitoring public health to detect and respond to potential outbreaks of diseases [ 21 ] . It involves the real-time collection, analysis, and interpretation of health-related data to identify unusual patterns or clusters of symptoms that may indicate an outbreak. Detecting disease outbreaks in a timely manner is essential for minimising health impacts, protecting vulnerable populations, efficiently allocating resources, and ensuring economic stability. In particular, early warning systems can be effective in the detection of infectious diseases outbreaks [ 41 ] . A popular approach for outbreak detection is to employ Bayesian statistical principles to model and infer the likelihood of an outbreak occurring based on observed data. These methods provide a probabilistic framework that can incorporate prior information and update beliefs as new data becomes available. Some examples of Bayesian modelling for outbreak detection include: Bayesian network modelling [ 25 , 62 , 12 , 11 ] , Bayesian Markov switching modelling [ 32 , 33 , 36 ] , Markov Chain Monte Carlo (MCMC) [ 38 , 32 , 33 , 36 , 2 ] and Sequential Monte Carlo (SMC) methods [ 13 , 33 ] . Continually monitoring syndromic surveillance allows public health officials to predict changes in disease incidence patterns. These changes can result from shifts in model parameters, such as the transmissibility parameter, which can lead to abrupt increases in infection rates over time [ 34 , 44 , 22 , 46 ] or decreases when disease control measures are being analysed [ 20 ] . One effective method for detecting changes in underlying incidence is the use of Markov switching models (MSM). MSMs have been successfully employed to detect outbreaks of diseases such as dengue [ 32 ] , influenza [ 33 , 39 , 3 ] , and anthrax [ 35 ] . The key idea is to capture the different phases or regimes of disease outbreaks, such as periods of low incidence (background noise) and high incidence (outbreaks), and to switch between these regimes based on the data observed over time. Predictions of the probability that there is an outbreak today (time t ) can be made and evaluated using sensitivity (True Positive Rate), specificity (True Negative Rate) and the false alarm rate [ 13 , 57 , 33 , 39 , 63 , 3 , 11 ] . Out-of-sequence (OOS) syndromic measurements refer to data that is collected, reported, or obtained in a non-sequential or asynchronous manner, often arising in disease modelling when data collection is irregular, delayed, or reported without following a strict chronological order [ 30 ] . A recent review article outlines different nowcasting methods for accounting for reorting delays [ 61 ] . Detecting disease outbreaks with OOS measurements can be challenging due to the non-linear nature of the data arrival [ 57 , 27 ] . Consequently, making inferences about disease states using data from various disparate sources can pose significant challenges [ 14 ] . Studies such as [ 43 , 53 , 37 ] combine heterogeneous data sources (e.g., death counts, hospital admissions, self-reported symptoms, positive test results, or social media signals) to infer the COVID-19 reproductive number R_{t} . These examples highlight how such data differ in spatio-temporal resolution and reporting latency. Latency in this context can refer to the delays between exposure, symptom onset, and infectiousness, often modeled by parameterising transmission kernels to extend the infectious period beyond a single time step [ 31 ] , or reporting delays between when an event occurs and when it is recorded. For example, self-reported symptom tweets are available daily with negligible delay [ 53 ] , whereas hospital admission counts are likely to be available with a delay. Uncertainty in these latency periods is commonly addressed using Bayesian inference methods [ 43 , 6 , 7 ] . Particle filters (PFs) [ 5 ] are online Bayesian methods that have been widely used to estimate the state of a disease based on noisy observations [ 50 , 65 , 13 , 9 , 52 , 19 , 29 , 51 ] . Traditionally, as data becomes available at each increment of time t , PFs provide an estimate of the probability distribution over the states of a disease model. These states could coincide with the latent compartments of the Susceptible, Infected, and Recovered (SIR) disease compartmental model [ 28 ] . As more data becomes available, this estimate is recursively updated. PFs can handle Markovian models wherein the future state of the system depends only on the current state and not on the sequence of events that preceded it. In the context of disease modeling, this means that the probability of an individual transitioning from one health state to another depends only on their current health status and not on how long they have been in that state or any prior disease history. These transition probabilities that govern the disease model