Robust, partially alive particle Metropolis-Hastings via The Frankenfilter
Chris Sherlock, Andrew Golightly, Anthony Lee · 2026
Read Robust, partially alive particle Metropolis-Hastings via The Frankenfilter by Chris Sherlock, Andrew Golightly, Anthony Lee (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-23173.txt.
Introduction
Chris Sherlock, Andrew Golightly, and Anthony Lee fix a failure mode in particle filtering for hidden Markov models. Sometimes every simulated particle scores zero likelihood for an observation, so the filter collapses. Then the filtering distribution cannot be estimated and the parameter likelihood reads zero.
Their partially alive scheme, nicknamed the Frankenfilter, keeps such runs going in a principled way. It slots into particle Metropolis-Hastings, a standard inference method. Robust filters matter for tracking, epidemiology, and finance, where zero-likelihood steps occur in real data. Partially alive particles keep the filter estimable through stretches where a naive particle set would collapse to zero.
Catalog record
| CREATOR | Chris Sherlock, Andrew Golightly, Anthony Lee |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 84 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-23173
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Robust, partially alive particle Metropolis-Hastings via The Frankenfilter Chris Sherlock, Andrew Golightly, Anthony Lee Abstract When a hidden Markov model permits the conditional likelihood of an observation given the hidden process to be zero, all particle simulations from one observation time to the next could produce zeros. If so, the filtering distribution cannot be estimated and the estimated parameter likelihood is zero. The alive particle filter addresses this by simulating a random number of particles for each inter-observation interval, stopping after a target number of non-zero conditional likelihoods. For outlying observations or poor parameter values, a non-zero result can be extremely unlikely, and computational costs prohibitive. We introduce the Frankenfilter, a principled, partially alive particle filter that targets a user-defined amount of success whilst fixing lower and upper bounds on the number of simulations. The Frankenfilter produces unbiased estimators of the likelihood, suitable for pseudo-marginal Metropolis–Hastings (PMMH). We demonstrate that PMMH with the Frankenfilter is more robust to outliers and mis-specified initial parameter values than PMMH using standard particle filters, and is typically at least 2-3 times more efficient. We also provide advice for choosing the amount of success. In the case of n n exact observations, this is particularly simple: target n n successes. 1 Introduction Consider a hidden Markov model for a hidden process, \{X_{t}\}_{t\in[0,T]} , X_{t}\in\mathcal{X} (t\in[0,T]) , parameterised by \theta and observed at times t_{1},\dots,t_{n} with observations y_{i}\in\mathcal{Y} , i=1,\dots,n . The likelihood for the data is P(y_{1:n}|\theta)=\int f(y_{1:n}|x_{[0,T]},\theta)~\mathsf{d}\widetilde{P}(x_{[0,T]}|\theta), where \widetilde{P} is the law of x_{[0,T]} , and the conditional likelihood is f(y_{1:n}|x_{[0,T]},\theta)=\prod_{i=1}^{n}f(y_{i}|x_{t_{i}},\theta). Suppose that, conditional on X_{t_{i}} , the likelihood, f(y_{i}|X_{t_{i}}=x,\theta)=0 if some criterion on the closeness of X_{t_{i}} to y_{i} is not satisfied. A special case of particular note is when each conditional likelihood is an indicator function (typically on the closeness of x to y_{t} ): f(y_{t}|X_{t}=x):\mathcal{Y}\times\mathcal{X}\rightarrow\{0,1\} . Our interest in this phenomenon arises from exact or partial but noiseless observations of a Markov jump process, which has a discrete statespace, \mathcal{X}\subseteq\mathbb{Z}^{d} ; alternative scenarios include, for any Markov process, approximate Bayesian computation with a kernel such as 1(\|y_{i}-x_{t_{i}}\|\leq\epsilon) ( Sisson et al., 2018 , e.g.,) . The usual collection of particle filters, including the bootstrap filter Gordon et al., 1993 and the auxiliary particle filter Pitt and Shephard, 1999 fix the number of particles (simulations) from one observation time, t_{i-1} to the next, t_{i} . Thus, in the scenario where the conditional likelihood for a simulation can be 0 , it is possible that the conditional likelihood of each of the particles is also 0 ; in this case, none of the particles at time t_{i} can be resampled, and the particle filter ‘dies out’. Consequently, it is not possible to estimate the filtering distribution and, within a particle MCMC or SMC 2 scheme, the estimate of the likelihood is 0 . When a traditional particle filter is used within particle Metropolis–Hastings, the ideal number of particles can vary from one parameter value to another; for example, a parameter value that fits less well with the data than the posterior mode, will lead to simulations from the prior of the process that fit less well with the data, and this can lead to more Monte Carlo variability in the estimate of the log likelihood for that particular simulation. Since in real scenarios (nearly) all models are wrong, even for the posterior modal parameter value, a few outlying process values or outlying observations could suggest an ideal number of particles for the related inter-observation intervals that is much larger than is required for the rest of the intervals. All of these points have motivated the development of the alive particle filter. Notation and simplification . We suppress the dependence on the parameter, \theta , from the notation. Also, in Sections 1-3, purely to simplify the presentation, we assume integer observation times ( t=1,2,\dots,T ) and that the transition kernel and observation process are time homogeneous. Here and throughout, we denote the prior for the hidden process at time 0 by p_{0}(\cdot) , and the one step transition kernel from time t-1 to time t , conditional on X_{t-1}=x , by p(\cdot|x) . The likelihood for the data conditional on \theta becomes P(y_{1:T}) 1.1 The alive particle filter and compromises in practice LeGland and Oudjane, 2004 ; LeGland and Oudjane, 2005 propose and analyse a particle filter which, for each inter-observation interval, simulates repeatedly until a prespecified amount of ‘success’, \mathfrak{s} , has been achieved, thus producing a random number of particles. In the special case of a product of binary (indicator) likelihoods, simulations are started from a state chosen uniformly at random from the successful states at time t_{i-1} , \mathfrak{s} is the target number of successes ( 1 s) and the estimate of the likelihood for n observations is \widehat{P}_{LO}:=\prod_{t=1}^{T}\frac{\mathfrak{s}}{M_{t}}. where M_{t} is the number of simulations required to achieve \mathfrak{s} ”successes” at time t . Whilst \widehat{P}_{LO} is consistent for the true likelihood, p , as \mathfrak{s}\to\infty , it is biased and is, therefore, unsuitable for particle Metropolis–Hastings. Amrein and Künsch, 2011 and del Moral et al., 2015 consider the case of a product of indicator function conditional likelihoods, and show that \mathbb{E}\left[{\widehat{P}_{\mathrm{alive}}}\right]=f(y_{1:T}) , where \widehat{P}_{\mathrm{alive}}:=\prod_{t=1}^{T}\frac{\mathfrak{s}-1}{M_{t}-1}. Clearly, we must set \mathfrak{s}\geq 2 . Subject to strong conditions, del Moral et al., 2015 also shows that to control the variance of \widehat{P}_{\mathrm{alive}}/p , \mathfrak{s} should grow linearly with T . Each M_{t} is now unbounded and can be exceedingly large when the success probability is small. The current ad hoc solution to this problem Drovandi and McCutchan, 2016 ; Drovandi et al., 2016 fixes a (high) hard threshold m_{+}\geq\mathfrak{s} on M_{t} such that if this threshold is reached, M_{t}=m_{+} , simulation halts and \widehat{P}_{\mathrm{alive}}=0 is returned. The motivation is that if M_{t}=m_{+}>>\mathfrak{s} , the simulated process does not fit with the data, so the associated parameter value should have low posterior mass and, hence, should be rejected. The ‘alive particle filter with a hard threshold’, where success/failure is binary (as in del Moral et al., 2015 ; Drovandi and McCutchan, 2016 ; Drovandi et al., 2016 ) is detailed in Algorithm 1 . Unfortunately Algorithm 1 leads to a biased estimator of the likelihood and biased inference for parameters within pseudo-marginal MCMC or SMC 2 . The first simulation study, in Section 4.1 demonstrates this bias in practice. Algorithm 1 Alive Filter with Hard Threshold 1: procedure AliveThresh ( \mathfrak{s},m_{+} ) \triangleright target # successes, max #trials 2: for t in 1:T do 3: m\leftarrow 0 . 4: do 5: m\leftarrow m+1 . 6: if t=1 then 7: Sample x_{t-1}^{m}\sim p_{0} ; set a_{t-1}^{m}=m . 8: else 9: a_{t-1}^{m}\leftarrow DiscreteUniform ( \{1,\dots,\mathfrak{s}-1\} ). 10: end if 11: Sample \widetilde{x}_{t}^{m}\sim p(\cdot|x_{t-1}^{a_{t-1}^{m}}) ; calculate s^{m}\in\{0,1\} from (x_{t}^{m},y_{t}) . 12: if s^{m}=1 then 13: x_{t}^{\sum_{j=1}^{m}s^{j}}=\widetilde{x}_{t}^{m} 14: end if 15: while m<m_{+} and \sum_{j=1}^{m}s^{j}<\mathfrak{s} 16: if m=m_{+} then 17: return \widehat{p}=0 . \triangleright \widehat{p}_{t}=0\implies\prod_{s=1}^{T}\widehat{p}_{s}=0 18: else 19: \widehat{p}_{t}\leftarrow\frac{\mathfrak{s}-1}{m-1} . 20: end if 21: end for 22: return \widehat{p}=\prod_{s=1}^{T}\widehat{p}_{s} . 23: end procedure Motivated by a desire for the robustness and adaptivity of the alive particle filter and the practical necessity of bounding the amount of computational work, all whilst producing an unbiased estimator of the likelihood,