A forward-only scheme for online learning of proposal distributions in particle filters

Sylvain Procope-Mamert, Nicolas Chopin, Maud Delattre, Guillaume Kon Kam King · 2026

Read A forward-only scheme for online learning of proposal distributions in particle filters by Sylvain Procope-Mamert, Nicolas Chopin, Maud Delattre, Guillaume Kon Kam King (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-16089.txt.

Introduction

Sylvain Procope-Mamert and three coauthors set out a fresh way to pick paths in grain filters. Their 2026 preprint deals with filters that track a state from a stream of views. Good paths, called proposals, guide which states the filter tests. Past online ways build paths by work from the end back. That needs the full data set in hand.

The new way works forth, step by step, as data comes in. It uses views yet to come to hone the paths so far. Forth work fits live use, where the end is not yet known. The team tests if forth paths can match back built ones. The work aims at fast live state tracking.

Catalog record

CREATORSylvain Procope-Mamert, Nicolas Chopin, Maud Delattre, Guillaume Kon Kam King
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-16089

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A forward-only scheme for online learning of proposal distributions in particle filters Sylvain Procope-Mamert, Nicolas Chopin, Maud Delattre, Guillaume Kon Kam King Abstract We introduce a new online approach for constructing proposal distributions in particle filters using a forward scheme. Our method progressively incorporates future observations to refine proposals. This is in contrast to backward-scheme algorithms that require access to the entire dataset, such as the iterated auxiliary particle filters ( Guarniero et al., 2017 ) and controlled sequential Monte Carlo ( Heng et al., 2020 ) , which leverage all future observations through backward recursion. In comparison, our forward scheme achieves a gradual improvement of proposals that converges toward the proposal targeted by these backward methods. We show that backward approaches can be numerically unstable even in simple settings. Our forward method, however, offers significantly greater robustness with only a minor trade-off in performance, measured by the variance of the marginal likelihood estimator. Numerical experiments on both simulated and real data illustrate the enhanced stability of our forward approach. 1 Introduction Sequential Monte Carlo (SMC) methods ( Doucet and Johansen, 2011 ; Chopin and Papaspiliopoulos, 2020 ) are a class of particle algorithms designed to approximate sequences of probability measures known up to a normalizing constant with a sequence of weighted particles. They are widely used for inference in state-space models (SSMs), a class of models describing the evolution of an unobserved latent process through time, combined with a noisy observation process ( Durbin and Koopman, 2012 ) . An SSM typically consists of a latent Markov process and an observation process conditionally independent given the states. These models are particularly useful when observations are highly noisy, but the underlying dynamics provide essential structure to link observations together and share information across time, thereby reducing uncertainty and improving estimation. SSMs are ubiquitous in statistics, with applications in econometrics, signal processing, epidemiology, and robotics ( Cappé et al., 2005 ) . However, inference in nonlinear and non-Gaussian SSMs is challenging because the likelihood, the filtering, and the smoothing distributions lack closed-form expressions and are high-dimensional. While exact solutions exist for linear Gaussian cases via the Kalman filter ( Kalman, 1960 ) , Monte Carlo methods, such as particle filters and sequential Monte Carlo methods were introduced to handle more general settings. SMC algorithms may be naturally derived for most SSMs from the sequential nature of the model. The simplest and canonical SMC algorithm used to infer an SSM is the bootstrap particle filter ( Gordon et al., 1993 ) . This algorithm is often subject to particle degeneracy, resulting in a poor approximation of the target distribution when one or a few particles carry most of the weight. Designing efficient and robust filtering algorithms is crucial, as poor approximations and particle degeneracy lead to high variances for Monte Carlo estimates and unreliable inference, particularly in complex models. There have been many attempts to develop improved SMC algorithms that adapt to the target distribution, i.e., to the model and the observed data. For example, some authors have proposed guided particle filters ( Doucet et al., 2000 ) or auxiliary particle filters ( Pitt and Shephard, 1999 ) . Most of these methods involve looking one step (one observation) ahead to sample and weight particles at each time step. There are various ways to construct such SMC algorithms manually ( Chopin and Papaspiliopoulos, 2020 ) , but they require a deep understanding of the target distributions (for example, using Taylor expansions). Automatic and adaptive particle filters aim to reduce manual tuning and improve reliability across diverse applications, making them an active area of research. One approach to automatically construct better proposals is to iterate forward and backward passes over the data in order to progressively refine the proposals, as the iterated auxiliary particle filter (IAPF) of Guarniero et al., 2017 , and the controlled sequential Monte Carlo (cSMC) of Heng et al., 2020 . We observe that, in moderately challenging cases, these methods may fail to produce low-variance estimates of the marginal likelihood of the SSM. One explanation is that it is often difficult to design the initial forward pass that provides a good initialization to the next backward pass. This happens, for instance, if one uses the bootstrap filter for this initial forward pass. In this article, we propose a forward scheme that produces an SMC algorithm without requiring a good initialization. The difference with backward schemes can be understood as follows: the backward schemes start from the last time step of the SSM and go backward in time, essentially using all future observations to construct the proposals, whereas our forward scheme starts one step ahead and proceeds forward in time, gradually incorporating future observations to refine the proposals. Thus, our forward scheme iterates over easier steps than the backward schemes and is much more robust to difficult initializations. Although our scheme can be less efficient in easy cases — it often converges more slowly than backward schemes that incorporate all available information — we find this loss is modest. In Markovian models, observations far ahead typically carry little information about the current state, which limits the performance gap. Through extensive illustrations on simulated and real data, we observe that our algorithm is able to produce lower variance estimates than backward algorithms, which suffer from a lack of robustness. A recent proposal ( Xue et al., 2025 ) uses the same forward decomposition to construct an online smoothing algorithm, relying on two simultaneous particle systems. The implementation and goals differ from ours: they focus on estimating smoothing distributions rather than the marginal likelihood and parameter inference. Nonetheless, this work demonstrates that the forward decomposition can be used fruitfully to construct adaptive particle algorithms for SSMs. Building on these ideas, we now present our contribution in detail. The remainder of the article is organized as follows. In the next section, we introduce notation, state-space models, and the Feynman-Kac formalism underlying SMC algorithms. Next, we introduce auxiliary Feynman-Kac models and characterize globally and locally optimal proposals. Then, we derive our forward-only iterative scheme and discuss its practical implementation. The last section reports numerical experiments on simulated and real data, comparing our method to existing backward-scheme algorithms and to a reference bootstrap particle filter. We conclude with a brief discussion of limitations and possible extensions. 2 Context 2.1 Notations Given two measurable spaces (\mathcal{X}_{1},\mathcal{A}_{1}) and (\mathcal{X}_{2},\mathcal{A}_{2}) , we define an unnormalized kernel (resp. a Markov kernel) K from \mathcal{X}_{1} to \mathcal{X}_{2} as a function \mathcal{X}_{1}\times\mathcal{A}_{2}\to[0,\infty] such that for any set A\in\mathcal{A}_{2} the function x\in\mathcal{X}_{1}\mapsto K(x,A) is measurable and for any x\in\mathcal{X}_{1} the function A\in\mathcal{A}_{2}\mapsto K(x,A) is a finite measure (resp. a probability measure). Given some positive measurable function f\colon\mathcal{X}_{1}\times\mathcal{X}_{2}\to[0,\infty] , we define the function K(f)\colon\mathcal{X}_{1}\to[0,\infty] as follows: K(f)(x_{0})=\int f(x_{0},x)K(x_{0},dx). Similarly, given some measure \mathbb{K}(dx) and some positive measurable function f\colon\mathcal{X}\to[0,\infty] we define the quantity \mathbb{K}(f)\in[0,\infty] as follows: \mathbb{K}(f)=\int f(x)\mathbb{K}(dx). The notation t:s denotes the sequence (t,t+1,\dots,s) , x_{t:s} denotes a sequence (x_{t},\dots,x_{s}) , x^{n:m} denotes a sequence (x^{n},\dots,x^{m}) and x_{t:s}^{n:m} denotes the collection of all x_{i}^{j} with t\leq i\leq s and n\leq j\leq m , For spaces, \mathcal{X}_{t:s} denotes the product space \mathcal{X}_{t}\times\dots\mathcal{X}_{s} . Given a sequence of kernels (K_{t})_{t\geq 2} from \mathcal{X}_{t-1} to

Read the complete text