Fast filtering of non-Gaussian models using Amortized Optimal Transport Maps

Mohammad Al-Jarrah, Bamdad Hosseini, Amirhossein Taghvaei · 2025

Read Fast filtering of non-Gaussian models using Amortized Optimal Transport Maps by Mohammad Al-Jarrah, Bamdad Hosseini, Amirhossein Taghvaei (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-12633.txt.

Introduction

Mohammad Al-Jarrah and co-authors speed up a class of filters that track hidden states in this 2025 paper. The filters update beliefs about a system as data arrive, even when the noise is not bell-shaped. Their best versions rely on optimal transport maps, but those maps must be retrained at every time step, which is slow.

The new filter learns a library of maps ahead of time, offline. During live use, it clusters the situation and blends the right pre-trained maps, like a panel of experts voting. Tests show the shortcut keeps the accuracy and flexibility of the full method. The savings make transport-based filtering practical for real-time jobs.

Catalog record

CREATORMohammad Al-Jarrah, Bamdad Hosseini, Amirhossein Taghvaei
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-12633

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Fast filtering of non-Gaussian models using Amortized Optimal Transport Maps Mohammad Al-Jarrah, Bamdad Hosseini, Amirhossein Taghvaei Abstract In this paper, we present the amortized optimal transport filter (A-OTF) designed to mitigate the computational burden associated with the real-time training of optimal transport filters (OTFs). OTFs can perform accurate non-Gaussian Bayesian updates in the filtering procedure, but they require training at every time step, which makes them expensive. The proposed A-OTF framework exploits the similarity between OTF maps during an initial/offline training stage in order to reduce the cost of inference during online calculations. More precisely, we use clustering algorithms to select relevant subsets of pre-trained maps whose weighted average is used to compute the A-OTF model akin to a mixture of experts. A series of numerical experiments validate that A-OTF achieves substantial computational savings during online inference while preserving the inherent flexibility and accuracy of OTF. I Introduction The nonlinear filtering problem concerns the approximation of the conditional probability distribution (posterior) of the hidden state of a stochastic dynamical system given a sequence of partial and noisy observations. This problem is crucial in a wide range of applications including: satellite orbit determination and navigation systems [ 18 ] ; weather forecasting [ 38 ] ; machine learning [ 6 ] ; and economics [ 7 , 17 ] . Traditional methods for nonlinear filtering, such as the Kalman filter (KF) and its extensions [ 20 , 19 ] , simplify the problem by imposing a Gaussian ansatz on the joint distribution of the state and observations. This Gaussian assumption is adequate for nearly linear systems with additive Gaussian noise but it is ineffective for highly nonlinear and complex systems. On the other hand, particle filter methods such as sequential importance re-sampling (SIR) [ 14 , 10 ] approximate the posterior with the weighted empirical distribution of a set of particles. As a result, particle filters are able to handle nonlinear and non-Gaussian models but they often suffer from the weight degeneracy issue, usually in high-dimensional settings [ 5 , 31 ] . To overcome the aforementioned limitations, coupling and transport-based approaches have been developed [ 28 , 26 , 32 , 30 , 36 ] , with the optimal transport filter (OTF) [ 35 , 1 , 15 , 3 ] emerging as a particularly attractive alternative. The OTF deterministically transports particles using an optimal transport (OT) formulation of the prior to posterior relationship. OTF offers two main advantages: (i) it requires only samples from the joint distribution of states and observations, eliminating the need for explicit analytical models of the likelihood and dynamics, and (ii) it enables flexible neural network parameterizations to enhance the expressivity of transport maps. However, the computational burden of OTF is significant as the OT maps are computed online at each time step via a stochastic optimization procedure. The goal of this article is to reduce the computational cost of OTF during online/real-time filtering by exploiting the shared structure of OTF maps across various time instances: simply put, similar state and observation distributions should lead to similar OTF maps and this “similarity” can be exploited to improve efficiency of the algorithm. Inspired by the amortized optimization methodology [ 4 , 13 , 29 , 24 , 34 ] , we propose the amortized OTF (A-OTF). This method consists of an offline and an online stage: During the offline stage a collection of OTF maps are computed from a set of (often random) simulations of the model. During the online stage, the prior-to-posterior map is approximated as a weighted linear combination of the offline OTF maps. The defining weights for the A-OTF maps are determined using similarity measures between the current prior and those associated with the pre-trained maps, an approach analogous to kernel interpolation or scattered data approximation [ 27 , 40 ] . To further accelerate the online computations and avoid redundancy in the pre-trained set, we also apply a clustering algorithm in the offline stage that allows us to localize the A-OTF map around the current prior. Specifically, we use the partitioning around medoids algorithm [ 23 , 21 , 22 ] which we refer to as the K -Medoids. As it is often the case with local interpolation/regression, the quality of A-OTF is tied to the quality of the pre-training data set and the complexity of the underlying dynamics. Indeed, in the previous work [ 2 ] , the authors utilized a single pre-trained OTF filter in real-time for stationary dynamics. The A-OTF can be viewed as an extension of this idea to non-stationary settings. The rest of the paper is organized as follows: Sec. II includes the mathematical setup and the modeling assumptions; Sec. III contains the proposed methodology; and section IV presents several numerical experiments and benchmarks. II Problem Formulation II-A Setup Consider the discrete-time stochastic dynamical system \displaystyle X_{t} \displaystyle\sim a_{t}(\cdot|X_{t-1}),\quad X_{0}\sim\pi_{0} (1a) \displaystyle Y_{t} \displaystyle\sim h_{t}(\cdot|X_{t}) (1b) for t=1,2,\ldots where X_{t}\in\mathbb{R}^{n} is the hidden state of the system, Y_{t}\in\mathbb{R}^{n_{y}} is the observation, \pi_{0} is the initial probability distribution of the state, a_{t}(x^{\prime}|x) is the transition kernel from X_{t-1}=x to X_{t}=x^{\prime} , and h_{t}(y|x) is the likelihood of observing Y_{t}=y given X_{t}=x . The filtering problem is to infer the conditional distribution of the state X_{t} given the history of the observations \{Y_{1},\dots,Y_{t}\} , that is, the distribution \pi_{t}:=\mathbb{P}(X_{t}\in\cdot|Y_{1},\dots,Y_{t}) often referred to as the posterior distribution. The posterior distribution \pi_{t} can be expressed via a recursive equation which is fundamental to the design of filtering algorithms. In particular, by leveraging the dynamic and observation models, we introduce the following propagation and conditioning operators: \displaystyle\text{(propagation)}~\pi\mapsto\mathcal{A}_{t}\pi \displaystyle:=\int_{\mathbb{R}^{n}}a_{t}(\cdot|x)\pi(x)dx, (2a) \displaystyle\text{(conditioning)}~\pi\mapsto\mathcal{B}_{t,y}(\pi) \displaystyle:=\frac{h_{t}(y|\cdot)\pi(\cdot)}{\int_{\mathbb{R}^{n}}h_{t}(y|x)\pi(x)dx}, (2b) for an arbitrary probability distribution \pi . The propagation operator \mathcal{A}_{t} represents the update for the distribution of the state according to the dynamic model ( 1a ) and the conditioning operator \mathcal{B}_{t,y} represents the Bayes’ rule that carries out the conditioning according to the observation model ( 1b ). Combining these operators yields an update for for the posteriors [ 8 ] : \pi_{t}\;=\;\mathcal{B}_{t,Y_{t}}(\mathcal{A}_{t}\pi_{t-1}). (3) II-B The Optimal Transport Filter The OTF algorithm is introduced in the recent work of the authors [ 3 ] as an algorithm for approximating the Bayesian update ( 2b ) with an OT map which transports particles from the prior to the posterior. Let us briefly recall how OTF works. For any joint distribution P_{X,Y} consider the optimization problem \displaystyle\max_{f\in c\text{-Concave}_{x}}\,\min_{T\in\mathcal{M}(P_{X}\otimes P_{Y})}\,J(f,T;P_{X,Y}), (4) where P_{X}\otimes P_{Y} denotes the independence coupling of the X and Y marginals P_{X} and P_{Y} , \mathcal{M}(P_{X}\otimes P_{Y}) is the set of maps \mathbb{R}^{n}\times\mathbb{R}^{n_{y}}\mapsto\mathbb{R}^{n} that are P_{X}\otimes P_{Y} -measurable, and the set c\text{-Concave}_{x} denotes the set of functions f(x,y) on \mathbb{R}^{n}\times\mathbb{R}^{n_{y}}\mapsto\mathbb{R} that are c -concave in their first variable x everywhere 1 1 1 f is c -concave iff \frac{1}{2}\|\cdot\|^{2}-f is convex. . The explicit form of the objective J appears in [ 3 , eq(8c)] . Assuming P_{X} is absolutely continuous with respect to the Lebesgue measure, the optimization ( 4 ) has a unique solution pair (\overline{f},\overline{T}) where \overline{T}(\cdot,y)_{\#}P_{X}(\cdot)=P_{X|Y}(\cdot|y)\quad\forall y, where “ \# ” denotes the push-forward operator [ 3 , Prop. 2.3.] . The map \overline{T} , produced by the above optimization procedure, is used to

Read the complete text