Smoothing Out the Edges: Continuous-Time Estimation with Gaussian Process Motion Priors on Factor Graphs
Holmes, Connor, Lilge, Sven, Guo, Zi Cong, Dellaert, Frank, Barfoot, Timothy D · 2026
Read Smoothing Out the Edges: Continuous-Time Estimation with Gaussian Process Motion Priors on Factor Graphs by Holmes, Connor, Lilge, Sven, Guo, Zi Cong, Dellaert, Frank, Barfoot, Timothy D (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-09073.txt.
Introduction
Connor Holmes and four co-authors explain a cleaner way to estimate motion that unfolds smoothly over time, a need that arises when sensors report at different moments. Two broad styles exist: fitting flexible curves, or using Gaussian processes, which treat the path as a smooth random function. The second style has spread slowly in robotics despite clear strengths.
The authors recast Gaussian process estimation in the language of factor graphs, the diagram style roboticists already use to organize estimation problems. Their account aims to lower the barrier for newcomers. Three working examples built in a popular estimation library show the approach in action, covering the setup from model to solved trajectory.
Catalog record
| CREATOR | Holmes, Connor, Lilge, Sven, Guo, Zi Cong, Dellaert, Frank, Barfoot, Timothy D |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 145 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.09073
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Smoothing Out the Edges: Continuous-Time Estimation with Gaussian Process Motion Priors on Factor Graphs Holmes, Connor, Lilge, Sven, Guo, Zi Cong, Dellaert, Frank, Barfoot, Timothy D Abstract Continuous-time state estimation is gaining in popularity due to its abilities to provide smooth solutions, handle asynchronous sensors, and interpolate between data points. While there are two main paradigms, parametric (e.g., temporal basis functions, splines) and nonparametric (Gaussian processes), the latter has seen less adoption despite its technical advantages and relative ease of implementation. In this article, we seek to rectify this situation by providing a new simplified explanation of GP continuous-time estimation rooted in the language of factor graphs , which have become the de facto estimation paradigm in much of robotics. To simplify onboarding, we also provide three working examples implemented in the popular GTSAM estimation framework. \maintitleauthorlist Connor Holmes ∗ Sven Lilge ∗ Zi Cong Guo University of Toronto and Frank Dellaert Georgia Institute of Technology and Timothy D. Barfoot University of Toronto \issuesetup copyrightowner=C. Holmes, Z. C. Guo, S. Lilge, F. Dellaert, and T. D. Barfoot, volume = xx, issue = xx, pubyear = 2025, isbn = xxx-x-xxxxx-xxx-x, eisbn = xxx-x-xxxxx-xxx-x, doi = 10.1561/XXXXXXXXX, firstpage = 1, lastpage = 18 1]University of Toronto; connor.holmes, [email protected], sven.lilge, [email protected] 2]Georgia Institute of Technology; [email protected] *]Denotes equal contribution \articledatabox \nowfntstandardcitation \makeabstracttitle Chapter 1 Introduction In this article, we consider the problem of estimating a continuous-time trajectory from discrete measurements. This is a common problem in robotics, computer vision, and many other fields where we have sensors that provide measurements at discrete time intervals, but we would like to query the state of a system at any point in time. Specifically, we will discuss using continuous-time estimation based on GP ( GP ) regression. This topic is not itself new and therefore this article should be considered mostly of tutorial value. Its contributions beyond the existing literature are: • We provide new insights on the connections between continuous-time GP regression and factor graphs. In particular, we show that querying the trajectory at any time of interest can be accomplished by an application of the factor-graph elimination algorithm. This leads to a novel way to do covariance interpolation and new insights into interpolating measurement states. • We implement GP -based continuous-time estimation in the popular GTSAM ( GTSAM ) framework and apply it on three tutorial examples. This allows us to demonstrate the use of continuous-time estimation in a practical setting, including how to handle high-rate and asynchronous measurements. • We release the code and the datasets used in the examples open source. This will hopefully make adoption by others easier and allow for further experimentation and development in this area. In the rest of this chapter, we motivate the continuous-time estimation problem, discuss the specific type of continuous-time estimation we consider, and provide an overview of related work. 1.1 What is Continuous-Time Estimation? Figure 1.1 illustrates the general problem in which we are interested. We have a trajectory \mathbf{x}(t) that we would like to estimate, but we only have measurements \mathbf{y}_{k} at discrete times t_{k} . We would like to be able to query the trajectory at any time of interest, \tau . Figure 1.1 : We consider a trajectory to be a continuous function of time. Measurements \mathbf{y}_{k} occur (possibly asynchronously) at discrete times t_{k} yet we would like to be able to query (estimate) the trajectory state \mathbf{x}(\tau) at any time of interest, \tau . There are four main advantages to continuous-time estimation over its discrete-time counterpart: • We can easily handle high-rate and asynchronous measurements. This is accomplished by assigning each measurement to the trajectory at its time of occurrence, t_{k} . • We can query the trajectory at any time of interest, \tau , not just at the measurement times, t_{k} . This is useful for applications where we might use one sensor to estimate the trajectory but another to build a map, for example. It is also useful in control where we might want to query the trajectory at a high rate to compute control inputs. • The continuous-time representation can impose smoothness on the estimated trajectory. Often the object to which our sensors are attached is moving smoothly through the world because it is governed by physics, and we can use this knowledge to regularize the solution through the choice of motion prior. • The continuous-time representation can be used to overcome observability issues. For sweeping-while-moving sensors such as rolling-shutter cameras or spinning lidars, the trajectory is often under-constrained by the measurements alone since each pixel or point is acquired from a unique pose. Our motion prior serves to regularize the solution and can be physically motivated, such as a constant-velocity prior or a constant-acceleration prior. The ability to separate the roles of measurement times , estimation times , and query times is an important property of continuous-time estimation. We will next discuss the two main paradigms for continuous-time estimation, parametric and nonparametric, and why we focus on the latter in this article. 1.2 Parametric vs. Nonparametric A common way to perform continuous-time estimation is to use a parametric representation of the trajectory, such as a spline or temporal basis functions. In this case, we assume that the trajectory can be represented by a finite number of parameters, and we estimate these parameters from the measurements. For example, we might use a representation such as \mathbf{x}(t)=\sum_{n=0}^{N}\mathbf{B}_{n}(t){\boldsymbol{\theta}}_{n}, (1.1) where {\boldsymbol{\theta}}_{n} are the coefficient parameters to be estimated and \mathbf{B}_{n}(t) are known temporal basis functions. We receive some discrete-time measurements \mathbf{y}_{k} at times t_{k} , given by the linear measurement function, \mathbf{y}_{k}=\mathbf{C}_{k}\mathbf{x}(t_{k})+\mathbf{n}_{k}, (1.2) with \mathbf{n}_{k}\sim\mathcal{N}(\mathbf{0},\mathbf{R}_{k}) measurement noise. We can then estimate the parameters {\boldsymbol{\theta}}_{n} by minimizing the residuals between the measurements and the predicted values from the trajectory, \min_{{\boldsymbol{\theta}}_{n}}\left(\sum_{k=0}^{K}\|\mathbf{y}_{k}-\mathbf{C}_{k}\mathbf{x}(t_{k})\|^{2}_{\mathbf{R}_{k}}+\sum_{n=0}^{N}\|{\boldsymbol{\theta}}_{n}\|^{2}\right)\\ =\min_{{\boldsymbol{\theta}}_{n}}\left(\sum_{k=0}^{K}\|\mathbf{y}_{k}-\mathbf{C}_{k}\sum_{n=0}^{N}\mathbf{B}_{n}(t){\boldsymbol{\theta}}_{n}\|^{2}_{\mathbf{R}_{k}}+\sum_{n=0}^{N}\|{\boldsymbol{\theta}}_{n}\|^{2}\right), (1.3) where we have substituted in the trajectory from ( 1.1 ). The second term \|{\boldsymbol{\theta}}_{n}\|^{2} regularizes the problem by penalizing the magnitude of the parameters, {\boldsymbol{\theta}}_{n} (i.e., minimum description length prior). Stacking all the quantities up into vectors/matrices, we can write this problem cleanly as \min_{{\boldsymbol{\theta}}}\left(\|\mathbf{y}-\mathbf{C}\mathbf{B}{\boldsymbol{\theta}}\|^{2}_{\mathbf{R}}+\|{\boldsymbol{\theta}}\|^{2}\right), (1.4) The solution to this least-squares problem is the solution to the following linear system of equations: \left(\mathbf{B}^{T}\mathbf{C}^{T}\mathbf{R}^{-1}\mathbf{C}\mathbf{B}+\mathbf{I}\right){\boldsymbol{\theta}}=\mathbf{B}^{T}\mathbf{C}^{T}\mathbf{R}^{-1}\mathbf{y}. (1.5) One challenge with parametric methods is to choose the right basis functions \mathbf{B}_{n}(t) , which can be difficult in practice; too few and the trajectory does not have enough flexibility to fit the data, too many and the solution becomes overfit, although the regularization term can help with this. The state at the measurement times is \mathbf{x}=\mathbf{B}{\boldsymbol{\theta}} and so we can manipulate the linear system of equations above to become \left(\mathbf{C}^{T}\mathbf{R}^{-1}\mathbf{C}+\mathbf{K}^{-1}\right)\mathbf{x}=\mathbf{C}^{T}\mathbf{R}^{-1}\mathbf{y}, (1.6) where \mathbf{K}=\mathbf{B}\mathbf{B}^{T} can now be interpreted as a prior or regularizer term on the state \mathbf{x} . 1 1 1 Note that the \mathbf{K}^{-1}\mathbf{x} term in ( 1.6 ) corresponds exactly to the regularization term on {\boldsymbol{\theta}} in ( 1.4 ). The leap from parametric to nonparametric comes from the observation that we do not actually need the individual basis functions, only their inner products in order to construct \mathbf{K} . As such, we can instead select a kernel function \mathbf{K}(t_{k},t_{\ell}) that defines the inner product between two points in time, and we can write the kernel matrix as \mathbf{K}=\begin{bmatrix}\mathbf{K}(t_{k},t_{\ell})\end{bmatrix}, (1.7)