PoseFM: Relative Camera Pose Estimation Through Flow Matching

Dominik Kuczkowski & Laura Ruotsalainen · 2026

Read PoseFM: Relative Camera Pose Estimation Through Flow Matching by Dominik Kuczkowski & Laura Ruotsalainen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-22350.txt.

Introduction

Kuczkowski and Ruotsalainen recast monocular visual odometry, camera motion from a single camera, as a generative task. Most deep methods regress a single motion estimate, giving no sense of uncertainty. Their PoseFM framework uses flow matching to model motion as a distribution, turning noise into pose predictions. That design gives uncertainty estimates and robust inference in poor structure or lighting. On TartanAir, KITTI and TUM-RGBD it posts the lowest trajectory error on some sequences and ranks with the best methods.

Catalog record

CREATORDominik Kuczkowski & Laura Ruotsalainen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29977
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.22350

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PoseFM: Relative Camera Pose Estimation Through Flow Matching Dominik Kuczkowski & Laura Ruotsalainen Abstract Monocular visual odometry (VO) is a fundamental computer vision problem with applications in autonomous navigation, augmented reality and more. While deep learning-based methods have recently shown superior accuracy compared to traditional geometric pipelines, particularly in environments where handcrafted features struggle due to poor structure or lighting conditions, most rely on deterministic regression, which lacks the uncertainty awareness required for robust applications. We propose PoseFM, the first framework to reformulate monocular frame-to-frame VO as a generative task using Flow Matching (FM). By leveraging FM, we model camera motion as a distribution rather than a point estimate, learning to transform noise into realistic pose predictions via continuous-time ODEs. This approach provides a principled mechanism for uncertainty estimation and enables robust motion inference under challenging visual conditions. In our evaluations, PoseFM achieves strong performance on TartanAir, KITTI and TUM-RGBD benchmarks, achieving the lowest absolute trajectory error (ATE) on some of the trajectories and overall being competitive with the best frame-to-frame monocular VO methods. Code and model checkpoints will be made available at https://github.com/helsinki-sda-group/posefm. K eywords Computer Vision \cdot Visual Odometry \cdot Flow Matching 1 Introduction Figure 1: Overview of the PoseFM framework. (a) PoseFM Pipeline : The pipeline consists of an optical flow estimator f_{\phi} and parametrized vector field network. The output of the pipeline is a point estimate of the vector field \hat{u}_{\tau} . (b) Inference Procedure : Given an image pair (I_{t},I_{t+1}) , we sample a pose X_{0} from the initial distribution and numerically integrate the learned vector field using an ODE solver to recover the final camera motion. (c) Model Architecture : A detailed view of the network parameterizing u_{\tau} . Monocular visual odometry (VO) is a fundamental computer vision (CV) problem, with many applications in robotics, autonomous navigation, and augmented reality. Despite years of research, VO still remains challenging , due to issues such as textureless surfaces, motion blur, dynamics scenes, or changing illumination. Existing VO methods can be broadly divided into geometry-based and learning-based. Geometry-based methods [ 1 , 2 ] rely on explicit geometric constraints, such as epipolar geometry and photometric consistency, and typically offer strong interpretability and generalization under well-modeled assumptions. However, they often degrade in performance when these assumptions are violated. Learning-based methods [ 19 , 24 , 3 , 22 , 9 ] on the other hand, leverage deep neural networks to learn motion estimation directly from data. They often use geometric or photometric constraints implicitly or as training objectives, offering improved robustness in challenging scenarios at the cost of reduced interpretability and, in some cases, limited generalization beyond the training distribution. While optical flow based methods have achieved strong performance in visual odometry, they are particularly prone to failure in challenging scenarios, compared to feature-based approaches [ 11 ] . However, feature-based approaches use sparse correspondences while optical flow provides dense pixel-level motion cues that encode local geometric constraints between frames and therefore integrates naturally to deep learning frameworks. Recently, generative methods—particularly diffusion models [ 8 ] and flow matching (FM) [ 10 ] —have demonstrated remarkable success across a wide range of computer vision problems. In domains such as image synthesis, depth estimation, and structure-from-motion, diffusion-based approaches have been shown to effectively model complex, high-dimensional distributions and estimate global scene properties by iteratively refining noisy predictions [ 13 ] , [ 5 ] , [ 21 ] . Despite this progress, the application of diffusion-based or flow-based generative models to VO remains largely unexplored. To the best of our knowledge, prior work has not investigated diffusion models or FM formulations for estimating camera motion in a VO setting. This gap is notable because VO is inherently affected by ambiguity, perceptual aliasing, and accumulated uncertainty, particularly in challenging visual conditions. In such settings, modeling a distribution over possible motions, rather than committing to a single deterministic estimate via regression, offers clear advantages. Therefore, in this work, we explore a FM-based generative perspective on VO. FM provides an alternative to diffusion modeling that learns continuous probability flows between simple base distributions and complex target distributions, enabling efficient training and sampling. By framing VO as a generative modeling problem over camera motions, we aim to leverage the strengths of flow-based methods—such as stability, flexibility, and principled uncertainty modeling—while addressing the unique challenges of motion estimation from visual data. Our contributions are as follows: • The PoseFM Framework: We introduce the first formulation of monocular VO as a generative task using Flow Matching. Our method integrates optical flow to provide dense visual guidance and employs flow matching to overcome the aforementioned challenges by inferring the global camera motion. • We provide an evaluation of the generative modeling based approach for VO and show its competitiveness with regression-based methods, while providing inherent uncertainty estimation. 2 Related Work Learning-based Visual Odometry Traditional monocular VO approaches rely on explicit geometric constraints and estimate camera motion through nonlinear optimization. [ 1 , 2 ] . While the traditional approaches offer good generalizability, they often fail in challenging scenarios with dynamic cameras creating motion blur, moving objects, low lighting or feature-sparsity. Learning-based approaches try to solve these issues, by improving robustness of monocular VO. Among them, we can differentiate between methods that rely on learned global optimization [ 19 , 22 , 18 ] and frame-to-frame methods, that directly regress a camera pose between frames [ 24 , 9 , 14 ] . The methods based on learned optimization offer improved global consistency of estimated trajectories, but at the cost of relying on more complex pipelines, which makes them harder to train. Among the frame-to-frame methods, TartanVO [ 24 ] was the first to propose a learning-based model generalizable to many datasets. DytanVO [ 14 ] extended TartanVO with motion segmentation to improve performance in dynamic scenes. CUVO [ 9 ] was built on a similar foundation as the two previous methods, predicting the camera pose based on an optical flow estimate. The novelty in CUVO, was the introduction of Context Attention and uncertainty awareness in the pose predictor. Our method falls into the frame-to-frame category with optical flow as the basis of camera pose estimation. Generative Models in Computer Vision Generative models, particularly diffusion models [ 7 , 15 ] and flow matching based methods [ 10 ] , have recently become a widely adopted paradigm in computer vision. Both approaches learn to transform samples from a simple base distribution into samples from a complex data distribution through an iterative refinement process. Their rise in popularity is largely driven by remarkable success in image generation [ 7 , 12 ] , but they have since been extended to a variety of geometry-related tasks. While diffusion-based methods such as PoseDiffusion [ 21 ] and RayDiffusion [ 30 ] demonstrate strong performance for global pose estimation in Structure-from-Motion (SfM), these methods operate in multi-view, batch setting where iterative sampling is advantageous. In contrast, VO is a frame-to-frame problem that requires efficient and temporally consistent motion estimation under real-time constraints. FM learns deterministic transport between distributions via continuous-time velocity fields and provides a computationally efficient and geometrically aligned alternative. FM has also been successfully applied to geometric prediction problems,

Read the complete text