Image as an IMU: Estimating Camera Motion from a Single Motion-Blurred Image

Jerred Chen, Ronald Clark · 2025

Read Image as an IMU: Estimating Camera Motion from a Single Motion-Blurred Image by Jerred Chen, Ronald Clark (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-17358.txt.

Introduction

Jerred Chen and Ronald Clark turn motion blur, the smear in fast-moving shots, into a clue for how the camera moved. Their paper appeared in two thousand twenty-five. Robots and headsets often lose track of position when the camera swings fast. Standard pose tools fail on blurred frames.

From one blurred image, their model predicts a full flow field and a depth map. A least-squares step then turns those outputs into the camera's speed and spin. The result acts like a reading from a motion sensor chip. To train the model, they built a large set of shots with fake blur drawn from real indoor scans. Fine-tuning on real footage sharpened it further. On real tests it beat leading rivals at gauging both swing and drift.

Catalog record

CREATORJerred Chen, Ronald Clark
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-17358

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Image as an IMU: Estimating Camera Motion from a Single Motion-Blurred Image Jerred Chen, Ronald Clark Abstract In many robotics and VR/AR applications, fast camera motions cause a high level of motion blur, causing existing camera pose estimation methods to fail. In this work, we propose a novel framework that leverages motion blur as a rich cue for motion estimation rather than treating it as an unwanted artifact. Our approach works by predicting a dense motion flow field and a monocular depth map directly from a single motion-blurred image. We then recover the instantaneous camera velocity by solving a linear least squares problem under the small motion assumption. In essence, our method produces an IMU-like measurement that robustly captures fast and aggressive camera movements. To train our model, we construct a large-scale dataset with realistic synthetic motion blur derived from ScanNet++v2 and further refine our model by training end-to-end on real data using our fully differentiable pipeline. Extensive evaluations on real-world benchmarks demonstrate that our method achieves state-of-the-art angular and translational velocity estimates, outperforming current methods like MASt3R and COLMAP. 1 Introduction Given a sequence of images, visual odometry (VO) and Structure from Motion (SfM) methods have advanced to the point where they can accurately estimate camera poses even under moderately challenging conditions. However, these methods assume that the camera remains largely stationary during exposure, allowing each image to be treated as a snapshot of the scene that can be matched against subsequent images to compute relative camera poses. This assumption, however, ignores the continuous nature of camera motion and becomes especially problematic during fast movements where motion blur can severely degrade accuracy. Conventional approaches either discard motion-blurred frames or use inertial measurement units (IMUs) to improve robustness against blur. However, using IMUs introduces additional challenges such as sensor synchronization and drift. In this work, we therefore take a fundamentally different approach: rather than treating motion blur as an unwanted artifact, we exploit it as a rich source of information about the camera’s motion (see Figure 1 ). Figure 1 : Existing methods rely on establishing correspondences between multiple frames to estimate inter-frame camera motion (a). This leads to failures during fast motion with lots of blur. We propose a method that can estimate intra-frame camera motion from a single image (b), making our method robust to aggressive motions. Our key observation is that the extent and direction of motion blur provide direct cues about the camera’s motion during an exposure. Building on this idea, we propose a model that, using just the motion-blur in an image, can estimate the relative motion that the camera undergoes during the exposure. Our model works in two stages: first we predict the motion flow field and a monocular depth map, then we recover the relative pose of the camera by solving a linear least squares system. Notably, our method does not require any explicit deblurring process, and with a known exposure time, it yields an instantaneous rotational and translation velocity estimate that can be interpreted as an IMU-like measurement. Since no existing dataset includes all the necessary data to train such a model, we construct our own dataset using a subset of ScanNet++v2 [ 58 ] and show how we obtain realistic motion blur that allows for generalization to in-the-wild images. Furthermore, the fully differentiable nature of our method enables us to refine our model using real-world motion-blurred images, even when ground-truth flows and depths are not available for training. We evaluate our model with angular and translational velocity estimates on real-world motion blurred images to test the generalization capabilities of our model. Our method runs in real-time at 30 FPS and obtains significantly more accurate velocity estimates compared to the existing state of the art methods. In summary, our contributions are as follows: 1. A new approach for estimating camera motion that uses the blur present in a frame to provide extremely robust and accurate relative pose estimates 2. A pipeline for synthesizing the data needed to train the model (i.e. blurry images with ground-truth motion) from standard SLAM datasets 3. An evaluation of our method on real-world sequences, showing our method obtains state of the art results and is robust to aggressive camera motion The rest of the paper is as follows. We first discuss relevant works to our method in Section 2 . We then introduce preliminary information and provide a high-level intuition of our method in Section 3 . In Section 4 , we go into technical details about our method. Section 5 shows the dataset construction process. We evaluate our results against baseline methods in Section 6 . 2 Related Works Motion from Blur. This work is related to motion from blur methods that attempt to extract pixel-wise flow from a single blurred image. Early approaches assumed spatially invariant blur, with [ 7 ] using a linear motion model to extract the flow and [ 35 ] using a frequency domain approach. Later methods extended these where [ 10 ] first extracts an alpha channel matte and uses the edge gradients to estimate object motion, [ 41 ] builds on [ 35 ] to use the color channels directly while [ 14 ] proposed a variational technique and [ 1 ] a learned approach. Our focus, however, is not on estimating the flow field but rather the actual camera motion. Several works aim to recover either rotational or translational camera motion directly from a blurred image. A seminal work in this direction is [ 21 ] which proposes to estimate the camera rotation directly from a single motion-blurred image by searching for edgels to estimate the rotation axis, which is used to help compute the blur length and subsequently the rotation. [ 24 ] [ 3 ] also estimate the camera rotation with assuming negligible translations, while [ 2 ] [ 8 ] estimate exclusively linear motion. In contrast, we estimate the full 6DoF velocity. Closer to our method, [ 62 ] proposes a neural network to estimate the full relative pose from a single motion-blurred image but directly regresses the pose parameters and requires a clean depth map as input. Our method estimates depths to retrieve the metric-scaled motion. Similarly, [ 22 ] , [ 27 ] , and [ 34 ] recover 3D geometry in motion-blurred scenes. [ 27 ] is the most relevant, being a visual odometry method which computes the homography during exposure time between a sharp and potentially blurry frame. However, this depend on two images and an off-the-shelf deblurring method, whereas we do not require any deblurring for a single input image. Deblurring. An adjacent line of work is deblurring, which aims to recover a sharp image given a blurred one. [ 17 ] [ 33 ] [ 32 ] use classical energy minimization frameworks to obtain depth and camera pose estimates, similarly to our method, in addition to the deblurred image. However, compared to deep-learned deblurring methods [ 60 ] , classical methods are frequently slower during test time and underperform in more general conditions. Therefore, we do not benchmark against such methods given the restrictive assumptions made and significant runtime slowdown. Several deep deblurring methods [ 45 ] [ 15

Read the complete text