GeMS: Efficient Gaussian Splatting for Extreme Motion Blur

Gopi Raju Matta, Trisha Reddypalli, Vemunuri Divya Madhuri, Kaushik Mitra · 2025

Read GeMS: Efficient Gaussian Splatting for Extreme Motion Blur by Gopi Raju Matta, Trisha Reddypalli, Vemunuri Divya Madhuri, Kaushik Mitra (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-14682.txt.

Introduction

Gopi Raju Matta and co-authors present GeMS in 2025, a method that rebuilds 3D scenes from badly motion-blurred photos. A popular scene method, Gaussian Splatting, represents a scene as soft 3D blobs fitted to photos. Under extreme blur, rival methods cheat by assuming some sharp photos exist to fix camera positions, which real shoots cannot promise.

Other methods lean on a standard pose tool that fails when features smear. GeMS instead handles severe blur head-on, estimating poses and the scene under blur jointly and with modest computing cost. Tests use scenes with heavy shake. The work matters for drones and handheld capture, where blur is common and reshooting is not an option.

Catalog record

CREATORGopi Raju Matta, Trisha Reddypalli, Vemunuri Divya Madhuri, Kaushik Mitra
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-14682

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

GeMS: Efficient Gaussian Splatting for Extreme Motion Blur Gopi Raju Matta, Trisha Reddypalli, Vemunuri Divya Madhuri, Kaushik Mitra Abstract We introduce GeMS , a framework for 3D Gaussian Splatting designed to handle severely motion-blurred images. State-of-the-art deblurring method for extreme motion blur, such as ExBluRF, as well as Gaussian Splatting-based approaches like Deblur-GS, typically assume access to corresponding sharp images for camera pose estimation and point cloud generation, which is an unrealistic assumption. Additionally, methods relying on COLMAP initialization, such as BAD-Gaussians, fail due to the lack of reliable feature correspondences in cases of severe motion blur. To address these challenges, we propose GeMS , a 3D Gaussian Splatting (3DGS) framework that reconstructs scenes directly from extremely motion-blurred images. GeMS integrates: (1) VGGSfM , a deep learning-based Structure from Motion (SfM) pipeline which estimates camera poses and generates point clouds directly from severely motion-blurred images; (2) 3DGS-MCMC (Markov Chain Monte Carlo) enables robust scene initialization by treating Gaussians as samples from an underlying probability distribution, eliminating heuristic densification and pruning strategies; and (3) Joint optimization of camera motion trajectory and Gaussian parameters which ensures stable and accurate reconstruction. While this pipeline produces reasonable reconstructions, extreme motion blur can still introduce inaccuracies, especially when all input views are severely blurred. To address this, we propose GeMS-E , which integrates a progressive refinement step when event data is available. Specifically, we perform (4) Event-based Double Integral (EDI) deblurring, which first restores deblurred images from motion-blurred inputs using events. These deblurred images are then fed into the GeMS framework, leading to improved pose estimation, point cloud generation, and hence overall reconstruction quality. Both GeMS & GeMS-E achieve state-of-the-art performance on synthetic as well as real-world datasets, demonstrating their effectiveness in handling extreme motion blur. To the best of our knowledge, we are the first to effectively address this motion deblurring problem in extreme blur scenarios within a 3D Gaussian Splatting framework directly from severely motion blurred images. I Introduction Motion blur is a fundamental and unsolved challenge for 3D scene reconstruction and novel view synthesis , especially in real-world scenarios involving high-speed camera motion or low-light conditions . Such conditions are ubiquitous in practical settings ranging from robotics and autonomous vehicles to handheld photography, where capturing sharp images is often impossible. Robust 3D reconstruction from motion-blurred inputs is therefore essential for advancing computer vision systems. Despite recent advances such as Neural Radiance Fields (NeRF) [ 1 ] and 3D Gaussian Splatting (3DGS) [ 2 ] , these methods fundamentally rely on sharp images and accurate camera poses. Traditional Structure-from-Motion (SfM) pipelines like COLMAP [ 3 ] are especially brittle under heavy blur: they depend on reliable feature correspondences for keypoint detection and matching, but blur severely degrades texture information, leading to unreliable matches, poor pose estimation, and ultimately, failure to reconstruct the scene. As a result, there is currently no practical solution for robust 3D reconstruction from extremely motion-blurred images without sharp-image supervision, a critical gap in the literature. Fig. 1 : Overview: GeMS reconstructs sharp 3D scenes directly from extremely motion-blurred images without relying on COLMAP or sharp image supervision. GeMS-E leverages event streams, when available, to further enhance reconstruction quality in the most challenging cases. To address this open problem, we introduce GeMS , a fundamentally new, efficient 3D Gaussian Splatting framework that reconstructs sharp 3D scenes directly from severely blurred inputs. Our approach is not a simple stacking of existing techniques, but a tightly integrated, self-correcting system built on three core innovations: Blur-Robust Initialization with VGGSfM: We replace COLMAP’s brittle feature matching with VGGSfM [ 4 ] , a deep, differentiable SfM framework. VGGSfM’s learned 2D point tracking and end-to-end optimization provide robust, blur-tolerant initialization of camera poses and point clouds, succeeding where all classical and many recent methods fail. This enables downstream modules to operate even in the presence of extreme motion blur. Probabilistic Scene Modeling with 3DGS-MCMC: We incorporate a probabilistic formulation using 3DGS-MCMC [ 5 ] , which treats Gaussians as samples from a scene distribution and uses Markov Chain Monte Carlo (MCMC) sampling to adaptively densify and refine geometry. This avoids the heuristic and brittle densification strategies of prior work, maintaining high reconstruction quality even when the input is sparse or noisy due to extreme motion blur. Joint Trajectory-Geometry Optimization: Because motion blur arises from continuous camera motion during exposure, we jointly optimize camera trajectories (using Bézier curves) and Gaussian parameters with physics-based losses [ 6 ] . This joint optimization is essential for aligning the reconstructed geometry with the actual blur formation process and correcting errors that would otherwise propagate through the pipeline. The synergy of these components is critical: VGGSfM’s robust initialization enables effective probabilistic refinement, while joint optimization ensures global consistency and error correction. Our systematic experiments across a spectrum of blur levels demonstrate that each module is necessary, and their integration yields state-of-the-art performance. GeMS consistently outperforms both traditional and recent methods, especially as blur severity increases. For extreme blur cases where all input views are severely blurred, we further extend our framework to GeMS-E , when event data is available. By incorporating event-based deblurring using the Event-based Double Integral (EDI) model [ 7 ] , GeMS-E leverages high-temporal-resolution event data to recover sharp images. These EDI deblurred images are seamlessly fed to our GeMs framework. This extension outperforms all event-driven baselines in both synthetic and real-world datasets. Comprehensive experiments demonstrate that GeMS and GeMS-E achieve state-of-the-art results, outperforming existing methods in both synthetic and real-world motion-blur scenarios. Our GeMs/GeMS-E results are illustrated in Figure 1 Our key contributions are as follows: • We propose GeMS, an efficient 3D Gaussian Splatting framework that enhances robustness in extreme motion-blurred scenarios by leveraging VGGSfM for camera pose estimation and point cloud generation without sharp image supervision. The framework further incorporates MCMC-based Gaussian initialization and optimization, along with joint optimization of camera poses and Gaussian parameters, to effectively restore sharp scene representations. • When event data is available, GeMS-E integrates event-based deblurring using the EDI model, enabling sharp image reconstruction and novel sharp view synthesis even in extreme motion blur conditions, particularly in cases where all input views are severely blurred. To further support research in this area, we introduce a complementary synthetic event dataset EveGeMS specifically curated for extreme blur scenarios. • We conduct a systematic analysis across multiple blur levels, demonstrating the robustness of both VGGSfM and 3DGS-MCMC modules under severe motion blur. • Through extensive evaluations on both synthetic and real-world datasets, we demonstrate superior performance in deblurring and novel view synthesis, achieving state-of-the-art reconstruction quality while significantly improving computational and memory efficiency. To the best of our knowledge, this is the first work to effectively address the challenge of reconstructing sharp 3D scene from extremely motion blurred images within a 3D Gaussian Splatting framework, without relying on impractical sharp image supervision for pose and point cloud initialization. Fig. 2 : Our Method: GeMS addresses extreme motion blur in 3D Gaussian Splatting framework. GeMS directly optimizes Gaussians on blurred images without requiring COLMAP or sharp supervision, leveraging VGGSfM for robust SfM initialization, 3DGS-MCMC with joint optimization for effective refinement of camera poses and Gaussian parameters. When event data is available, GeMS-E enhances

Read the complete text