Real-Time Blind Defocus Deblurring for Earth Observation: The IMAGIN-e Mission Approach
Alejandro D. Mousist · 2025
Read Real-Time Blind Defocus Deblurring for Earth Observation: The IMAGIN-e Mission Approach by Alejandro D. Mousist (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-22128.txt.
Introduction
Alejandro Mousist tackles blurred Earth observation images in a solo 2025 paper on the IMAGIN-e mission, which flies aboard the International Space Station. A mechanical defocus in the camera softens the images the mission captures. His method must work on board the spacecraft, with no clean reference image to learn from and only limited computing power.
The method first estimates the defocus kernel, the shape of the blur, and then trains a restoration model within a GAN framework. On Sentinel-2 images with synthetic blur added, image quality improved sharply, with SSIM rising by 72.47% and PSNR by 25.00%. On real IMAGIN-e images, where no reference exists, perceptual quality scores also improved greatly. The approach is now deployed on the mission itself. It supports tasks such as water body segmentation and contour detection within the limits of onboard computing.
Catalog record
| CREATOR | Alejandro D. Mousist |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-22128
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Real-Time Blind Defocus Deblurring for Earth Observation: The IMAGIN-e Mission Approach Alejandro D. Mousist Abstract This work addresses mechanical defocus in Earth observation images from the IMAGIN-e mission aboard the ISS, proposing a blind deblurring approach adapted to space-based edge computing constraints. Leveraging Sentinel-2 data, our method estimates the defocus kernel and trains a restoration model within a GAN framework, effectively operating without reference images. On Sentinel-2 images with synthetic degradation, SSIM improved by 72.47% and PSNR by 25.00%, confirming the model’s ability to recover lost details when the original clean image is known. On IMAGIN-e, where no reference images exist, perceptual quality metrics indicate a substantial enhancement , with NIQE improving by 60.66% and BRISQUE by 48.38% , validating real-world onboard restoration . The approach is currently deployed aboard the IMAGIN-e mission, demonstrating its practical application in an operational space environment. By efficiently handling high-resolution images under edge computing constraints, the method enables applications such as water body segmentation and contour detection while maintaining processing viability despite resource limitations. † † address: Thales Alenia Space, Tres Cantos, Spain 1 INTRODUCTION AND STATE-OF-THE-ART The IMAGIN-e mission ( I SS M ounted A ccessible G lobal I maging N od -e ) is a space edge computing initiative hosted aboard the International Space Station (ISS). IMAGIN-e operates as a functional demonstration payload with real-world applications for Earth observation. Its primary objective is to evaluate the capabilities and operating modes of onboard edge computing by processing Earth observation data directly within the payload. An optical sensor was integrated to capture images that fuel onboard applications. However, the captured images exhibit significant mechanical defocus characterized by wide dispersion and smoothing (see Fig. 1 ), complicating precise interpretation and hindering the extraction of meaningful insights. Figure 1 : Captured image from the IMAGIN-e payload without further processing, showing significant mechanical blur. In this context, missions like Sentinel-2 from the Copernicus program -which provide multispectral images with higher spatial resolution (GSD) and additional spectral bands— could serve as a reference to estimate the defocus kernel when contrasted with IMAGIN-e RGB images. Nonetheless, IMAGIN-e images are not georeferenced at origin and include uncertainties (e.g., the sensor’s final orientation due to its uncharacterized mechanical and thermoelastic misalignments), posing a significant challenge for restoration in the absence of sharp reference images. Recent studies, such as Popika and Lelechenko [ 1 ] , have used synthetic distortions to train models for satellite image restoration in post-processing. Our approach builds on this idea, adapting it for onboard edge computing to enable real-time correction within the IMAGIN-e payload (see Section 3 ). Traditional deblurring approaches, such as the Wiener filter [ 2 ] or Richardson-Lucy deconvolution [ 3 ] , rely on known blur kernel characteristics, which limits their performance for complex, non-uniform blurs observed in space-based imagery. The advent of deep learning has enabled robust alternative strategies. Early methods employed Convolutional Neural Networks (CNNs) to learn the mapping between blurred and sharp images [ 4 , 5 ] , while GAN‑based approaches like DeblurGAN [ 6 , 7 ] addressed blind deblurring when the blur kernel is unknown. More recently, transformer‑based architectures have emerged as promising candidates for image restoration tasks. For instance, DeblurDiNAT [ 8 ] presents a compact model that leverages dilated neighborhood attention mechanisms to achieve robust generalization and high perceptual fidelity, even in out‑of‑domain settings . In parallel, MIMO‑Uformer [ 9 ] integrates a U‑shaped structure with window‐based attention (W‑MSA), enabling efficient capture of both local and global dependencies with a computational footprint suitable for resource‐constrained environments. Despite these advances, most state‑of‑the‑art approaches assume access to paired blurred‑sharp images or mandate substantial computational resources, rendering them incompatible with the onboard processing constraints of the IMAGIN‑e mission. 1.1 Contribution of This Work Our research contributes a blind deblurring methodology for satellite imagery without reference images that leverages Sentinel-2 data to characterize the defocus kernel. We adapt MIMO-Unet++ [ 10 ] for space-based edge computing, optimizing computational efficiency while preserving restoration quality. Quantitative and qualitative analysis validates our approach, showing significant improvements in structural similarity and edge preservation. Additionally, we provide insights into deep learning-based image enhancement for space-based observation systems with limited resources. This study introduces a generative AI framework for defocus correction within the constraints of the IMAGIN-e mission, enhancing onboard edge computing for Earth observation and enabling the effective utilization of otherwise compromised instruments. 2 Problem Characterization 2.1 Platform and Payload Orientation The payload is hosted on an external platform for payload hosting, mounted on the Columbus module, which is externally mounted on the Columbus module of the International Space Station (ISS). Although its nominal alignment is Earth-facing, the imaging system is not perfectly oriented in the nadir direction; rather, it is directed a few degrees backward relative to the ISS trajectory (see Fig. 2 ). This orientation results in a non-perpendicular incidence angle compared to a purely nadir-pointing configuration, potentially affecting the observation geometry and data acquisition characteristics. Moreover, the payload was installed using a robotic arm, so the exact sensor orientation relative to nadir was not known a priori. Figure 2 : Illustration of the payload orientation on the Bartolomeo platform, showing its backward tilt relative to the ISS trajectory. 2.2 Sensor Data Characteristics The sensor acquires RGB images compressed in JPEG format at a resolution of 2048×1536 pixels. The Ground Sample Distance (GSD) ranges from 37.5m to 41m, depending on altitude variations, ISS pitch fluctuations, and terrain elevation changes. The captured images exhibit significant optical defocus noise, likely due to mechanical miscalibration, while some images also display minor shot noise, though its intensity is considerably lower than that of the defocus blur. Figure 3 provides a spectral comparison between an IMAGIN-e capture and its corresponding Sentinel-2 scene, highlighting the frequency-domain effects of these noise sources. (a) Sentinel-2: Scene and FFT spectrum (b) IMAGIN-e: Scene and FFT spectrum Figure 3 : Comparison of Sentinel-2 and IMAGIN-e images along with their frequency spectra. The Sentinel-2 scene, composed of RGB bands downscaled to a 40m GSD, and its corresponding frequency spectrum are presented in (a). The IMAGIN-e scene and its respective frequency spectrum are shown in (b), illustrating the effects of defocus and alterations in the frequency domain. 2.3 Onboard Deblurring Process The deblurring process is designed to be executed onboard without dedicated acceleration hardware as a critical step in the postprocessing stage of the capture pipeline. It takes place immediately after image acquisition, ensuring that restoration is completed before the images are passed on for further analysis. Third-party applications, which request image captures and process them upon availability, rely on this preprocessing step to enhance data quality and optimize downstream computational tasks. Given the constraints of onboard execution without specialized hardware, the deblurring model must operate efficiently within the platform’s limited computational resources. To meet this challenge, the MIMO-Unet++ model was selected for its high efficiency in generative processing, enabling real-time deblurring with minimal hardware requirements. By integrating this model into the capture pipeline, image restoration is performed onboard without compromising system performance, ensuring that the processed images maintain the necessary fidelity for further analysis. 3 Methodology: Deblurring without reference images 3.1 Model Architecture and Training Strategy To enhance structural features critical for georeferencing,