Conditional Diffusion Models for Global Precipitation Map Inpainting

2025

Read Conditional Diffusion Models for Global Precipitation Map Inpainting (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-20478.txt.

Introduction

Kishikawa, Muto, and Kotsuki use conditional diffusion models to fill gaps in global rainfall maps in a 2025 paper. Satellite rainfall products miss large regions because microwave sensors pass only at certain times. Current filling methods often leave spatial breaks in the maps.

The task is framed as video inpainting. A 3D network with a condition encoder rebuilds full maps using infrared images, location grids, and time inputs. Training used hourly reanalysis data, with fake satellite masks applied to mimic real gaps. On a held-out year, the method produced maps that were more consistent in space and time than standard methods. The authors see promise for global rainfall monitoring.

Catalog record

YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-20478

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Conditional Diffusion Models for Global Precipitation Map Inpainting Abstract Incomplete satellite-based precipitation presents a significant challenge in global monitoring. For example, the Global Satellite Mapping of Precipitation (GSMaP) from JAXA suffers from substantial missing regions due to the orbital characteristics of satellites that have microwave sensors, and its current interpolation methods often result in spatial discontinuities. In this study, we formulate the completion of the precipitation map as a video inpainting task and propose a machine learning approach based on conditional diffusion models. Our method employs a 3D U-Net with a 3D condition encoder to reconstruct complete precipitation maps by leveraging spatio-temporal information from infrared images, latitude-longitude grids, and physical time inputs. Training was carried out on ERA5 hourly precipitation data from 2020 to 2023. We generated a pseudo-GSMaP dataset by randomly applying GSMaP masks to ERA maps. Performance was evaluated for the calendar year 2024, and our approach produces more spatio-temporally consistent inpainted precipitation maps compared to conventional methods. These results indicate the potential to improve global precipitation monitoring using the conditional diffusion models. † † journal: JGR: Machine Learning and Computation † † authors: Daiko Kishikawa, Yuka Muto, Shunji Kotsuki † † corresponding: Daiko Kishikawa, [email protected] † † corresponding: Shunji Kotsuki, [email protected] Center for Environmental Remote Sensing, Chiba University Institute for Advanced Academic Research, Chiba University Research Institute of Disaster Medicine, Chiba University Data Assimilation Research Team, RIKEN Center for Computational Science 1-33 Yayoi-cho, Inage-ku, Chiba-shi, Chiba, Japan, 263-8522 7-1-26 Minatojima-minami-machi, Chuo-ku, Kobe-Shi, Hyogo, Japanm 650-0047 keypoints High-fidelity global precipitation maps are in high demand, but polar-orbiting satellite cause spatio-temporal gaps. We propose a diffusion model-based inpainting method using a 3D U-Net to obtain spatio-temporal consistency. Our method achieves higher spatio-temporal consistency than conventional and deep learning approaches in filling unobserved regions. Plain Language Summary Current global precipitation maps use data from multiple satellites to estimate rainfall amounts. However, polar-orbiting satellites cannot simultaneously observe the entire Earth, which means that large portions of the precipitation maps lack observations. Current methods fill in these missing areas by estimating values from the previous and next hours’ observations. Unfortunately, these methods mainly focus on time-based consistency and sometimes generate predictions that are not smoothly connected to observed areas, resulting in noticeable gaps. To overcome this issue, we developed a new machine learning approach. Instead of relying on manually designed formulas, our method treats precipitation map sequences as video-like data and repairs missing sections by using information from both nearby time frames and the surrounding regions with additional information. We built a model that generates three-dimensional data and learns to complete precipitation maps using additional inputs such as infrared images, geographic coordinates, and time information. We trained our model to complete hourly precipitation data from 2020 to 2023 by simulating the missing regions using actual satellite observations. The results show that our model produces smoother, more consistent precipitation maps that effectively fill in the missing areas compared to conventional methods. 1 Introduction 1.1 Background and Motivation In recent years, high-accuracy and high-temporal-resolution global precipitation maps has become essential for mitigating damage from extreme weather, supporting water management activities (e.g., dam operations), and informing public policy decisions at both governmental and local levels. Thus, improving global precipitation maps have become an increasingly important topic in current research. One notable example is the Global Satellite Mapping of Precipitation (GSMaP) Kubota et al. (2020) produced by the Japan Aerospace Exploration Agency (JAXA). GSMaP uses microwave observations from multiple polar-orbiting satellites to estimate global precipitation. However, due to orbital limitations, it is practically impossible to observe the entire globe simultaneously. Another example is the Integrated Multi-satellite Retrievals for GPM (IMERG) Huffman et al. (2014) produced by the National Aeronautics and Space Administration (NASA). IMERG also relies on microwave observations from polar-orbiting satellites, resulting in similar spatio-temporal gaps due to orbital constraints. To make these products operationally usable, large spatio-temporal gaps must be filled. For that purpose, conventional inpainting methods are applied using transformation formulas based on adjacent temporal observations to achieve temporal consistency both in GSMaP and IMERG. However, spatial consistency is not prioritized, often resulting in inconsistencies between observed and inpainted regions. Hence, achieving both spatial and temporal consistency remains a significant challenge in satellite-based global precipitation mapping. 1.2 Conventional and Deep Learning Approaches Over the past decades, a variety of methods — from classical statistical approaches to modern deep learning techniques — have been proposed to tackle this inpainting problem. Conventional methods can be divided into two categories: spatial methods and data assimilation methods. Conventional techniques for inpainting precipitation maps include methods such as Inverse Distance Weighting (IDW) and Kriging Cressie (1990) . These methods estimate values in unobserved regions by leveraging data from neighboring locations. Advanced Kriging-based techniques, such as co-kriging and kriging with external drift, have demonstrated superior predictive performance compared to simpler approaches like IDW Caloiero et al. (2021) . However, purely spatial methods often produce overly smooth and physically unrealistic precipitation fields Geiss & Hardin (2021) . Other approaches based on Markov Random Fields (MRF) Cheng et al. (2014) and the Total Variation (TV) method Yang et al. (2009) rely on specific assumptions about the underlying image statistics, which may limit their effectiveness for large unobserved regions. Data assimilation represents another approach to produce precipitation analyses by combining predictions from numerical weather prediction (NWP) models with observations from multiple sensors, including satellite precipitation data Kotsuki et al. (2017) . However, data assimilation approaches are limited by the horizontal resolution of NWP models, making it difficult to generate high-resolution precipitation data. Recent advances in deep learning have provided a promising alternative. Convolutional Neural Networks (CNNs) and encoder–decoder architectures, such as U-Net, can learn the structural characteristics of precipitation fields through a purely data-driven approach. For example, Geiss and Hardin Geiss & Hardin (2021) demonstrated that a CNN trained on radar images could effectively inpaint missing regions that radar could not scan. Both pure CNN models and Generative Adversarial Networks (GANs) Goodfellow et al. (2014) have been reported to outperform conventional methods such as linear interpolation and Laplace equation-based approaches. In particular, GAN-based inpainting combines adversarial loss with pixel-level error measures to enable high-fidelity reconstruction. Furthermore, recent models based on U-Net Ronneberger et al. (2015) have been shown to substantially reduce errors in radar blind zones (i.e., near-surface gaps in satellite radar observations), with the incorporation of meteorological features as conditional inputs reducing the mean absolute error (MAE) by an additional 6% King et al. (2024) . 1.3 Our Diffusion Model Approach Our main contributions are as follows: • Applying diffusion models to inpainting problem of satellite-derived global precipitation maps • Employing a 3D U-Net to capture spatio-temporal consistency • Incorporating multi-modal conditions to improve prediction accuracy and quality In this work, we propose an inpainting method for satellite-based precipitation maps based on diffusion models — a rapidly advancing class of generative models known for stable training and high-quality generation. Unlike conventional approaches, our method employs a three-dimensional U-Net architecture with 3D convolutions to simultaneously capture the spatial patterns and temporal dynamics of precipitation fields. For training, we utilize the ERA5 hourly precipitation dataset, which provides complete precipitation maps without missing regions, and simulate unobserved areas by applying satellite observation masks derived

Read the complete text