RainShift: A Benchmark for Precipitation Downscaling Across Geographies

Paula Harder, Luca Schmidt, Francis Pelletier, Nicole Ludwig, Matthew Chantry, Christian Lessig, Alex Hernandez-Garcia, David Rolnick · 2025

Read RainShift: A Benchmark for Precipitation Downscaling Across Geographies by Paula Harder, Luca Schmidt, Francis Pelletier, Nicole Ludwig, Matthew Chantry, Christian Lessig, Alex Hernandez-Garcia, David Rolnick (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-04930.txt.

Introduction

Paula Harder and seven co-authors released RainShift in two thousand twenty-five, a test set for sharpening rainfall maps. Climate models project change well at large scales but are too coarse for local risk work. Learning-based tools can sharpen their output, yet they often need retraining for each new region.

RainShift checks how well these tools cope when the region changes. Top methods lost a lot of skill when moved between rich and poor data regions. More training area helped, but not enough on its own. Aligning the data across regions did help. The work aims to spread good climate detail more fairly.

Catalog record

CREATORPaula Harder, Luca Schmidt, Francis Pelletier, Nicole Ludwig, Matthew Chantry, Christian Lessig, Alex Hernandez-Garcia, David Rolnick
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-04930

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

RainShift: A Benchmark for Precipitation Downscaling Across Geographies Paula Harder, Luca Schmidt, Francis Pelletier, Nicole Ludwig, Matthew Chantry, Christian Lessig, Alex Hernandez-Garcia, David Rolnick Abstract Earth System Models (ESM) are our main tool for projecting the impacts of climate change. However, running these models at sufficient resolution for local-scale risk-assessments is not computationally feasible. Deep learning-based super-resolution models offer a promising solution to downscale ESM outputs to higher resolutions by learning from data. Yet, due to regional variations in climatic processes, these models typically require retraining for each geographical area—demanding high-resolution observational data, which is unevenly available across the globe. This highlights the need to assess how well these models generalize across geographic regions. To address this, we introduce RainShift, a dataset and benchmark for evaluating downscaling under geographic distribution shifts. We evaluate state-of-the-art downscaling approaches including GANs and diffusion models in generalizing across data gaps between the Global North and Global South. Our findings reveal substantial performance drops in out-of-distribution regions, depending on model and geographic area. While expanding the training domain generally improves generalization, it is insufficient to overcome shifts between geographically distinct regions. We show that addressing these shifts through, for example, data alignment can improve spatial generalization. Our work advances the global applicability of downscaling methods and represents a step toward reducing inequities in access to high-resolution climate information. Introduction High-resolution climate projections are crucial for planning effective responses to extreme weather and climate events. With ongoing climate change, extreme events such as floods, droughts, and heatwaves are expected to become more frequent and severe, threatening infrastructure, agriculture, energy systems, and public health [ 1 ] . Among these, precipitation extremes are particularly destructive, causing floods, landslides, and soil erosion; and are projected to intensify at local scales [ 2 , 3 ] . Yet, accurately modeling precipitation extremes remains difficult due to their high spatial and temporal variability and the non-linear, multi-scale processes involved [ 4 , 5 ] . Earth System Models (ESMs) are the primary tools for understanding the Earth’s climate system and projecting future conditions. By representing physical, chemical, and biological processes, they simulate interactions between climate, the carbon cycle, ecosystems, and human activities. However, the spatial resolution of ESMs—typically around 100 km—is too coarse to resolve small-scale processes. Instead, sub-grid processes are approximated through parameterizations that estimate their average influence. A critical example is deep convection, a major driver of precipitation and a major cause of extreme rainfall, such as flash floods and landslides [ 6 ] . As these processes occur at spatial scales finer than those resolved by ESMs, the models are unable to accurately represent these events [ 4 ] . To address this limitation, downscaling methods are used to increase the spatial resolution of ESM output. There are two families of approaches for downscaling: dynamical downscaling and statistical downscaling. Dynamical downscaling uses a high-resolution regional climate model driven by ESM boundary conditions to simulate fine-scale processes within a limited area of interest. In contrast, statistical downscaling techniques learn empirical relationships between large-scale predictors and local-scale observations from training data and apply these learned relationships to predict localized climate outputs. Compared to dynamical downscaling methods, statistical downscaling methods are more computationally efficient but require high-resolution data for training. Recently, deep learning methods have shown promise for statistical downscaling, leveraging advances in computer vision—particularly super-resolution techniques. Early approaches used convolutional neural networks (CNNs) to learn deterministic mappings from coarse to high resolution [ 7 ] , with architectures such as super-resolution CNNs, U-Nets [ 8 , 9 ] , and ResNets [ 10 , 11 ] being widely applied to climate downscaling. More recent work has shifted toward probabilistic frameworks, leveraging generative models to represent the inherent uncertainty in the downscaling task. Generative adversarial networks (GANs) [ 12 ] , especially conditional generative adversarial networks (cGANs) [ 12 ] and stabilized variants like Wasserstein GANs [ 13 , 14 ] are popular choices for downscaling. More recently, diffusion models have also shown strong performance in modeling complex, high-dimensional distributions [ 15 , 16 , 17 , 18 , 19 ] . Among all climate variables, precipitation is particularly challenging to model and forecast due to its stochastic, high-frequency, spatial and temporal variability. Capturing these fine-scale variations and inherent uncertainties would make generative approaches successful for precipitation downscaling. Unlike dynamical downscaling, statistical downscaling algorithms are not restricted to specific data sources or geographic regions. By construction, statistical downscaling relies on statistical relationships learned during the training phase, allowing it to be applied to new regions at inference time. However, this transferability hinges on the assumption that both predictor and predictand distributions, as well as their statistical relationships, remain stationary across space. In practice, this assumption does not hold due to substantial geographic variability in topography, climatic conditions and processes. For example, precipitation in equatorial regions is strongly driven by convection and, therefore, substantively different than in Europe and North America. Consequently, statistical downscaling models often require retraining for each target region, which relies on the availability of high-resolution observational data. Despite the large amount of weather and climate datasets, high-quality observations are unevenly distributed globally. Ground-based radar and gauge data, essential for training and validating downscaling models, are particularly sparse in many parts of the Global South (see Figure 1 ). Yet, it is also these regions that are often the most exposed and vulnerable to climate change and extreme weather events like heavy rainfall and flooding [ 3 ] . This global imbalance in data availability—coupled with heterogeneous regional climate processes—presents challenges in generalization of deep learning-based downscaling models. To address these challenges, we introduce RainShift, a large-scale global benchmark and dataset designed to evaluate the geographical generalization of deep learning-based downscaling. RainShift defines test scenarios where models are trained on subsets of data-rich regions and tested on regions with scarce availability of high-resolution observations. The dataset is built from ERA5 reanalysis and IMERG satellite precipitation data. We establish baseline results by evaluating state-of-the-art models for probabilistic precipitation downscaling, including GANs and diffusion-based architectures. RainShift is intended to support the development of approaches that generalize to low-data regions, particularly in underrepresented areas such as the Global South. Our main contributions are the following: • We frame the task of downscaling across a geographically varying data distribution, based on a critical gap in Earth system modeling. • We introduce the RainShift benchmark dataset, along with tools for expanding it to new regions, data loaders, training pipelines and evaluation frameworks, within an accessible library to facilitate further research. • We evaluate a variety of state-of-the-art machine learning downscaling models on RainShift and find substantial variation in spatial generalization across models and regions; we show that data alignment techniques can improve performance in cases where generalization is limited by strong geographic distribution shifts. Figure 1: Map of ground-based radar stations. The map shows the availability of precipitation data, with each blue dot representing a station. Coverage is relatively high in the Global North and comparatively low across the Global South. Image from the Tropical Globe radar database [ 20 ] . Results We train a variety of downscaling models in scenarios representing data-abundant regions and then evaluate their performance in data-sparse regions,

Read the complete text