DYffCast : Regional Precipitation Nowcasting Using IMERG Satellite Data. A case study over South America
Daniel Seal, Rossella Arcucci, Salva Rühling-Cachay, César Quilodrán-Casas · 2024
Read DYffCast : Regional Precipitation Nowcasting Using IMERG Satellite Data. A case study over South America by Daniel Seal, Rossella Arcucci, Salva Rühling-Cachay, César Quilodrán-Casas (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-02723.txt.
Introduction
Daniel Seal and co-authors extend in 2024 a generative diffusion frame to rain nowcasting over South America from satellite data. Extreme rain grows more common, and fast short-range forecasts help officials act in time. Satellite rain data feed forecasts up to four hours ahead.
Tweaks to the base frame suit rain data better than the stock form. A new loss joins three error and image quality scores in one aim. Scores for weak, moderate, and heavy rain beat four rival models in the tests. Forecasts stay sharp and stable to two hours on a heavy rain case, with slow decay after.
Catalog record
| CREATOR | Daniel Seal, Rossella Arcucci, Salva Rühling-Cachay, César Quilodrán-Casas |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-02723
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DYffCast : Regional Precipitation Nowcasting Using IMERG Satellite Data. A case study over South America Daniel Seal, Rossella Arcucci, Salva Rühling-Cachay, César Quilodrán-Casas Abstract Climate change is increasing the frequency of extreme precipitation events, making weather disasters such as flooding and landslides more likely. The ability to accurately nowcast precipitation is therefore becoming more critical for safeguarding society by providing immediate, accurate information to decision makers. Motivated by the recent success of generative models at precipitation nowcasting, this paper: extends the DYffusion framework to this task and evaluates its performance at forecasting IMERG satellite precipitation data up to a 4-hour horizon; modifies the DYffusion framework to improve its ability to model rainfall data; and introduces a novel loss function that combines MSE, MAE and the LPIPS perceptual score. In a quantitative evaluation of forecasts up to a 4-hour horizon, the modified DYffusion framework trained with the novel loss outperforms four competitor models. It has the highest CSI scores for weak, moderate, and heavy rain thresholds and retains an LPIPS score < < 0.2 for the entire roll-out, degrading the least as lead-time increases. The proposed nowcasting model demonstrates visually stable and sharp forecasts up to a 2-hour horizon on a heavy rain case study 1 1 1 Code is available at https://github.com/Dseal95/DYffcast . 1 Introduction The ability to accurately nowcast (predict up to 6 hours in advance [ 1 ] ) precipitation, is a vital task that can help mitigate hazards such as flooding or landslides [ 2 ] . Globally, heavy precipitation events are becoming more common due to climate change [ 3 , 4 , 5 , 6 , 7 ] , causing large human displacement, human fatalities [ 8 ] , and economic cost. Accurate precipitation forecasts are therefore becoming more instrumental in providing critical information required for weather-dependent decision making that can safeguard society. The absence of effective precipitation models especially impacts countries that lack access to freely available ground-based radar systems and experience vulnerability in resource management, agriculture, disaster preparedness, and climate adaptation. This work evaluates the applicability of a novel probabilistic, spatio-temporal forecasting framework, DYffusion [ 9 ] , to precipitation nowcasting. This research is motivated by the recent success of generative modelling at this task and, DYffusion’s skilful forecasts over long horizons on Navier-Stokes flows and sea surface temperatures (SST); two systems that exhibit complex dynamics comparable to that of precipitation. In this study, the focus is on how well DYffusion can forecast up to a 4-hour horizon, how well these forecasts compare to deterministic and statistical baselines, and what modifications are required to apply DYffusion to precipitation nowcasting. The contributions to the field of precipitation nowcasting can be summarised as follows: 1. Evaluation of a novel modelling framework, alternative to diffusion-based or Generative Adversarial Network (GAN)-based models, at precipitation nowcasting. 2. A focus on countries lacking freely available ground-based radar and most impacted by global warming. 3. Introduction of a novel loss function that demonstrates how guiding a pixel-wise distance-based loss with a perceptual loss improves a model’s ability to learn small-scale features in imbalanced datasets such as precipitation. 2 Methods 2.1 Data This research uses the publicly available satellite precipitation product, IMERG. In particular, it uses the latest version (V07B [ 10 ] ) of the half-hourly, Early Run product with a 0.1^{\text{o}} spatial resolution and precipitation rates in \text{mm}\cdot\text{h}^{-1} . The dataset is created from four 128 \times 128 grid boxes that cover the South American countries: Colombia, Ecuador and Per ú . These are regions that are susceptible to increased flooding and have limited availability of weather radar 2 2 2 According to the World Meteorological Organisation’s (WMO) radar database, South America has roughly 1 / 4 of North America’s or Europe’s radar [ 11 ] . . The four 128 \times 128 grid boxes are stacked into dimensions: (N, S, C, H, W) where N is the number of samples, S is the sequence length (input and target) and C is the number of channels (1 for IMERG). The data is preprocessed to [0,1] using linear normalisation, \text{log}(1+X) transform and min-max normalisation. For this research, a 4-hour horizon or 8 \times 1 \times 128 \times 128 images, was chosen to match the latency of the Early-Run IMERG product and avoid any discontinuity of real-time data. 2.2 Modelling 2.2.1 DYffusion Framework The DYffusion framework is outlined in Figure 1 . It consists of an Interpolator network, \mathrm{I}_{\phi} and a Forecastor network, F_{\theta} . Training . \mathrm{I}_{\phi} is trained to interpolate any timestep of the sequence x_{t+i_{n}} , given the initial and final states, x_{0} and x_{t+h} , respectively. F_{\theta} is trained to forecast the horizon x_{t+h} given the initial condition x_{0} and an intermediate state x_{t+i_{n}} . This two-stage training has a constant memory footprint as a function of h , only requiring x_{0} and x_{t+h} (plus x_{t+i_{n}} during the Interpolator training). Inference . Given an initial condition, x_{0} , the entire sequence x=[x_{t+i_{n}}]_{n=1}^{h} is generated over N (or h ) auto-regressive steps. At step s = 0 ( n = s + 1), F_{\theta} predicts the horizon x_{t+h}^{s=0} using only x_{0} . \mathrm{I}_{\phi} then interpolates x_{t+i_{1}} using x_{0} and x_{t+h}^{s=0} . At the next step ( s = 1 ), F_{\theta} predicts the horizon again x_{t+h}^{s=1} , using x_{0} and x_{t+i_{1}} . x_{t+h}^{s=1} and x_{0} are then used to interpolate, x_{t+i_{2}} . This process is repeated until F_{\theta} predicts x_{t+h}^{s=N-1} ( N times), using the nearest intermediate value, x_{t+i_{N-1}} . This iterative process is analogous to the iterative denoising in standard diffusion models and underpins the time-coupled, DYnamics informed nature of the DYffusion framework. The final forecast is the mean of an ensemble of X members. The probabilistic nature of DYffusion occurs through Monte Carlo dropout. \mathrm{I}_{\phi} is trained with dropout rates that are enabled during the training (and inference) of F_{\theta} . Enabling dropout during training is analogous to \mathrm{I}_{\phi} interpolating x_{t+i_{n}} by sampling it from the conditional probability distribution P(x_{t+i_{n}}|x_{0},x_{t+h}) . Figure 1: An illustration of DYffusion sampling: DYffusion forecasts a sequence of N (or h ) timesteps x_{t+i_{1}} , x_{t+i_{2}} , … , x_{t+h} given the initial condition x_{0} . x_{t+h} is forecasted at each step using x_{0} and the nearest intermediate value x_{t+i_{n}} . 2.2.2 DYffusion Key Modifications For the IMERG dataset, the SST U-Net backbone from DYffusion and parts of the training framework were modified to model the rainfall data. The following key modifications were made: 1. Loss Function. Replaced the L1 loss with a novel loss function (referred to as LCB), combining the Learned Perceptual Image Patch Similarity (LPIPS) [ 12 ] score with the class-weighted Mean Squared Error (MSE) and Mean Absolute Error (MAE) loss proposed in [ 13 ] (referred to as CBLoss in [ 14 ] ). LCB was constructed as follows: \text{LCB}=(1-\alpha)\cdot\text{LPIPS}+\alpha\cdot\text{CBLoss}(\beta) (1) Based on experimental results during Interpolator training, \alpha was set to 0.6, optimising for MSE, LPIPS and Critical Success Index (CSI) at varying thresholds. This value slightly biases the CBLoss towards spatial accuracy, while the perceptual component prevents large-scale features from dominating and improves image detail. Lower \alpha values ( < 0.6) led to background artefacts and magnitude errors. For the CBLoss, the \beta scaling