Skillful Nowcasting of Convective Clouds With a Cascade Diffusion Model

Haoming Chen, Xiaohui Zhong, Qiang Zhai, Xiaomeng Li, Ying Wa CHAN, Pak Wai CHAN, Yuanyuan Huang, Hao Li, Xiaoming Shi · 2025

Read Skillful Nowcasting of Convective Clouds With a Cascade Diffusion Model by Haoming Chen, Xiaohui Zhong, Qiang Zhai, Xiaomeng Li, Ying Wa CHAN, Pak Wai CHAN, Yuanyuan Huang, Hao Li, Xiaoming Shi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-10957.txt.

Introduction

Haoming Chen and eight co-authors forecast convective clouds from satellite images with a diffusion model designed to stay sharp and physical. Nowcasting matters most where ground radar is scarce, including many developing regions. Video prediction models tend to blur exactly the storm structures forecasters care about.

Their system, SATcast, stacks a cascade of diffusion stages and takes two kinds of input: recent satellite observations and physical fields predicted by the FuXi weather model. Across multiple metrics it beat conventional methods, and ablations credited both the multimodal inputs and the cascade design. Skill held up as far as twenty-four hours ahead, an unusually long horizon for cloud nowcasting. The authors pitch it for operational use.

Catalog record

CREATORHaoming Chen, Xiaohui Zhong, Qiang Zhai, Xiaomeng Li, Ying Wa CHAN, Pak Wai CHAN, Yuanyuan Huang, Hao Li, Xiaoming Shi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-10957

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Skillful Nowcasting of Convective Clouds With a Cascade Diffusion Model Haoming Chen, Xiaohui Zhong, Qiang Zhai, Xiaomeng Li, Ying Wa CHAN, Pak Wai CHAN, Yuanyuan Huang, Hao Li, Xiaoming Shi Abstract Accurate nowcasting of convective clouds from satellite imagery is essential for mitigating the impacts of meteorological disasters, especially in developing countries and remote regions with limited ground-based observations. Recent advances in deep learning have shown promise in video prediction; however, existing models frequently produce blurry results and exhibit reduced accuracy when forecasting physical fields. Here, we introduce SATcast, a diffusion model that leverages a cascade architecture and multimodal inputs for nowcasting cloud fields in satellite imagery. SATcast incorporates physical fields predicted by FuXi, a deep-learning weather model, alongside past satellite observations as conditional inputs to generate high-quality future cloud fields. Through comprehensive evaluation, SATcast outperforms conventional methods on multiple metrics, demonstrating its superior accuracy and robustness. Ablation studies underscore the importance of its multimodal design and the cascade architecture in achieving reliable predictions. Notably, SATcast maintains predictive skill for up to 24 hours, underscoring its potential for operational nowcasting applications. keywords nowcasting, satellite, deep learning, FuXi, cascade † † equal-contributors: These authors contributed equally to this work. † † equal-contributors: These authors contributed equally to this work. 1 Introduction Small-scale deep convection and mesoscale convective systems (MCSs) frequently lead to severe meteorological disasters, such as flooding, wind gusts, and turbulence Chen et al. (2024) ; Guo et al. (2022) . The United Nation’s "Early Warnings for All" initiative aims to protect global populations from weather hazards by enhancing early warning systems capable of predicting the timing, location, and intensity of such convective events Organization (2023) . Satellite observations play an indispensable role in monitoring the formation and evolution of convective systems, offering significantly broader spatial coverage than traditional radar systems. This advantage is particularly critical in regions with limited radar infrastructure, such as over oceans and in developing countries, where advanced radar networks are sparse or nonexistent Schmit et al. (2017) . To address these gaps, satellite-based nowcasting techniques have been developed. For example, the World Meteorological Organization (WMO) recently issued guidelines for satellite-based nowcasting in Africa, emphasizing its importance in areas with limited observational resources Organization (2023) . Traditional methods for satellite and radar-based nowcasting, such as the Lucas-Kanade optical flow algorithm, efficiently track MCS movement but struggle with capturing intensity variations due to assumptions of brightness constancy Baker and Matthews (2004) . Similarly, systems such as the Short-Term Ensemble Prediction System offer uncertainty estimates but often smooth out small-scale convective details, since it uses stochastic noise to model the evolution of small-scale convection Smith et al. (2024) . These limitations have catalyzed the adoption of deep learning models, which do not have these assumptions and excel in producing more reliable forecasts Zhang et al. (2023) ; Chen et al. (2023) ; Bi et al. (2023) . The evolution of deep learning in nowcasting has yielded promising advances, although certain challenges persist. Forecast horizons for satellite or radar-based predictions rarely exceed six hours due to cumulative errors, and deep learning models often produce blurred outputs Kumar et al. (2020) ; Tran and Song (2019) ; Ehsani et al. (2021) ; Wei et al. (2024) . For instance, Shi et al. Shi et al. (2015) introduced convolutional Long Short Term Memory (ConvLSTM) networks for radar image time series forecasting, demonstrating superior performance in precipitation nowcasting with lead times of up to 2 hours. More recently, DaYu, which integrates transformer Vaswani (2017) and residual convolution layers, has extended the skillful forecast lead time for satellite-based nowcasting to 12 hours Wei et al. (2024) . However, its outputs become overly smooth after 3 hours, particularly in representing typhoon structure and the eye’s position (see Figures 3 and 4). Wang et al. Wang et al. (2023) used Generative Adversarial Networks (GAN) Goodfellow et al. (2020) to generate high-quality radar images successfully,achieving skillful forecast up to 2 hours. Kim et al. Kim et al. (2024) incorporated European Centre for Medium-Range Weather Forecasts Reanalysis version 5 (ERA5) data into a deep learning model, improving precipitation forecasts within six hours compared to those generated using only radar images inputs. However, the production schedule of ERA5 data is not compatible with the requirements of nowcasting, and they Kim et al. (2024) suggest that numerical weather prediction (NWP) data could serve as a viable alternative. Despite this, NWP models also face significant challenges including high computational costs associated with running NWP models, and uncertainties in parameterization schemes for gray-zone convection, which limit their ability to accurately forecast convective activities Trier et al. (2014) ; Shi and Wang (2022) . As a result, weather data-driven nowcasting techniques that operate independently of NWP models offer a more cost-effective and practical solution Chen et al. (2023) ; Bi et al. (2023) . Physical variables generated by either deep learning or NWP models exhibit significant differences in information content compared to radar and satellite observations, making them multimodal data sources. The integration of multimodal data is a key method for enhancing model performance, and further research is needed on how to effectively process and combine these diverse data types in deep learning models for atmospheric science. For example, the Contrastive Language-Image Pretraining model employs transformer and convolutional layers to encode text and images, enabling a more flexible classifier that serves as a foundation for subsequent multimodal models Radford et al. (2021) . In atmospheric science, MetNet-3 Andrychowicz et al. (2023) employs different ResNet blocks Huang et al. (2016) to process multi-resolution data, thereby extending skillful forecast lead times up to 24 hours. Wang et al. Rui Wang (2024) uses a cross-attention module to merge NWP results and radar images, extending precipitation forecasts up to six hours. Therefore, integrating physical variables and satellite imagery into deep learning models is beneficial, but bridging the gap between these data types remains challenging. In this study, we introduce SATcast for predicting convective clouds observed by the FengYun-4A (FY-4A) geostationary satellite. Diffusion models, which are state-of-the-art in text-to-image and video generation in computer vision Ho et al. (2020) ; Dhariwal and Nichol (2021) , are employed for this purpose. The FY-4A satellite plays a crucial role in monitoring weather patterns, climate variations, environmental changes, and natural disasters across East Asia Yang et al. (2017) . Our physical-driven model innovatively incorporates atmospheric physical conditions predicted by FuXi Chen et al. (2023) , which has demonstrated remarkable accuracy in deterministic weather predictions, as conditioning inputs. Additionally, we employ a cascade structure to mitigate the error accumulation in nowcasting. This multimodal, cascade-based deep learning nowcasting model achieves remarkable performance in predicting convective clouds with forecast lead times of up to 24 hours, addressing the long-standing issues of blurriness in nowcasting. 2 Results We train our nowcasting model using four years (2019-2022) of hourly FY-4A satellite data from the infrared channel (channel 12) of the Advanced Geosynchronous Radiation Imager (AGRI). Channel 12 is selected as it is specifically designed for water vapor detection and mid-troposphere monitoring, making it particularly effective for tracking cloud system development and convective processes Lu et al. (2017) ; Yan et al. (2024) . The diffusion model employs a U-Net structure enhanced with ConvNeXt modules Liu

Read the complete text