Score-based diffusion nowcasting of GOES imagery
2025
Read Score-based diffusion nowcasting of GOES imagery (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-10432.txt.
Introduction
Randy Chase and three co-authors show how score-based diffusion models can forecast clouds from satellite images, in this 2025 paper. Such models, borrowed from image generation, build pictures by reversing a noise-adding process, and they give sharper results than older machine learning methods trained to minimize squared error. The authors aim to make the method usable for earth science rather than leaving it in theory papers.
They test three versions on infrared images from a geostationary satellite, forecasting cloud cover up to three hours ahead. The models did more than push existing clouds along; they also grew and faded clouds, including the birth of storms. The best version, a residual-correction model, beat the other diffusion models, a standard U-Net, and assuming no change. The setup produces ensembles with well-judged spread. The paper closes with lessons for adapting diffusion models to earth science tasks.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-10432
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Score-based diffusion nowcasting of GOES imagery Abstract Clouds and precipitation are important for understanding weather and climate. Simulating clouds and precipitation with traditional numerical weather prediction is challenging because of the sub-grid parameterizations required. Machine learning has been explored for forecasting clouds and precipitation, but early machine learning methods often created blurry forecasts. In this paper we explore a newer method, named score-based diffusion, to nowcast (zero to three hour forecast) clouds and precipitation. We discuss the background and intuition of score-based diffusion models - thus providing a starting point for the community - while exploring the methodology’s use for nowcasting geostationary infrared imagery. We experiment with three main types of diffusion models: a standard score-based diffusion model (Diff); a residual correction diffusion model (CorrDiff); and a latent diffusion model (LDM). Our results show that the diffusion models are able to not only advect existing clouds, but also generate and decay clouds, including convective initiation. These results are surprising because the forecasts are initiated with only the past 20 mins of infrared satellite imagery. A case study qualitatively shows the preservation of high resolution features longer into the forecast than a conventional mean-squared error trained U-Net. The best of the three diffusion models tested was the CorrDiff approach, outperforming all other diffusion models, the traditional U-Net, and a persistence forecast by one to two kelvin on root mean squared error. The diffusion models also enable out-of-the-box ensemble generation, which shows skillful calibration, with the spread of the ensemble correlating well to the error. † † authors: Randy J. Chase \aff a, Katherine Haynes \aff a, Lander Ver Hoef \aff a, Imme Ebert-Uphoff \aff a,b, \statement Knowing where clouds and precipitation will be is important for everything from weather forecasts to telecommunications. Unfortunately, simulating clouds and precipitation is a challenge for physics-based approaches. Machine learning methodology can help, but older methodologies often result in blurry forecasts. In this paper, we explore a newer machine learning method from the computer science literature, named diffusion, which enables clearer and more realistic looking forecasts. We specifically look at how the diffusion models work and provide some base intuition to accelerate others using diffusion in their Earth and Environmental Science research. We explore how these diffusion models work for forecasting satellite infrared imagery. Our results show skillful performance of these new diffusion models, outperforming prior machine learning techniques. 1 Introduction Clouds and precipitation play a vital role in understanding the radiative budget of Earth and understanding the past, current, and future climate. Furthermore, the exact location and timing of clouds and precipitation have natural applications to forecast weather, solar power generation ( Zhang et al. 2018 ) and laser communications ( Craddock et al. 2024 ) . The main methods for forecasting clouds and precipitation are Lagrangian advection schemes ( Bowler et al. 2006 ; Pulkkinen et al. 2019 , e.g.,) , traditional numerical weather prediction ( Griffin et al. 2017 ; Griffin et al. 2024 , e.g.,) , optical flow ( Shakya and Kumar 2019 , e.g.,) , or machine learning ( Berthomier et al. 2020 ; Kellerhals et al. 2022 , e.g.,) . The use of machine learning in meteorology is not new and has been growing rapidly ( Chase et al. 2022 , c.f., Figure 1 in ) . In fact, neural networks have shown skill in forecasting clouds and precipitation ( Shi et al. 2015 ; Caseri et al. 2022 ; Andrychowicz et al. 2023 , e.g.,) . The challenge with the early types of neural networks, such as convolutional neural networks, is that while they are skillful they often result in blurry predictions ( Bouallègue et al. 2024 ) which may be less useful to forecasters. One way to combat the blurry issue has been the use of Generative AI methods, such as Generative Adversarial Networks ( Goodfellow et al. 2014 ; Andrianakos et al. 2019 ; Ravuri et al. 2021 , GANs; ) . Unfortunately, GANs are notorious for being difficult to train ( Saxena and Cao 2021 ) and have suboptimal uncertainty quantification ( Harris et al. 2022 ; Price and Rasp 2022 , e.g., underdispersive ensemble forecasts; ) . A newer Generative AI method to combat blurry output is known as diffusion models ( Ho et al. 2020 ; Song et al. 2021 ; Karras et al. 2022 ) which has already been used in cloud and precipitation forecasting ( Hatanaka et al. 2023 ; Zhang et al. 2023 ; Dai et al. 2024 ; Nai et al. 2024 ; Wang et al. 2024 ; Yu et al. 2024 ) and, more generally, in data-driven weather forecasting ( Manshausen et al. 2024 ; Pathak et al. 2024 ; Price et al. 2025 ) . Diffusion models use machine learning to iteratively solve a carefully constructed differential equation (inspired by those governing the physical process of heat diffusion, thus the name) to turn random noise into generated images that are consistent with the distribution of the data they are trained on. More casually speaking, that look like they could have come from the training set. The goal of this paper is to specifically explore score-based diffusion models ( Song et al. 2021 ; Karras et al. 2022 ) and their ability to nowcast infrared brightness temperatures of geostationary satellites. The end goal of such a nowcasting model is eventually to forecast clouds and precipitation. In the exploration of this relatively new methodology, we discuss the hurdles encountered in implementing score-based diffusion models with Earth and Environmental Science data. Furthermore, we also discuss some often overlooked steps needed for meteorological applications that are not addressed in the computer science literature on diffusion models. The goal of this added discussion and open-access code is to accelerate the use of score-based diffusion models among domain scientists in the Earth and Environmental Sciences. In our exploration of score-based diffusion models we try three types that all follow the main design approach from Karras et al. 2022 , also known as Elucidating the Design space of diffusion-based generative Models (EDM). The three specific types are 1. A plain diffusion model ( Karras et al. 2022 , Diff; ) , 2. A residual correction diffusion model ( Mardani et al. 2025 ; Pathak et al. 2024 , CorrDiff; ) , 3. A latent diffusion model ( Rombach et al. 2022 ; Leinonen et al. 2023 , LDM; ) . This paper is organized as follows. Section 2 contains the overview of score-based diffusion, including a brief discussion of the mathematical foundations of diffusion models. Section 3 provides background on the geostationary dataset we use, the steps to prepare it for using score-based diffusion, how it is adapted for the satellite forecasting task, what specific types of machine learning models are trained, and some exploration of pre-trained autoencoders. Section 4 shows the results of several score-based diffusion models trained to forecast satellite imagery and discusses their performance compared to a couple of baseline forecasts, persistence and a mean squared error trained U-Net. Lastly, Section 5 summarizes the paper and provides an outlook of improvements that could be made. 2 Background on Score-Based Diffusion Models 2.1 Preface All diffusion models discussed in this paper follow a