Probabilistic Precipitation Nowcasting with Rectified Flow Transformers
Johannes Schusterbauer, Jannik Wiese, Nick Stracke, Timy Phan, Björn Ommer, Munich Center for Machine Learning (MCML) · 2026
Read Probabilistic Precipitation Nowcasting with Rectified Flow Transformers by Johannes Schusterbauer, Jannik Wiese, Nick Stracke, Timy Phan, Björn Ommer, Munich Center for Machine Learning (MCML) (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-31204.txt.
Introduction
Schusterbauer and colleagues forecast short-term rainfall with a model that keeps uncertainty intact. Data-driven nowcasts beat simulations for speed and detail, but existing diffusion methods compress weather data in a fixed way that hides decoding uncertainty. Their FREUD model encodes each frame separately and decodes with one unified video decoder, so forecasts update continuously and stay consistent over time. Ensembling over the preserved uncertainty helps most for extreme weather, and the model leads on the SEVIR benchmark.
Catalog record
| CREATOR | Johannes Schusterbauer, Jannik Wiese, Nick Stracke, Timy Phan, Björn Ommer, Munich Center for Machine Learning (MCML) |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 96207 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.31204
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Probabilistic Precipitation Nowcasting with Rectified Flow Transformers Johannes Schusterbauer, Jannik Wiese, Nick Stracke, Timy Phan, Björn Ommer, Munich Center for Machine Learning (MCML) Abstract Accurate weather forecasts are essential across various domains and are safety-critical in extreme weather conditions. Compared to simulation-based forecasting, data-driven approaches show greater efficiency, enabling short-term, high-resolution nowcasting. In particular, diffusion models proved effective in weather nowcasting due to their strong probabilistic foundation. However, existing methods rely on deterministic compression to reduce the complexity of high-dimensional weather data, limiting their ability to capture uncertainty in the decoding process. In this work, we introduce FREUD , a Fr ame-wise E ncoder and U nited D ecoder model based on rectified flow transformers for efficient compression of spatio-temporal weather data. Frame-wise encoding enables continuous forecast updates, while the unified video decoder ensures temporal consistency. Our uncertainty-preserving first stage allows us to capture aleatoric uncertainty via ensembling, which is particularly beneficial for extreme weather events with high decoding variability. We achieve state-of-the-art performance in precipitation nowcasting with a compact latent-space rectified flow transformer on the SEVIR benchmark and show further performance gains by model and test-time scaling. Code available here: https://github.com/CompVis/weather-rf . Figure 1 : Reconstruction ensemble distributions from our generative compression stage for locations with medium ( blue ), heavy ( orange ), and extreme ( red ) precipitation. In light-rain regions, the ensemble shows low variance, while under intense and chaotic rainfall, the spread increases and reliably covers the ground-truth values (dots), whereas the deterministic CasCast decoder 40 (lines) cannot quantify uncertainty and fails to cover ground truth. 1 Introduction Accurate weather forecasting underpins many industries, including energy production 127 ; 148 ; 141 , agriculture 116 ; 105 ; 23 , and aviation 30 ; 95 ; 106 and is safety-critical during extreme weather events. Nowcasting refers to short-term, high-resolution forecasts over 30 minutes to 12 hours 136 ; 33 ; 31 and requires rapid updates, rendering slow numerical weather prediction models less useful. Data-driven machine learning (ML) models overcome this speed bottleneck 136 ; 1 , but deterministic formulations often blur predictions by averaging over multiple plausible futures 136 ; 33 ; 31 . Sampling from probabilistic generative models yields sharp, diverse forecasts, whose spread naturally captures predictive uncertainty 107 ; 14 ; 122 ; 71 ; 36 . Uncertainty quantification is of particular importance in safety-critical settings where the range of plausible outcomes matters more than the most likely one. Early generative approaches use Generative Adversarial Networks (GANs) 41 ; 107 ; 79 ; 159 . However, GANs suffer from training instabilities and mode collapse 66 , limiting coverage of rare but critical long-tail events. Hence, effective nowcasting requires data-driven methods that are accurate , probabilistic , fast , and scalable . Diffusion and flow-based models 126 ; 125 ; 48 ; 110 ; 80 ; 4 ; 3 ; 78 overcome GAN instabilities and mode collapse, but iterative sampling in high-dimensional spaces is computationally expensive. Commonly, a two-stage setup is employed to reduce overhead. First, a compression stage abstracts imperceptible details. Second, a generative model operates in the learned latent space. While effective for natural images and videos, the current two-stage design is ill-posed for weather forecasting . Compression is inherently lossy, and errors that are imperceptible in images may correspond to substantial shifts in predicted precipitation. Two-stage modeling thus undermines reliability in safety-critical settings. Moreover, training such autoencoders requires balancing regularization 65 , perceptual 157 , and adversarial losses 41 ; 110 , where the adversarial components can reintroduce instability and degrade coverage of extreme events. Despite these drawbacks, recent nowcasting models 36 ; 40 ; 71 continue to rely on this architecture to manage the high dimensionality of weather data. In this work, we introduce a novel and simple first stage design, tailored to weather nowcasting. Replacing the standard decoder with a rectified flow decoder ensures that predictions are sharp and realistic, without adversarial or perceptual losses. Therefore, the compression stage becomes (1) easy to train, (2) scalable, and (3) able to quantify uncertainty in the decoding process. To ensure a smooth and well-behaved latent space, we introduce a novel stochastic \tanh regularization, which restricts latents to the range [-1,1] . Unlike KL regularization 65 , it requires no loss weighting or architectural changes 110 ; 65 . We further propose an asymmetric architecture for our first stage, tailored for forecasting. In line with recent image synthesis works 43 ; 161 , we utilize transformers for the first-stage encoder and decoder, thereby avoiding the inefficient convolutional design 161 . For latent-space forecasting, we must avoid information leakage from future to past frames, making sequence-level encoders 142 ; 133 ; 75 ; 158 ; 150 unsuitable. At the same time, we require frame-wise encoding 36 ; 40 ; 74 to support incremental updates and robustness to frame drops. However, purely frame-wise designs introduce flickering and temporal inconsistency 149 . We therefore propose FREUD , a FR amewise E ncoder and U nited D ecoder architecture. Each frame is encoded independently by a lightweight transformer, while a hierarchical rectified flow transformer 24 ; 99 ; 84 decodes them jointly. FREUD provides a fast, scalable first stage for latent-space generation and yields temporally consistent reconstructions without adversarial training or loss weighting. Prior diffusion-based nowcasting models either use a fixed conditioning window 40 ; 36 ; 71 , which is vulnerable to missing or corrupted frames 63 ; 25 ; 2 , or generate future frames auto-regressively 103 ; 62 , which accumulates errors over time. Robust nowcasting therefore requires flexible, adaptive conditioning. We achieve this through masking-based diffusion forcing 54 ; 16 . This allows inference with any number of conditioning frames and maintains strong skill even with only two past frames. Recent methods cascade a deterministic forecast with a generative model 153 ; 40 ; 97 , improving localization but yielding overconfident predictions. We condition solely on observed precipitation, achieving better calibration. Combining this insight with our novel FREUD compression stage and masking-based rectified flow training yields state-of-the-art precipitation nowcasting on the SEVIR benchmark 139 . Our compact model outperforms prior work in Continuous Ranked Probability Score (CRPS) and perceptual metrics, while maintaining competitive localization without biasing the generation. We formulate our contributions as follows: • A simple, scalable first stage tailored for weather nowcasting. We introduce a rectified-flow encoder-decoder with novel stochastic \tanh -regularization that achieves higher reconstruction quality without perceptual or adversarial losses, ensuring a smooth, bounded latent space. • Frame-wise encoder and united video decoder. We propose an asymmetric design that encodes frames independently to prevent information leakage and support variable-length inputs, while jointly decoding all frames simultaneously for temporal consistency. • Decoding uncertainty quantification. Our probabilistic decoder design enables multiple reconstructions from the same latent, providing natural estimates of decoding uncertainty, crucial for safety-critical applications. • Scalable and robust latent-space nowcasting. We achieve state-of-the-art precipitation forecasting through masking-based rectified-flow training that handles variable-length conditioning and frame drops, while scaling with model size, ensemble count, and function evaluations to trade latency for accuracy. 2 Related Works Figure 2 : FREUD architecture. Left : Frame-wise encoder. Right : Generative decoder conditioned on encoder latents \mathbf{z} . Precipitation Nowcasting Classical Numerical Weather