Demystifying Data-Driven Probabilistic Medium-Range Weather Forecasting
Jean Kossaifi ∗† , Nikola Kovachki ∗† , Morteza Mardani ∗ , Daniel Leibovici ∗ , Suman Ravuri ∗ , Ira Shokar ∗ , Edoardo Calvello, Mohammad Shoaib Abbas, Peter Harrington, Ashay Subramaniam, Noah Brenowitz, Boris Bonev, Wonmin Byeon, Karsten Kreis, Dale Durran, Arash Vahdat, Mike Pritchard and Jan K · 2026
Read Demystifying Data-Driven Probabilistic Medium-Range Weather Forecasting by Jean Kossaifi ∗† , Nikola Kovachki ∗† , Morteza Mardani ∗ , Daniel Leibovici ∗ , Suman Ravuri ∗ , Ira Shokar ∗ , Edoardo Calvello, Mohammad Shoaib Abbas, Peter Harrington, Ashay Subramaniam, Noah Brenowitz, Boris Bonev, Wonmin Byeon, Karsten Kreis, Dale Durran, Arash Vahdat, Mike Pritchard and Jan K (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-18111.txt.
Introduction
Jean Kossaifi and co-authors strip weather AI down to what really makes it skillful. Their 2026 preprint deals with data-driven probabilistic forecasting at medium range. The field has boomed, but it has also splintered into complex, bespoke designs and training tricks. That splintering hides the true drivers of forecast skill. The authors show that top-level probabilistic skill needs neither intricate architecture rules nor special training heuristics.
A simpler recipe that matches the best models is good news. It lowers the cost of entry for new teams. It also tells the field where to stop adding parts. Weather forecasts guide farms, grids, and disaster plans, so clarity about what works has wide value.
Catalog record
| CREATOR | Jean Kossaifi ∗† , Nikola Kovachki ∗† , Morteza Mardani ∗ , Daniel Leibovici ∗ , Suman Ravuri ∗ , Ira Shokar ∗ , Edoardo Calvello, Mohammad Shoaib Abbas, Peter Harrington, Ashay Subramaniam, Noah Brenowitz, Boris Bonev, Wonmin Byeon, Karsten Kreis, Dale Durran, Arash Vahdat, Mike Pritchard and Jan K |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-18111
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Demystifying Data-Driven Probabilistic Medium-Range Weather Forecasting Jean Kossaifi ∗† , Nikola Kovachki ∗† , Morteza Mardani ∗ , Daniel Leibovici ∗ , Suman Ravuri ∗ , Ira Shokar ∗ , Edoardo Calvello, Mohammad Shoaib Abbas, Peter Harrington, Ashay Subramaniam, Noah Brenowitz, Boris Bonev, Wonmin Byeon, Karsten Kreis, Dale Durran, Arash Vahdat, Mike Pritchard and Jan Kautz Abstract The recent revolution in data-driven methods for weather forecasting has lead to a fragmented landscape of complex, bespoke architectures and training strategies, obscuring the fundamental drivers of forecast accuracy. Here, we demonstrate that state-of-the-art probabilistic skill requires neither intricate architectural constraints nor specialized training heuristics. We introduce a scalable framework for learning multi-scale atmospheric dynamics by combining a directly downsampled latent space with a history-conditioned local projector that resolves high-resolution physics. We find that our framework design is robust to the choice of probabilistic estimator, seamlessly supporting stochastic interpolants, diffusion models, and CRPS-based ensemble training. Validated against the Integrated Forecasting System and the deep learning probabilistic model GenCast, our framework achieves statistically significant improvements on most of the variables. These results suggest scaling a general-purpose model is sufficient for state-of-the-art medium-range prediction, eliminating the need for tailored training recipes and proving effective across the full spectrum of probabilistic frameworks. \abscontent 1 Introduction Until recently, the consensus within the atmospheric science community was that purely data-driven approaches could never rival the fidelity of numerical weather prediction (NWP). The chaotic, multi-scale dynamics of the atmosphere were thought to demand explicit solvers based on fluid dynamics. However, the introduction of a neural-operator [ 33 ] , and later graph-neural-network approaches [ 36 , 22 ] for capturing these multi-scale dynamics, demonstrated that deep learning could not only capture global circulation patterns from historical data but do so with accuracy competing with the gold-standard Integrated Forecasting System (IFS) developed by the European Centre for Medium-Range Weather Forecasts (ECMWF). Since, data-driven deterministic models [ 33 , 5 , 26 , 6 , 11 , 24 ] have reached parity with or surpassed traditional NWP. Beyond matching the accuracy of traditional solvers, these models offer a fundamental computational advantage: they generate predictions several orders of magnitude faster, often requiring only a single GPU. This efficiency has democratized access to high-quality forecasting and opened the door to massive ensembles [ 29 , 30 ] . Consequently, the frontier of research has now shifted from establishing feasibility to mastering probabilistic prediction [ 37 , 27 , 2 , 7 , 57 ] , aiming to capture the uncertainty inherent in partially observed, chaotic systems. However, these recent and rapid evolutions of the field have led to a fragmented landscape of architectures and training methodologies. Because weather data resides on a spherical manifold and involves distinct physical variables, researchers have heavily prioritized domain-specific inductive biases. Current approaches generally fall into three distinct design philosophies. First, the FourCastNet family [ 6 , 7 ] and related architectures [ 50 , 10 , 51 , 19 , 14 ] leverage spherical harmonics and convolutions to strictly enforce geometric symmetries as inductive biases. Second, graph-based models [ 26 , 37 , 27 , 2 ] encode the atmosphere on icosahedral meshes and rely on message-passing architectures to capture physical dynamics. A third category [ 5 , 11 , 32 ] adapts vision transformers (ViTs) [ 15 ] with bespoke tokenization strategies or vertical aggregation layers to handle the 3D structure of the atmosphere. While effective, these specialized architectural and training constraints often introduce significant engineering complexity and computational bottlenecks that hinder efficient scaling. The challenge is compounded in the probabilistic setting where the design space is even more fragmented. To capture uncertainty, complex loss functions and sampling strategies have been proposed. Some approaches optimize continuous-ranked probability scores (CRPS) directly but can struggle to accurately predict spectral power at the shortest retained wavelengths [ 27 , 2 ] . Others augment CRPS with spectral terms to improve sharpness [ 43 , 7 ] . More recently, diffusion, flow-matching, or consistency models [ 37 , 13 , 46 ] have demonstrated high fidelity but suffer from slow inference times or limited resolution. Indeed, diffusion based approaches have especially attractive potential for controllability relevant to multi-task foundation modeling [ 8 ] beyond the prediction task. However, they have so far not achieved probabilistic skill close to state-of-the-art without sacrificing either time or spatial resolution – an open challenge. We investigate the extent to which any specific probabilistic estimation, training receipy or architectural complexity is necessary to achieve state-of-the-art weather forecasts by pursuing a very different path: a streamlined framework that relies on standard, scalable components. Our framework leverages general-purpose transformer architectures operating within a compressed latent space. Inspired by the success of latent diffusion in computer vision, our approach decouples the modeling of global dynamics from high-resolution synthesis. Our approach strips away domain-specific constraints in favor of a general-purpose, scalable backbone, and achieves state-of-the-art probabilistic performance with simplicity. Our contributions are as follows: • A unified latent framework: We find that the direct application of probabilistic methods such as diffusion or stochastic interpolants to high-resolution weather data is often computationally prohibitive or unstable. We propose the ATLAS framework: a standard transformer operating in a directly downsampled latent space, coupled with a history-conditioned local projector. We show that this streamlined framework effectively resolves high-resolution physics without the need for complex variational encodings or bespoke layers. • Method-agnostic robustness: We demonstrate that this framework serves as a universal backbone for probabilistic forecasting. Unlike prior works that are tightly coupled to specific loss functions or training recipes, our framework achieves state-of-the-art results using three independent estimation methods, including stochastic interpolants, diffusion models, and CRPS-based ensemble training, suggesting potential to unify the fragmented modeling landscape. • State-of-the-art performance for a fully open model: We validate our approach against the Integrated Forecasting System (IFS) and the strongest publicly available deep learning probabilistic model we are aware of that was trained on similar ERA5 data and can therefore be fairly compared – GenCast. Our method outperforms the IFS by a large margin and achieves statistically significant improvements over GenCast for most variables (Figure 1 ). • This performance represents the most skillful attempt yet to train a diffusion-based approach for this task without sacrificing resolution. (a) Atlas-SI vs. IFS-ENS (b) Atlas-SI vs. GenCast Figure 1 : Scorecard comparison of ATLAS-SI vs. IFS-ENS ( a ) and GenCast ( b ) for a fifteen day forecast with 56 ensemble members averaged over ERA5 initial conditions in 2020. Left shows percent improvement in the RMSE of the ensemble mean and right in the ensemble CRPS. 2 ATLAS: Medium-Range Latent Probabilistic Weather Forecasting In this section, we introduce ATLAS (Atmospheric Transformer in Latent Space), our method for medium-range probabilistic weather forecasting. We first introduce the problem formulation, our choice of latent space modeling and backbone architectures before introducing three probabilistic generative methods used to train and validate our approach. 2.1 Problem Formulation We consider a stationary, discrete-time, \mathbb{R}^{d} -valued stochastic process \{x_{j}\}_{j\in\mathbb{Z}} which represents the distribution of d measurements of the state of the atmosphere at equally spaced time intervals. Our task is to model the conditional distribution \rho_{c}(x_{j+1}|x_{j}) from a single, finite, realization of \{x_{j}\} as