Learning to Advect: A Neural Semi-Lagrangian Architecture for Weather Forecasting
Carlos A. Pereira, Stéphane Gaudreault, Valentin Dallerit, Christopher Subich, Shoyon Panday, Siqi Wei, Sasa Zhang, Siddharth Rout, Eldad Haber, Raymond J. Spiteri, David Millard, Emilia Diaconescu · 2026
Read Learning to Advect: A Neural Semi-Lagrangian Architecture for Weather Forecasting by Carlos A. Pereira, Stéphane Gaudreault, Valentin Dallerit, Christopher Subich, Shoyon Panday, Siqi Wei, Sasa Zhang, Siddharth Rout, Eldad Haber, Raymond J. Spiteri, David Millard, Emilia Diaconescu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21151.txt.
Introduction
Carlos Pereira and a large team of co-authors give weather models a dedicated engine for moving air. Their 2026 paper presents a neural semi-Lagrangian architecture for weather forecasting. Recent machine learning forecasters often use one monolithic network. Distinct physical mechanisms are then represented only implicitly. Advection, diffusion-like mixing, thermodynamics, and forcing all blur together. Advection suffers most from that blur. It needs long-range transport across the globe.
Treating advection implicitly demands expensive global interactions or deep convolutional stacks. A semi-Lagrangian design follows air parcels along their paths instead. That matches how the atmosphere actually moves weather. The architecture builds transport in, rather than hoping a big network learns it. The paper aims for forecasts that respect physics by construction. It joins a push for hybrid models that keep the best of both traditions.
Catalog record
| CREATOR | Carlos A. Pereira, Stéphane Gaudreault, Valentin Dallerit, Christopher Subich, Shoyon Panday, Siqi Wei, Sasa Zhang, Siddharth Rout, Eldad Haber, Raymond J. Spiteri, David Millard, Emilia Diaconescu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 115 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-21151
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Learning to Advect: A Neural Semi-Lagrangian Architecture for Weather Forecasting Carlos A. Pereira, Stéphane Gaudreault, Valentin Dallerit, Christopher Subich, Shoyon Panday, Siqi Wei, Sasa Zhang, Siddharth Rout, Eldad Haber, Raymond J. Spiteri, David Millard, Emilia Diaconescu Abstract Recent machine-learning approaches to weather forecasting often employ a monolithic architecture, where distinct physical mechanisms—advection (transport), diffusion-like mixing, thermodynamic processes, and forcing—are represented implicitly within a single large network. This representation is particularly problematic for advection, where long-range transport must be treated with expensive global interaction mechanisms or through deep, stacked convolutional layers. To mitigate this, we present PARADIS, a physics-inspired global weather prediction model that imposes inductive biases on network behavior through a functional decomposition into advection, diffusion, and reaction blocks acting on latent variables. We implement advection through a Neural Semi-Lagrangian operator that performs trajectory-based transport via differentiable interpolation on the sphere, enabling end-to-end learning of both the latent modes to be transported and their characteristic trajectories. Diffusion-like processes are modeled through depthwise-separable spatial mixing, while local source terms and vertical interactions are modeled via pointwise channel interactions, enabling operator-level physical structure. PARADIS provides state-of-the-art forecast skill at a fraction of the training cost. On ERA5-based benchmarks, the 1 ∘ 1^{\circ} PARADIS model—with a total training cost of less than a GPU-month—meets or exceeds the performance of 0.25 ∘ 0.25^{\circ} traditional and machine-learning baselines, including the ECMWF HRES forecast and DeepMind’s GraphCast. † † affiliationnotice: Equal contribution Figure 1 : Tracking of cyclone eye for Hurricane Laura (August 2020) using different models and the observed trajectory (IBTrACS dataset ( 19 ; 12 ) ). 1 Introduction Weather forecasting constitutes critical infrastructure for global safety and economic resilience, informing daily decisions and mitigating the impacts of extreme events. For decades, numerical PDE solvers have addressed this challenge. More recently, weather forecasting using machine learning has seen rapid progress. The success of machine learning models has sparked important debate in the numerical weather prediction (NWP) community around fundamental questions: How can they forecast unprecedented extreme events? Can systems trained on only 40 years of historical data reliably predict climate extremes that have never been observed before ( 2 ) ? Although imperfect, these models have shown surprising robustness. For example, results reported so far indicate that they can successfully predict tropical cyclone trajectories ( 3 ; 21 ) , although significant challenges remain in forecasting cyclone intensity ( 35 ) . These observational shortcomings highlight a deeper structural issue: purely deep learning weather models lack the geometric constraints required for fine-scale fluid dynamics. Standard architectures, such as convolutions, message-passing, and attention, propagate information through local mixing, forcing long-range advection to emerge implicitly from deep stacks of operations that introduce diffusive artifacts ( 40 ) . Consequently, these models act as low-pass filters, washing out high-frequency details and making it difficult to relocate sharp features without smearing ( 39 ; 28 ) . This smoothing is further compounded by mean-squared error (MSE) minimization, which induces a “double penalty” effect ( 37 ) , driving models to predict a conditional mean rather than the realistic localized extremes required for high-stakes emergency planning. We address this limitation by embedding a semi-Lagrangian transport algorithm directly into the neural architecture, introducing PARADIS ( P hysically-inspired A dvection, R eaction A nd DI ffusion on the S phere). Unlike classical semi-Lagrangian methods that advect known physical variables along solved velocity fields ( 32 ) , PARADIS learns which latent features to transport and along which trajectories. By separating what to learn (transport modes) from how to represent it (Lagrangian trajectories), the model avoids expending representational capacity on re-learning atmospheric transport processes for which efficient algorithms already exist. This contrasts with convolution- or attention-based approaches, which offer limited explicit physical consistency. We present a global PARADIS model at 1^{\circ} resolution that achieves state-of-the-art forecasting performance via: • Neural semi-Lagrangian architecture: We propose a neural operator that advects a compressed latent representation along flow trajectories on the sphere. This compression reduces the computational cost of advection and encourages the network to distinguish between atmospheric features that require transport and those processed locally. • Physics-inspired decomposition: We enforce hard architectural constraints by decomposing the forecast operator into trajectory-based transport (advection), depthwise-separable spatial mixing (diffusion), and pointwise transformations (reaction). This discourages unphysical shortcuts and aligns network components with physical processes. • Spectral training curriculum: We introduce a multi-stage curriculum that begins with a reversed Huber loss and concludes with spectral fine-tuning. This explicitly optimizes amplitude and phase, mitigating spectral roll-off and preserving small-scale energy. 2 Related Work 2.1 Data-Driven Weather Prediction Models The emergence of data-driven models has transformed weather forecasting, arguably the most significant shift since Richardson’s pioneering work ( 31 ) . Enabled by comprehensive reanalysis datasets such as ERA5 ( 14 ) , which translate raw meteorological observations into a model-space “truth” estimate and by rapid advances in deep learning, these models now rival operational NWP systems in deterministic skill. Vision Transformer–based models, including Pangu-Weather ( 3 ) , FengWu ( 7 ) , and FuXi ( 8 ) , leverage self-attention to model long-range atmospheric dependencies, while Graph Neural Network (GNN) approaches such as GraphCast ( 21 ) , the Artificial Intelligence Forecasting System (AIFS) ( 22 ) , and the work of Keisler ( 18 ) represent the atmosphere on multiresolution meshes, enabling flexible treatment of spherical geometry beyond uniform latitude–longitude grids. In parallel, Fourier Neural Operators (FNO) ( 6 ) seek to learn resolution-robust operator mappings of the underlying partial differential equations. Recent work addresses uncertainty and generalization limitations of deterministic surrogates, with diffusion-based generative models ( 28 ; 24 ) targeting probabilistic forecasts of extreme events, large-scale foundation models such as Aurora ( 5 ) and Prithvi WxC ( 34 ) exploring cross-resolution and multi-variable generalization through fine-tuning, and hybrid systems like NeuralGCM ( 20 ) integrating differentiable dynamical cores with learned physical parameterizations. 2.2 Advection–Diffusion–Reaction Network Most directly relevant to our work is the Advection–Diffusion–Reaction Network (ADRNet) proposed by ( 40 ) . They demonstrated that standard convolutional neural networks are fundamentally limited in representing advection-dominated dynamics and introduced an architectural decomposition that improved performance compared with standard convolutional architectures. However, this approach cannot be directly applied to global atmospheric forecasting. ADRNet was designed on regular two-dimensional Cartesian grids, failing to account for spherical geometry, multi-level states, and the need for spectral fidelity over long autoregressive rollouts, and the computational constraints imposed by training on large-scale reanalysis datasets. Addressing these challenges requires additional architectural innovations beyond a direct extension of existing ADR-style models. Figure 2 : Diagram of the PARADIS model. 3 From Physical Principles to a Neural Architecture Most neural weather models treat forecasting as an image-to-image translation task, learning patterns from data without explicit physical structure. This perspective neglects the fact that atmospheric dynamics are governed by conservation laws, where information is physically transported by fluid motion rather than transformed in place. PARADIS is designed to mirror the Advection-Diffusion-Reaction structure that describes atmospheric evolution. At the coarsest level, the evolution of the state vector \mathbf{q}\in\mathbb{R}^{C_{\text{phys}}} can be written as \displaystyle\frac{\partial\mathbf{q}}{\partial t}+\underbrace{(\mathbf{u}\cdot\nabla)\mathbf{q}}_{\text{Advection}}=\underbrace{\mathcal{D}(\mathbf{q})}_{\text{Diffusion}}+\underbrace{\mathcal{R}(\mathbf{q})}_{\text{Reaction}}, (1) where \mathbf{u} is the velocity field. This decomposition naturally separates three physical processes: Advection (transport by wind), Diffusion (spatial mixing and