FastNet: Improving the physical consistency of machine-learning weather prediction models through loss function design
2025
Read FastNet: Improving the physical consistency of machine-learning weather prediction models through loss function design (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-17601.txt.
Introduction
Tom Dunstan leads a large team of co-authors on a 2025 arXiv paper about machine learning weather forecasts. Their model, FastNet, is a graph neural network that predicts weather worldwide at a fraction of the cost of classic physics-based systems. The catch is physical consistency: learned forecasts can blur fine detail or draw patterns no real atmosphere would make.
The team redesigns the training loss in three ways. A spectral loss punishes errors in pattern scale, which fights blurring. Gradient terms in the loss suppress artifacts that break smooth flow. A new wind encoding splits speed from direction to catch extreme winds better. Alone, the first two changes slightly hurt the standard error score. Trained together, they gave forecasts that score well and look far more physical, a trade the authors argue forecasters should want.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-17601
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FastNet: Improving the physical consistency of machine-learning weather prediction models through loss function design Thanks: * Equal contributions Abstract Machine learning weather prediction (MLWP) models have demonstrated remarkable potential in delivering accurate forecasts at significantly reduced computational cost compared to traditional numerical weather prediction (NWP) systems. However, challenges remain in ensuring the physical consistency of MLWP outputs, particularly in deterministic settings. This study presents FastNet, a graph neural network (GNN)-based global prediction model, and investigates the impact of alternative loss function designs on improving the physical realism of its forecasts. We explore three key modifications to the standard mean squared error (MSE) loss: (1) a modified spherical harmonic (MSH) loss that penalises spectral amplitude errors to reduce blurring and enhance small-scale structure retention; (2) inclusion of horizontal gradient terms in the loss to suppress non-physical artefacts; and (3) an alternative wind representation that decouples speed and direction to better capture extreme wind events. Results show that while the MSH and gradient-based losses alone may slightly degrade RMSE scores, when trained in combination the model exhibits very similar MSE performance to an MSE-trained model while at the same time significantly improving spectral fidelity and physical consistency. The alternative wind representation further improves wind speed accuracy and reduces directional bias. Collectively, these findings highlight the importance of loss function design as a mechanism for embedding domain knowledge into MLWP models and advancing their operational readiness. See Research_front.png † † authors: Tom Dunstan*, \aff a Oliver Strickson*, \aff b Thusal Bennett*, \aff a Jack Bowyer*, \aff a Matthew Burnand*, \aff a James Chappell*, \aff a Alejandro Coca-Castro*, \aff b Kirstine Ida Dale*, \aff a Eric G. Daub*, \aff b Noushin Eftekhari*, \aff b Manvendra Janmaijaya*, \aff b Jon Lillis*, \aff a David Salvador-Jasin*, \aff b Nathan Simpson*, \aff b Ryan Sze-Yin Chan*, \aff b Mohamad Elmasri*, \aff c Lydia Allegranza France*, \aff b Sam Madge*, \aff a Levan Bokeria, \aff b Hannah Brown, \aff g Tom Dodds, \aff h Anna-Louise Ellis, \aff a David Llewellyn-Jones, \aff b Theo McCaie, \aff a Sophia Moreton, \aff b Tom Potter, \aff a James Robinson, \aff b Adam A. Scaife, \aff d,e Iain Stenson, \aff b David Walters, \aff a Karina Bett-Williams, \aff a,f Louisa van Zeeland, \aff b Peter Yatsyshin, \aff b and J. Scott Hosking \aff b,i 1 Introduction Within a time frame of only a few years, Machine Learning (ML) based weather prediction has risen from speculative, small-scale research projects to established components of many national met services’ (NMS) plans for future operational products. The potential benefits of Machine Learning Weather Prediction (MLWP) models are clear: bringing a step change in accuracy on many standard error metrics alongside an orders-of-magnitude reduction in the time and cost needed to produce a forecast. Beyond this tremendous potential, however, there remains a substantial gap between the outputs currently available from MLWP models (temporal and spatial resolution and the range of processes represented) and the outputs available from current operational Numerical Weather Prediction (NWP) models. Whether or not this gap can be closed with purely data-driven models or whether a blend of traditional and data-driven modelling will continue to be necessary is an active area of research. Regardless of the answer, a key factor in closing this gap will come from improving the physical consistency of MLWP output and moving beyond standard error metrics such as Root Mean Squared Error (RMSE). Achieving this will broaden the range of downstream uses for MLWP models, increase confidence and trust in their output, and improve their ability to generalise to unseen conditions. We focus here on deterministic MLWP models. Whilst ensembles are of growing importance even at short lead times, good deterministic model characteristics are important in forming a good ensemble. We also make the assumption here that initial conditions are available from an existing analysis, and so the important challenge of data assimilation, or of working directly from observations, is set to one side for the purposes of this work. Early attempts at pure ML-based weather models adapted image processing architectures such as Convolutional Neural Nets (CNNs) ( Rasp et al. 2020 ; Rasp and Thuerey 2021 ) . The models were skillful but resolution was relatively coarse and errors were not competitive with the state of the art NWP models at the time. The seminal paper by Keisler ( Keisler 2022 ) , building on work from Pfaff et al. 2021 , was the first to demonstrate the true potential of the data-driven approach; producing a model that was competitive with leading NWP systems on key error metrics and with training and inference costs that were orders of magnitude lower than those required by NWP. Many of the design choices established in Keisler 2022 , such as the encode-process-decode GNN structure, auto-regressive rollout, increment learning, and multi-resolution training still form the basis for many leading MLWP models today. FourCastNet ( Pathak et al. 2022 ) , using a vision transformer backbone operating in Fourier space, was the first to achieve [formula] resolution using ERA5 on a lat/lon grid. Pangu Weather ( Bi et al. 2023 ) extended the vision transformer concept to accommodate 3-dimensional atmospheric blocks, and was the first to achieve competitive RMSE scores compared to state of the art NWP models. In parallel to the transformer-based approach, Graph-based models were further advanced in GraphCast ( Lam et al. 2023 ) , building on the work of Keisler 2022 to produce a state of the art model that exceeded the performance of the Integrated Forecast System (IFS) from the European Centre for Medium-Range Weather Forecasting (ECMWF) on the majority of standard error metrics. The AIFS model developed by ECMWF ( Lang et al. 2024a ) also followed the encode-process-decode GNN architecture and was the first to exceed IFS performance for all variables. Alternative approaches such as Spherical Fourier Neural Operators ( Bonev et al. 2023 ; Bonev et al. 2025 ) and Hybrid General Circulation-NN models ( Kochkov et al. ) have also proven effective for producing competitive prediction models. The diversity of approaches described above, all capable of producing competitive forecasts, points to the fact that, beyond certain minimum requirements, the choice of model architecture is not the only, or even the most important, factor affecting performance, but rather • the size and quality of training data (length, consistency, resolution, accuracy) • the formulation of the learning task (including the design of the loss function) • the computational efficiency and scaling characteristics of the model all work in combination to determine a model’s effectiveness. The FastNet model therefore takes as its starting point a GNN-based architecture similar to those described in Pfaff et al. 2021 ; Keisler 2022 ; Lam et al. 2023 , and uses ERA5 reanalysis data for training on a global domain. Our main contribution focuses instead on improving the physical consistency and generalisability of the model through modifications to the loss function. In particular, we focus on three key areas where deterministic ML models have been found to exhibit biases: • Spectral biases, i.e. loss of power at the small to medium scales (blurring) that compounds with lead time, e.g. Lam et al. 2023 . • A slow bias in the wind speeds,