Enhancing Tropical Cyclone Path Forecasting with an Improved Transformer Network
1 st Nguyen Van Thanh, 2 nd Nguyen Dang Huynh, 3 rd Nguyen Ngoc Tan, 4 th Nguyen Thai Minh, 5 th Nguyen Nam Hoang · 2025
Read Enhancing Tropical Cyclone Path Forecasting with an Improved Transformer Network by 1 st Nguyen Van Thanh, 2 nd Nguyen Dang Huynh, 3 rd Nguyen Ngoc Tan, 4 th Nguyen Thai Minh, 5 th Nguyen Nam Hoang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-00495.txt.
Introduction
Storm paths decide where warnings and evacuations fall, and a 2025 paper by Nguyen Van Thanh and co-authors improves short-range path forecasts with a transformer network. Storm tracks shift often, which makes them hard to predict, yet even a few hours of warning protects lives and property.
The team trained their model on storm records from the US weather agency NOAA. The goal was to predict a storm's movement over the next six hours. In simulations, the improved transformer beat traditional methods on accuracy. The authors also report that their method runs faster and costs less than the standard routes. The paper is a compact proof that attention-based networks suit this urgent task.
Catalog record
| CREATOR | 1 st Nguyen Van Thanh, 2 nd Nguyen Dang Huynh, 3 rd Nguyen Ngoc Tan, 4 th Nguyen Thai Minh, 5 th Nguyen Nam Hoang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-00495
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Enhancing Tropical Cyclone Path Forecasting with an Improved Transformer Network 1 st Nguyen Van Thanh, 2 nd Nguyen Dang Huynh, 3 rd Nguyen Ngoc Tan, 4 th Nguyen Thai Minh, 5 th Nguyen Nam Hoang Abstract A storm is a type of extreme weather. Therefore, forecasting the path of a storm is extremely important for protecting human life and property. However, storm forecasting is very challenging because storm trajectories frequently change. In this study, we propose an improved deep learning method using a Transformer network to predict the movement trajectory of a storm over the next 6 hours. The storm data used to train the model was obtained from the National Oceanic and Atmospheric Administration (NOAA) [1]. Simulation results show that the proposed method is more accurate than traditional methods. Moreover, the proposed method is faster and more cost-effective. I Introduction Tropical cyclones are considered extreme weather phenomena. Major storms (with wind speeds of 63 km/h or higher) can cause significant damage to life and property for people in coastal areas worldwide [ 2 ] . Each year, around 40 to 50 tropical depressions (formed near the equator) develop into storms globally. Accurate and timely storm path forecasting enables authorities to take appropriate preventive measures, minimizing damage caused by storms. However, due to the complexity of storm movements and global climate change, predicting storm trajectories faces many difficulties. Storm path forecasting technology has made remarkable progress in recent years. However, most current forecasting methods are essentially statistical [ 3 ] . Specifically, the U.S. National Hurricane Center (NOAA) currently uses several forecasting methods such as: • Global Forecast System (GFS) [ 4 ] and the Hurricane Weather Research and Forecasting model (HWRF); • Geostationary Operational Environmental Satellite (GOES) system [ 5 ] ; • Weather sensor network over land and sea. First, the GFS and HWRF models compute and predict storm movements using algorithms and equations based on observational data and current weather conditions. However, the accuracy of GFS relies on the quality and precision of input data such as wind intensity, pressure, and weather information. This poses challenges in forecasting unpredictable factors such as rapid storm development and transformation. The second system, GOES, collects continuous data on storm trajectories and intensities. By monitoring storm changes in real time, NOAA can provide updated information and forecasts. However, this depends on the satellite’s data collection and transmission capabilities, which can be affected by adverse weather or technical issues. Limited satellite coverage over remote oceanic areas also presents challenges. Finally, NOAA uses a network of weather sensors to collect data on factors such as pressure, wind, temperature, and humidity. This method requires deploying and maintaining a complex system of sensors and data collection devices over a wide area, which can be difficult in remote or isolated oceanic regions. The above methods are limited by the complexity and nonlinearity of atmospheric systems and the computational errors in solving complex equations. Recently, some storm forecasting approaches based on deep learning have emerged, such as Recurrent Neural Networks (RNNs), Long Short-Term Memory (LSTM) networks [ 6 ] , and Gated Recurrent Units (GRU), which are capable of storing temporal information effectively. Previously, Convolutional Neural Networks (CNNs) have been applied due to their ability to detect and learn spatial features in data, which makes them suitable for predicting storm trajectories based on the spatial characteristics of storm paths [ 7 ] . However, these methods still have several limitations, such as difficulty in handling long-term storm trajectories. The models often only consider spatial features at each individual time step without capturing spatial interactions between data points along the trajectory. This is particularly problematic when the storm trajectory is large in scale or when multiple features and data sources need to be processed simultaneously. Traditional deep learning models like RNNs, GRUs, or CNNs may struggle to scale effectively for such complex tasks and large datasets [ 9 ] . The Transformer model, with its ability to learn nonlinear relationships among meteorological variables such as humidity, pressure, location, etc., and its capacity to handle sequences of varying lengths, holds great potential for improving the accuracy of storm trajectory prediction. Therefore, in this paper, we propose using the Transformer model to address the limitations of the aforementioned methods. The structure of this paper is organized as follows: The architecture and operational flow of the original Transformer model and our proposed version are presented in Sections II and III, respectively. Finally, in Section IV, we compare the storm trajectory prediction results using the proposed Transformer model with those of other deep learning models such as LSTM, as well as with forecasting methods currently used by the U.S. National Weather Service. II Transformer Model The Transformer model is a neural network architecture for processing sequential data, introduced by Vaswani et al. in 2017 [ 10 ] . It utilizes the Multi-Head Attention mechanism and a Feedforward Neural Network, and has demonstrated high effectiveness in various natural language processing tasks. Therefore, in this study, we apply the Transformer model for tropical cyclone trajectory forecasting to leverage its advantages—particularly its ability to learn nonlinear relationships between meteorological factors such as humidity, pressure, temperature, wind speed, etc., through the Attention layers. This capability enables the model to capture correlations among different weather variables and improve forecasting accuracy. Moreover, the Transformer model offers flexibility in choosing the appropriate model size to match the complexity of input data and computational requirements. As shown in Figure 5 , the Transformer architecture consists of two main components: the Encoder and the Decoder . Both the encoder and decoder are composed of multiple layers, each of which contains an Attention layer and a Feedforward layer. The encoder is used to extract features from the input data, while the decoder utilizes these features to generate predictions [ 11 ] . Fig. 1: Overview of the original Transformer architecture, consisting of encoder and decoder components. Several recent studies have also applied improved Transformer models to tasks such as drought prediction [ 12 ] , and tracking and forecasting the intensity of tropical cyclones [ 13 ] . In [ 12 ] , the authors proposed a deep Transformer model with four encoder and decoder layers. The results showed that the Transformer achieved better long-term forecasting performance than traditional LSTM models. The study in [ 13 ] , published in July 2023, proposed a Transformer network for simultaneously tracking storm trajectories and forecasting storm intensities. In this work, the authors used typhoon data from China for experimentation, and the results outperformed those of RNN-based models. III Proposed Transformer Model Combined with Coordinate Grid Based on the analysis of the Transformer architecture above, in this section, we propose a model that combines the Transformer model combined with a coordinate grid to enhance accuracy and reduce the complexity of the method, as presented below. Fig. 2: Storm occurrence points from 1944 to 2022 Fig. 3: A coordinate grid with a resolution of 1° longitude × 1° latitude. A. Grid Model Figure shows the longitude and latitude points of tropical cyclones recorded by the Unisys Weather Dataset used for training and testing the model [ 14 ] . This figure illustrates the typical movement of