Explore the Ideology of Deep Learning in ENSO Forecasts

Yanhai Gan, Yipeng Chen, Ning Li, Xingguo Liu, Junyu Dong, Xianyao Chen · 2026

Read Explore the Ideology of Deep Learning in ENSO Forecasts by Yanhai Gan, Yipeng Chen, Ning Li, Xingguo Liu, Junyu Dong, Xianyao Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-02050.txt.

Introduction

El Niño and La Niña swing the global climate, and deep learning now forecasts them well but opaquely. Yanhai Gan and five co-authors build a framework for reading such models. It is grounded in math, in functions of bounded variation. It also revives neurons stuck in the saturated zone of the activation function. That restores expressive capacity.

Their analysis finds forecast skill concentrated in the tropical Pacific. The Indian and Atlantic oceans add support. The pattern matches physical understanding. Controlled experiments confirm robustness. The team probes the notorious spring barrier to forecast skill. Sensitivity actually widens in spring. Skill still falls. The blame falls on variable selection. Adding the right ocean-atmosphere inputs might break through the barrier. The study ties model internals back to climate physics.

Catalog record

CREATORYanhai Gan, Yipeng Chen, Ning Li, Xingguo Liu, Junyu Dong, Xianyao Chen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-02050

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Explore the Ideology of Deep Learning in ENSO Forecasts Yanhai Gan, Yipeng Chen, Ning Li, Xingguo Liu, Junyu Dong, Xianyao Chen Abstract The El Niño–Southern Oscillation (ENSO) exerts profound influence on global climate variability, yet its prediction remains a grand challenge. Recent advances in deep learning have significantly improved forecasting skill, but the opacity of these models hampers scientific trust and operational deployment. Here, we introduce a mathematically grounded interpretability framework based on bounded variation function. By rescuing the “dead” neurons from the saturation zone of the activation function, we enhance the model’s expressive capacity. Our analysis reveals that ENSO predictability emerges dominantly from the tropical Pacific, with contributions from the Indian and Atlantic Oceans, consistent with physical understanding. Controlled experiments affirm the robustness of our method and its alignment with established predictors. Notably, we probe the persistent Spring Predictability Barrier (SPB), finding that despite expanded sensitivity during spring, predictive performance declines—likely due to suboptimal variable selection. These results suggest that incorporating additional ocean-atmosphere variables may help transcend SPB limitations and advance long-range ENSO prediction. I Introduction The most significant interannual climate variability signal on Earth—the El Niño-Southern Oscillation (ENSO)—is a typical climate phenomenon resulting from large-scale ocean-atmosphere coupling in the tropical Pacific [ 6 , 16 ] . The ENSO signal not only affects tropical [ 5 ] and subtropical [ 13 ] ocean-atmosphere interactions, but it also leads to frequent global extreme weather events [ 21 ] . Consequently, ENSO has profound impacts on global climate [ 1 , 25 ] . Therefore, improving ENSO forecasting capabilities holds significant scientific value and socio-economic importance in addressing global climate change. In recent years, with the continuous development of big data and deep learning in varied fields [ 22 , 12 , 8 ] , some scholars have also started to apply deep learning to ENSO forecasting. Ham et al. [ 11 ] utilized simulation data and transfer learning to train the convolutional neural network (CNN) [ 15 ] , and obtained higher prediction performance than the previous mainstream methods. Petersik et al. [ 17 ] utilized a small number of predictor variables and samples to train a neural network and obtained similar prediction results. In spite of these achievements, we are interested in understanding how these deep learning models make decisions to achieve such good prediction performance, which may reveal some known or unknown physics in the ocean, and may also help to further improve the prediction ability. The inherent “black box” nature of AI models makes their decision-making processes difficult to trace, which, despite their exceptional forecasting capabilities, severely limits the credibility of research findings due to the opacity of their decision logic. Therefore, enhancing model interpretability is crucial for building trust in AI-based climate forecasting. Among various methods, representation visualization is one of the most intuitive post hoc interpretability methods, which can present the features learned by the model and the correlation between inputs and outputs by heatmaps [ 2 , 10 , 9 , 14 , 23 ] . Through heatmaps, we can intuitively understand the main basis for the model to make the final decisions. There have been many types of representation visualization methods, such as perturbation-based methods [ 2 , 10 , 9 , 23 ] , backpropagation-based methods [ 4 , 19 , 26 , 20 , 3 ] , class activation mapping methods [ 27 , 18 , 7 , 24 ] . Perturbation-based method is similar to a causal process, where a certain part of the input is masked, modified, etc., and then fed into the model to get the corresponding output. The importance of this part of the input is measured based on the degree of change in the output [ 23 ] . Backpropagation-based method maps outputs to inputs layer by layer according to the designed backpropagation rules to get the magnitude of the contribution of the input variables to the outputs [ 14 ] . Class activation mapping methods argued that the final convolutional layer contains the semantic information related to decision making, and by weighting and stacking its feature maps onto the original image, they can visualize the regions that contribute to the target category [ 18 ] . Most interpretability methods are developed for image classification models and are not readily applicable to ENSO index regression tasks. These approaches typically assume that features lead to larger output values are the basis for the model’s decision-making [ 7 , 24 ] . While this assumption holds in classification—where a higher output value produces greater class confidence—it breaks down in regression settings. In regression, a larger output does not necessarily imply closer proximity to the expected value. This highlights the inadequacy of such interpretability assumptions for regression models and calls for methods that better reflect their underlying ideology. We hope for an interpretability method that provides a clear mathematical meaning for the interpretation of ENSO prediction models, thus gaining the trust of researchers and further promoting ENSO research. Essentially, ENSO index forecasting differs fundamentally from conventional computer vision tasks. In this case, it is necessary and hopeful to propose an interpretability approach specifically tailored to the ENSO index forecasting model. To this end, we first define the principled objective of interpretation: identifying geographic regions most critical for ENSO forecasting. In line with the principled objective, we develop the interpretability method by treating the ENSO forecasting model as a bounded variation function. We quantify the responsibility of each variable for the variance of the function as an importance metric. This approach ensures that the design of the interpretability method is both clear and grounded in mathematics. Ultimately, the proposed method is tested and validated through extensive controlled experiments, and the insights derived from the interpretations are presented to inspire further understanding of ENSO predictability—an outcome we indeed hope to achieve. II Materials and Methods II-A Data and Convolutional Neural Network Ham et al. [ 11 ] leveraged both climate model simulations and historical reanalysis data for training a deep learning model aimed at multi-year ENSO forecasting. To overcome the limitations imposed by the relatively short observational record, a transfer learning approach was adopted. The CNN was first pre-trained on a large volume of data from the historical simulations of 21 different Coupled Model Intercomparison Project phase 5 (CMIP5) models. Following this pre-training phase, the learned features were transferred, and the model was subsequently fine-tuned using the Simple Ocean Data Assimilation (SODA) reanalysis dataset covering the period 1871-1973. This two-stage training strategy allowed the model to learn robust features from the extensive simulations and then adapt them to the characteristics of the historical reanalysis. The final model performance was evaluated on an independent validation period using the Global Ocean Data Assimilation System (GODAS) reanalysis from 1984 to 2017. This study only used GODAS data for the analysis experiment. The applied CNN architecture consisted of an input layer receiving Sea Surface Temperature (SST) and upper Ocean Heat Content (HC) anomaly maps for three consecutive months, followed by three convolutional layers interspersed with two max-pooling layers for hierarchical feature extraction and dimensionality reduction, a fully connected layer for integrating learned features, and an output layer predicting the 3-month averaged Nino3.4 index up

Read the complete text