Transparent Machine Learning: Training and Refining an Explainable Boosting Machine to Identify Overshooting Tops in Satellite Imagery
2025
Read Transparent Machine Learning: Training and Refining an Explainable Boosting Machine to Identify Overshooting Tops in Satellite Imagery (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-03183.txt.
Introduction
Nathan Mitchell and co-authors present a 2025 study on clear, open machine learning for weather work. Their paper bears the head title Knowledge-Guided Machine Learning. The test case is finding overshooting tops in satellite images. Such tops are domes of cloud that punch up through a storm top and can signal severe weather.
The team uses a method whose choices a person can read and check, rather than a black box. They first pull plain number traits, such as cloud texture, from the images. Then experts review the trained model and adjust it by hand to match how forecasters judge a storm. The final model works fairly well, though less well than larger opaque tools. The gain is trust, since each step can be seen and fixed.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-03183
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Transparent Machine Learning: Training and Refining an Explainable Boosting Machine to Identify Overshooting Tops in Satellite Imagery Abstract An Explainable Boosting Machine (EBM) is an interpretable machine learning (ML) algorithm that has benefits in high risk applications but has not yet found much use in atmospheric science. The overall goal of this work is twofold: (1) explore the use of EBMs, in combination with feature engineering, to obtain interpretable, physics-based machine learning algorithms for meteorological applications; (2) illustrate these methods for the detection of overshooting top (OTs) in satellite imagery. Specifically, we seek to simplify the process of OT detection by first using mathematical methods to extract key features, such as cloud texture using Gray-Level Co-occurrence Matrices, followed by applying an EBM. Our EBM focuses on the classification task of predicting OT regions, utilizing Channel 2 (visible imagery) and Channel 13 (infrared imagery) of the Advanced Baseline Imager sensor of the Geostationary Operational Environmental Satellite 16. Multi-Radar/Multi-Sensor system convection flags are used as labels to train the EBM model. Note, however, that detecting convection, while related, is different from detecting OTs. Once trained, the EBM was examined and minimally altered to more closely match strategies used by domain scientists to identify OTs. The result of our efforts is a fully interpretable ML algorithm that was developed in a human-machine collaboration. While the final model does not reach the accuracy of more complex approaches, it performs well and represents a significant step toward building fully interpretable ML algorithms for this and other meteorological applications. † † authors: Nathan Mitchell \aff a, Lander Ver Hoef \aff b, Imme Ebert-Uphoff \aff b,c, Kristina Moen \aff d, Kyle Hilburn \aff b, Yoonjin Lee \aff e, Emily J. King \aff d \statement The purpose of this work is to introduce the interpretable machine learning method of Explainable Boosting Machines (EBMs) to an atmospheric science audience by closely examining how they can be used to predict the location of overshooting cloud tops, which have been associated with the occurrence of severe weather, in satellite imagery. Interpretable machine learning methods are important in high-risk situations such as overshooting top detection as they allow forecasters to have a better understanding of how exactly a prediction is made. We walk through how to build, interpret, and modify the machine learning algorithm for use on this task, but the steps discussed can be generalized to any application. 1 Introduction Explainable Boosting Machines (EBMs) are a simple and interpretable machine learning (ML) algorithm introduced by Nori et al. 2019 that have brought many advancements to medical, health care, and financial applications. EBMs are interpretable, meaning, by nature, their decision-making processes can be easily articulated and understood. In high-stakes fields understanding how a model arrived at its conclusions is paramount for avoiding harmful mistakes. ML models can suffer from problems such as encoded bias ( Noiret et al. 2021 ; McGovern et al. 2024 ) and other faulty strategies ( Lapuschkin et al. 2019 ; McGovern et al. 2022 ) . Being able to observe and understand the underlying processes may help to alleviate such issues. This paper evaluates the use of EBMs, in combination with feature engineering, to obtain an interpretable, physics-based machine learning algorithm for a satellite imagery analysis application in meteorology. 1.1 Interpretable AI for Meteorological Applications For high-stakes applications such as severe weather forecasting, forecasters need to trust and understand the models they use. A key part of building that trust is establishing their failure modes . Knowing in which situations a method might fail and what that failure might look like is an instrumental step in rolling out a model into operational use. While any ML model can be susceptible to adopting faulty strategies, it is very hard to detect these issues and understand the failure modes they lead to in typical complex, black-box ML models ( Rudin 2019 ) . Two broad methods for building understanding of ML models have been developed: Explainable AI (XAI) and Interpretable AI ( Flora et al. 2023 ) . XAI methods seek to create post-hoc explanations for the behavior of a black-box model, and have been utilized in many atmospheric applications; see, e.g., McGovern et al. 2019 ; Toms et al. 2020 ; Bommer et al. 2024 ; Fan et al. 2024 ; Krell et al. 2024 , and references therein. These methods, however, are generally limited to identifying strategies that a model employed for a specific sample, which makes establishing a broad understanding of all strategies and failure modes of a model extremely challenging. An alternative to XAI is Interpretable AI, which entails utilizing ML pipelines that are inherently interpretable, i.e., models that make their strategies directly legible to users and as such do not require post-hoc explanations. This approach is advocated by Rudin 2019 and is the approach used here. Along the same guidelines, Hilburn 2023 attempted to build interpretability into their model by replacing a neural network with a combination of feature engineering (applying spatial derivatives and pooling operations to the inputs) and linear regression. This approach was able to reveal additional prediction strategies that were not obvious using XAI; however, the data preparation and model training were cumbersome using this approach. In this research, we explore a different type of Interpretable AI method, namely the method of Explainable Boosting Machines (EBMs), inspired by a talk given by Caruana 2023 on the benefits of using EBMs. Motivated by this talk, we set out to explore whether EBMs can also be applied to meteorological applications. As a sample application, we chose to explore how EBMs can be used to predict the location of overshooting tops (OTs) in satellite imagery. This task has been taken on multiple times before ( Bedka et al. 2010 ; Bedka and Khlopenkov 2016 ; Khlopenkov et al. 2021 ) including, more recently, by using complex, black-box machine learning models ( Kim et al. 2017 ; Cooney et al. 2025 ) . In this paper, we seek to leverage EBMs to develop a simplified approach. We first apply physics-based feature engineering to simplify the task, then apply EBMs using those features to gain a fully interpretable ML model. By using such a simple ML method, we hope to achieve good performance—though perhaps not quite as good as that of complex ML methods—while gaining full interpretability, including the ability to identify the failure modes of the model. We emphasize that the goal of this study is not to deliver a new, state-of-the-art OT identification algorithm. Instead, our primary goal is to explore the ML technique of EBMs and its unique capabilities for meteorological applications. The application of OT identification is used only to demonstrate the step-by-step process of developing an EBM for such an application. 1.2 Sample Application - Detecting Overshooting Tops in Satellite Imagery The importance of detecting and monitoring OTs is revealed through their connection with convective storms and, in general, the occurrence of severe weather. More specifically, satellite imagery has been used to connect OT signatures with the occurrence of severe weather events such as heavy rainfall, strong winds, hail, and tornadoes ( Negri and Adler 1981 ; Heymsfield et al. 1991 ; Brunner et al. 2007 ; Dworak et al. 2012