Explainable Comparison of Feature-Based and Deep Learning Models for TROPOMI Methane Plume Screening

Solomiia Kurchaba, Joannes D. Maasakkers, Berend J. Schuit, Ilse Aben · 2026

Read Explainable Comparison of Feature-Based and Deep Learning Models for TROPOMI Methane Plume Screening by Solomiia Kurchaba, Joannes D. Maasakkers, Berend J. Schuit, Ilse Aben (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27236.txt.

Introduction

Kurchaba and co-authors compare two ways to tell true methane plumes from look-alike artifacts in TROPOMI satellite data. Many plume-like features are not real emissions at all, but artifacts from terrain, surface brightness, aerosols, coasts, or water. Older work used expert-built features with a support vector machine, which drops spatial layout and narrows what the model can see. The authors test feature-based models against image-based networks under balanced and skewed test settings, then use SHAP explanations to guide model choice for live screening.

Catalog record

CREATORSolomiia Kurchaba, Joannes D. Maasakkers, Berend J. Schuit, Ilse Aben
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50455
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.27236

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Explainable Comparison of Feature-Based and Deep Learning Models for TROPOMI Methane Plume Screening Solomiia Kurchaba, Joannes D. Maasakkers, Berend J. Schuit, Ilse Aben Abstract . Continuous and global detection of large methane emissions is a crucial step for global warming mitigation. Satellite observations, such as from S5P/TROPOMI, combined with plume detection algorithms, can play a key role in this effort. However, not all TROPOMI plume detections that look like methane emission plumes are the result of actual emissions. A significant part of the plume-like features in the data are retrieval artifacts. Such artifacts could be the result of variations in elevation or albedo gradients, high concentrations of aerosols, coastal lines, water bodies, etc. Previous work approached the problem of plume-artifact classification by means of a Support Vector Machine Classifier (SVC), trained on an extensive set of observation-based scalar features designed by the domain experts. However, such an approach limits the information scope received by the algorithm to what is deemed to be important by the experts, breaks the spatial relationship between pixels, and loses information during the process of statistical aggregation. In this study, we compare feature-based (SVC, Random Forest, XGBoost) and image-based (ResNet-18, ResNet-34) models for methane plume–artifact classification under balanced and imbalanced evaluation settings. To interpret the results, we apply SHAP-based explainability to both model families. Our findings provide practical guidance for model selection in operational methane-screening workflows such as the CAMS Methane Hotspot Explorer. 1. Introduction Anthropogenic methane emissions are responsible for more than 30% of human-caused global warming ( 23 ; 21 ) . Moreover, a substantial fraction of total methane emissions originates from a relatively small number of very large sources, often referred to as “super-emitters”, including coal mines, oil and gas infrastructure, and landfills. Consequently, effective mitigation of global warming in the short term benefits from the continuous monitoring of these super-emitters. The TROPOspheric Monitoring Instrument (TROPOMI) on board the ESA Sentinel-5 Precursor (S5P) satellite ( 31 ) plays a key role in this monitoring. Launched in 2017, TROPOMI is the first instrument capable of detecting methane emission plumes from super-emitters globally on a daily basis ( 14 ; 26 ) . Here, we compare feature-based and image-based machine learning techniques to screen plumes detected in these data for artifacts. In satellite observations, emissions from super-emitters typically manifest as localized methane plumes, making plume detection in TROPOMI data a key step in identifying large, localized emission sources. Over more than seven years of operation, TROPOMI has performed a vast number of methane observations, which include many plume-like signals that cannot realistically be all identified through manual inspection. As a result, monitoring this growing volume of data for super-emitter activity requires automated detection methods, creating opportunities for machine learning approaches that depend on large and representative training datasets. However, detecting methane plumes in TROPOMI data remains challenging, as not every plume-like feature corresponds to an actual emission. Retrieval artifacts can closely resemble real methane plumes. Such artifacts may arise from factors including elevation or surface albedo gradients, high aerosol loading, coastlines, and the presence of water bodies. The Methane Hotspot Explorer is a new application launched by the Copernicus Atmospheric Monitoring Service (CAMS) ( 6 ) to provide, on a weekly basis, large methane plumes detected worldwide by TROPOMI, thereby drawing global attention to the issue of large concentrated methane emissions. The application relies on the processing of TROPOMI methane data with a machine learning-based pipeline introduced by ( 26 ) . The first step of the pipeline is to identify methane plumes among all image patches (small spatial subsets) extracted from TROPOMI methane data. As a second step, another machine learning model is used to distinguish genuine methane plumes from retrieval artifacts. Finally, before being published on the Methane Hotspot Explorer, detections classified as plumes by the second machine learning model are double-checked manually by two independent expert labelers. Thus, the optimal performance of the plume-artifact classifier of this pipeline is crucial for reducing the human labor, as well as, maximizing the number of reported methane plumes. In ( 26 ) , as the second step of the presented pipeline, the authors used a support vector machine (SVM) classifier trained on an extensive set of features designed by domain experts. The primary advantage of this approach is that multivariate modeling enables the extraction of relationships among variables that contribute to the formation of artifacts. However, this methodology also constrains the information available to the algorithm to the set of features deemed to be important by experts, disrupts the spatial relationships between pixels, and results in information loss through statistical aggregation. In this study, we compare the performance of several feature-based and image-based classification models for the task of methane plume–artifact classification. We compare the performances of the models in two complementary regimes: balanced and imbalanced evaluation settings. In the imbalanced setting, we have more instances of one class in the dataset such as can be expected in a real-world application. The balanced setting, on the other hand, isolates the discriminative capacity of the models by removing class domination effects. In addition, we conduct a unified interpretability analysis for both feature-based and image-based models to understand the main factors contributing to the performance of both studied model types. The paper is organized as follows: Section 2 reviews previous work on the topic of methane detection with machine learning. In Section 3 , we explain our methodology by introducing the used data sources, machine learning concepts and the dataset. We present our results in Section 4 composed of metrics and the explainability analysis, and discuss the findings in Section 5 . 2. Literature Review Various machine learning methods have been applied for tasks related to methane detection, ranging from feature-based models such as SVMs to deep neural networks applied to images ( 26 ; 28 ; 7 ; 15 ; 5 ) . In ( 26 ) , the basis of this work, the authors applied an SVM to distinguish the emission plumes from retrieval artifacts on TROPOMI data. Other studies have also used data with higher spatial resolution, ranging from 0.5 to 60 meters, both satellite and airborne instruments. In ( 7 ) , a UNet-based architecture model was used for segmenting methane plumes on data from the Earth Surface Mineral Dust Source Investigation (EMIT) instrument. A UNet model was also used in ( 25 ) to segment methane plumes from a combination of hyperspectral and multispectral satellite images. In ( 24 ) , the authors tested several deep learning architectures to enhance the precision of methane quantification using Sentinel-2 data. In ( 15 ) , a Hyperspectral Mask-RCNN model was used to autonomously represent and detect methane plumes using data from the Airborne Visible/Infrared Imaging Spectrometer Next Generation (AVIRIS-NG). The proposed model outperformed feature-based models such as SVM and logistic regression. Finally, in ( 35 ) , the authors showed the efficiency of a ResNet architecture for the task of classification between the Sentinel-2 images containing synthetic, simulated methane plumes and images that do not contain (synthetic) methane enhancements. Our work extends beyond ( 26 ) , which is currently used for the CAMS Methane Hotspot Explorer. Specifically, for the task of plume-retrieval artifact

Read the complete text