Mitigating representation bias caused by missing pixels in methane plume detection
Julia Wąsala, Joannes D. Maasakkers, Ilse Aben, Rochelle Schneider, Holger Hoos, Mitra Baratchi · 2025
Read Mitigating representation bias caused by missing pixels in methane plume detection by Julia Wąsala, Joannes D. Maasakkers, Ilse Aben, Rochelle Schneider, Holger Hoos, Mitra Baratchi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-19478.txt.
Introduction
Julia Wąsala and five co-authors show how missing pixels in satellite images can bias methane plume detection and test ways to remove that bias. Clouds and sensor gaps leave pixels missing in a systematic way. A model can lazily learn that images with low coverage tend to carry certain labels, then under-detect plumes exactly where coverage is poor.
Several imputation approaches are evaluated for breaking the link between coverage and label. A weighted resampling scheme during training also enforces balance across coverage levels. Fairer detection matters because methane monitoring guides real emission cuts, and biased maps would misdirect that effort.
Catalog record
| CREATOR | Julia Wąsala, Joannes D. Maasakkers, Ilse Aben, Rochelle Schneider, Holger Hoos, Mitra Baratchi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-19478
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Mitigating representation bias caused by missing pixels in methane plume detection Julia Wąsala, Joannes D. Maasakkers, Ilse Aben, Rochelle Schneider, Holger Hoos, Mitra Baratchi Abstract Most satellite images have systematically missing pixels (i.e., missing data not at random (MNAR)) due to factors such as clouds. If not addressed, these missing pixels can lead to representation bias in automated feature extraction models. In this work, we show that spurious association between the label and the number of missing values in methane plume detection can cause the model to associate the coverage (i.e., the percentage of valid pixels in an image) with the label, subsequently under-detecting plumes in low-coverage images. We evaluate multiple imputation approaches to remove the dependence between the coverage and a label. Additionally, we propose a weighted resampling scheme during training that removes the association between the label and the coverage by enforcing class balance in each coverage bin. Our results show that both resampling and imputation can significantly reduce the representation bias without hurting balanced accuracy, precision, or recall. Finally, we evaluate the capability of the debiased models using these techniques in an operational scenario and demonstrate that the debiased models have a higher chance of detecting plumes in low-coverage images. Accepted as a workshop paper at MACLEAN - ECML/PKDD 2025. 1 Introduction Detecting and reducing large methane emissions is a promising approach towards mitigating global warming [ 9 , 11 ] . The TROPOMI satellite methane data product with daily global observations of atmospheric methane concentrations is a powerful resource for monitoring large emissions by detecting the associated methane plumes. Training ML models for methane plume detection is challenging, because the TROPOMI methane data product contains missing pixels not at random (MNAR) over clouds or water, as methane concentrations can only be retrieved over water under specific circumstances [ 12 ] . Since it is inevitable to have images with low coverage, it is important to be able to train models to detect plumes in scenes with missing pixels, such as over coastal areas. A simple approach to address missing pixels in satellite images is to remove images below a minimum coverage threshold before training. For higher resolution satellite images, such as Sentinel-2, missing pixels (e.g., due to cloud cover) can be imputed through interpolation or by using pixel values from a past scene [ 1 ] . These solutions are, however, insufficient for methane plume detection in automated feature extraction-based models for the following reasons. Firstly, many important regions where methane emissions occur have low coverage (more than 50\% of pixels missing), for example, because of proximity to coastlines. Secondly, imputation algorithms based on static Earth surface properties are poorly suited to dynamic atmospheric problems, where emissions change and plumes move with the wind. Thirdly, because of the comparatively low spatial resolution of TROPOMI compared with Earth imaging satellites such as Sentinel-2 (i.e., 7\times 5.5~\mbox{km}^{2} vs. 10\times 10~\mbox{m}^{2} ), interpolation is likely to yield results comparable to single-value imputation. Finally, mindlessly imputing missing values can exacerbate representation bias. In this work, we demonstrate that failing to adequately handle missing pixels, particularly in combination with automated feature extraction, can cause the model to associate image coverage with methane plume presence, leading to under-detection in low-coverage images. This incorrect association is related to the concept of shortcut learning and confounders [ 2 ] , a core concern in fair ML [ 3 ] . We propose to address the representation bias due to MNAR by using data-centric approaches and present the following contributions: • We evaluate two deterministic imputation approaches and propose two new non-deterministic ones. We show that the choice of imputation strategy can impact representation bias. • We propose a resampling scheme during training to remove the dependence between coverage and the class label and show that this approach significantly improves bias-related metrics without hurting accuracy. We further show that combining resampling with imputation strategies leads to the strongest bias reduction. • We evaluate the generalisation of the de-biasing approaches in an operational scenario and find that de-biased models increase the chance of finding plumes in low-coverage images. 2 Related Work Methane plume detection . Schuit et al. [ 17 ] propose to detect methane plumes in TROPOMI methane data [ 8 ] with a two-step ML pipeline that combines a CNN with an SVM, which reduces false positives by using physics-based features. This domain-informed approach shows robustness to image coverage, but lacks generalisability to related plume detection problems due to the methane-specific design. Wąsala et al. [ 20 ] enable the extension of this work to other gases by automatically designing end-to-end pipelines with neural architecture search. ML approaches have also been proposed to detect plumes from individual facilities in (limited coverage) high-resolution satellite data ( \sim 20~\mbox{m} ), such as from Sentinel-2 [ 18 ] and PRISMA [ 10 ] . In this work, we build on the work by Wąsala et al. [ 20 ] by designing new data-driven strategies inspired by approaches taken to address representation bias in Fair ML literature while maintaining the generalisability of automated feature extraction using neural networks. Missing data and Fair ML . Fernando et al. [ 6 ] show that simply removing instances with non-randomly missing features can exacerbate representation bias. To address this bias, fair ML approaches propose different ways to deal with missing data. Wang et al. [ 19 ] propose an algorithm for weighted resampling of the dataset to account for non-random missingness in multi-class classification of tabular data. Caton et al. [ 4 ] evaluate multiple imputation strategies and find that the choice of imputation can significantly impact fairness in tabular data classification. While most approaches focus on tabular data, we address the issue of MNAR in satellite data. We explicitly treat the missing data as a confounder and propose a simple approach for addressing bias in model predictions by removing the dependence between coverage and the image label. 3 Data We detect methane plumes in a dataset of 9046 images, each consisting of 32\times 32 pixel TROPOMI observations (Data version 19 [ 8 ] ). The dataset extends the methane plume detection dataset created by Schuit et al. [ 17 ] with ~5000 images detected using their model and verified by domain experts, creating a binary classification task ( 56\% “plume” and 44\% “not plume.”) [ 16 , 5 ] 1 1 1 http://earth.sron.nl/methane-emissions . Last accessed 19 June 2025 . The public dataset only includes confirmed methane plumes, while we also use detections labelled as “not plume.” Data is available upon request. . The “not plume” class contains clearly empty images and artefacts, instances with plume-like features in the primary channel that are due to correlations with other retrieval parameters, such as albedo, that cause false positives. To correctly classify these artefacts, we include six auxiliary data fields from the Sentinel-5P methane data product [ 8 ] : surface pressure, albedo (SWIR), aerosol optical thickness (SWIR), data quality assurance values, cloud fraction (from Schuit et al. [ 17 ] ), \chi^{2} of the methane retrieval and land surface classification. We use spatial blocking ( 3^{\circ}\times 3^{\circ} ) to partition the data into 64\% training, 16\% validation, and 20\% testing data,