Development and Application of Self-Supervised Machine Learning for Smoke Plume and Active Fire Identification from the FIREX-AQ Datasets
Nicholas LaHaye, Anistasija Easley, Kyongsik Yun, Huikyo Lee, Erik Linstead \orcidI, Michael J. Garay, Olga V. Kalashnikova \orcidH, Nicholas LaHaye, Anistasija Easley, Kyongsik Yun, Hugo Lee, Erik Linstead, Michael J. Garay, Olga V. Kalashnikova · 2025
Read Development and Application of Self-Supervised Machine Learning for Smoke Plume and Active Fire Identification from the FIREX-AQ Datasets by Nicholas LaHaye, Anistasija Easley, Kyongsik Yun, Huikyo Lee, Erik Linstead \orcidI, Michael J. Garay, Olga V. Kalashnikova \orcidH, Nicholas LaHaye, Anistasija Easley, Kyongsik Yun, Hugo Lee, Erik Linstead, Michael J. Garay, Olga V. Kalashnikova (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-15343.txt.
Introduction
Nicholas LaHaye, Anistasija Easley, and colleagues teach a model to find smoke and fire in airborne measurements without hand labels in a 2025 study. A major field campaign flew through wildfire and farm fire smoke to study air quality and climate effects, gathering far more data than analysts can annotate. Self-supervised learning lets the model learn structure from the unlabeled flights themselves, then surface smoke plumes and active fire fronts.
Automated spotting turns an archive too big to read into evidence about how fires pollute regions and warm the planet. The same approach suits future campaigns as fire seasons lengthen.
Catalog record
| CREATOR | Nicholas LaHaye, Anistasija Easley, Kyongsik Yun, Huikyo Lee, Erik Linstead \orcidI, Michael J. Garay, Olga V. Kalashnikova \orcidH, Nicholas LaHaye, Anistasija Easley, Kyongsik Yun, Hugo Lee, Erik Linstead, Michael J. Garay, Olga V. Kalashnikova |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-15343
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Development and Application of Self-Supervised Machine Learning for Smoke Plume and Active Fire Identification from the FIREX-AQ Datasets Nicholas LaHaye, Anistasija Easley, Kyongsik Yun, Huikyo Lee, Erik Linstead \orcidI, Michael J. Garay, Olga V. Kalashnikova \orcidH, Nicholas LaHaye, Anistasija Easley, Kyongsik Yun, Hugo Lee, Erik Linstead, Michael J. Garay, Olga V. Kalashnikova Abstract Fire Influence on Regional to Global Environments and Air Quality (FIREX-AQ) was a field campaign aimed at better understanding the impact of wildfires and agricultural fires on air quality and climate. The FIREX-AQ campaign took place in August 2019 and involved two aircraft and multiple coordinated satellite observations. This study applied and evaluated a self-supervised machine learning (ML) method for the active fire and smoke plume identification and tracking in the satellite and sub-orbital remote sensing datasets collected during the campaign. Our unique methodology combines remote sensing observations with different spatial and spectral resolutions. The demonstrated approach successfully differentiates fire pixels and smoke plumes from background imagery, enabling the generation of a per-instrument smoke and fire mask product, as well as smoke and fire masks created from the fusion of selected data from independent instruments. This ML approach has a potential to enhance operational wildfire monitoring systems and improve decision-making in air quality management through fast smoke plume identification and tracking and could improve climate impact studies through fusion data from independent instruments. keywords FIREX-AQ; fire and smoke detection; Big data applications; clustering; computer vision; image segmentation; self-supervised deep learning; multi-modal data fusion † † firstpage: 1 † † volume: 1 † † issue: 1 † † articlenumber: 0 † † year: 2025 † † copyright-year: 2025 † † hreflink: https://doi.org/ † † titlecitation: Development and Application of Self-Supervised Machine Learning for Smoke Plume and Active Fire Identification from the FIREX-AQ Datasets † † authornames: Nicholas LaHaye, Anistasija Easley, Kyongsik Yun, Huikyo Lee, Erik Linstead, Michael J. Garay, and Olga V. Kalashnikova † † authorcitation: LaHaye N.; Easley A.; Yun K.; Lee, H.; Linstead, E.; Garay, M. J.; Kalashnikova, O. † † address: 1 Spatial Informatics Group, LLC., Pleasanton, CA 94566, USA 2 Jet Propulsion Laboratory, California Institute of Technology, Pasadena, CA 91101, USA 3 University of California at Berkeley, Berkeley, CA 94720, USA 4 Fowler School of Engineering, Chapman University, Orange, CA 92866, USA 5 Machine Learning and Assistive Technology Lab (MLAT), Chapman University, Orange, CA 92866, USA † † corresponding: Correspondence: [email protected] † † hreflink: https://ntrs.nasa.gov/citations/20240001694 † † hreflink: https://madewithclay.org/ † † reftitle: References 1 Introduction An important and common application of machine learning (ML) is to identify and leverage latent patterns in data or imagery. A typical approach is to use supervised learning, which requires a set of truth labels that the ML method attempts to generalize to the problem of mapping from an input dataset X to the output Y through a set of features, M . The challenge with supervised learning, and even the recently popularized semi-supervised learning, is acquiring a sufficiently large and unambiguous set of labels, which often requires many hours of manual labor on the part of domain experts. Alternatively, self-supervised learning takes a similar input dataset X and finds relationships among the features M resulting in context-free groupings in the output Y . Because no labels are provided for the input, there are no labels provided in the output. To utilize the results, the labels or missing context must be assigned after the fact by experts, but this has proven to be a much less labor-intensive endeavor, all while keeping subject matter experts in the loop. In previous work, we demonstrated that feeding 2-dimensional images of instrument radiances, or Level 1 (L1) data, into Deep Belief Networks (DBNs) coupled with an unsupervised clustering method results in images automatically segmented into relevant geophysical objects LaHaye et al. (2019) . We further demonstrated that the same results can be achieved using a simplified architecture across select areas of the globe and for various kinds of land surface and atmospheric segmentation tasks LaHaye et al. (2021) . In our recent work LaHaye et al. (2024) , we have generalized our ML framework into an open-source software system called Segmentation, Instance Tracking, and data Fusion Using multi-SEnsor imagery (SIT-FUSE). This framework allows for various types of encoders, including regular and convolutional DBNs, Transformers, and Convolutional Neural Networks (CNNs), and we have moved from traditional unsupervised clustering to a deep-learning-based clustering approach. This approach, as a whole, has several unique benefits. First, it is not restricted to a particular remote sensing instrument with specific spatial or spectral resolution. Second, it has the potential to identify and “track” geophysical objects across datasets acquired from multiple instruments. Third, it allows for the joining of data from different instruments, ”fusing” the information within the self-supervised encoder. Finally, it can be applied to many different scenes and problem sets, most notably in no- and low-label environments, not just ones for which labeled training sets exist, which is required for strictly supervised ML techniques. Here we apply our self-supervised ML approach to the problem of automatically detecting and tracking wildfires and smoke plumes, through sequences of L1 (imagery) data acquired by multiple remote sensing instruments during the joint National Aeronautics and Space Administration/National Oceanic and Atmospheric Administration (NASA/NOAA) Fire Influence on Regional to Global Environments and Air Quality (FIREX-AQ) field campaign that took place in the western United States in the summer of 2019 Warneke et al. (2023) . The high-altitude NASA ER-2 carried seven remote sensing instruments that provided high-spatial resolution observations of fires and smoke plumes in conjunction with NASA DC-8 aircraft and multiple satellite overpasses over same fire events. The FIREX-AQ datasets of collocated satellite and multiple airborne imagery at different spatial resolution are excellent as a testbad for SIT-FUSE method of fire/smoke identification and tracking. Wildfires and the smoke plumes induced by wildfires substantially contribute to the carbon cycle and can have a long-lasting impact on air quality and Earth’s climate system. In addition, human-driven climate change is associated with more frequent and severe wildfires Williams et al. (2019) . Despite the importance and immediacy of the problem, most research and decision-support tools to study wildfires and plumes use observations from a single instrument whose spatial coverage and (spatial, spectral, and temporal) resolutions vary from very fine to very coarse scales, neither of which, on their own, is fully capable of providing the much-needed information for a comprehensive understanding of wildfires and wildfire smoke Stavros et al. (2019) . As such, the current study aims to bine datasets with different spatial resolutions from multiple instruments to create a patchwork of datasets that fill the temporal gaps present in current single-instrument fire detection datasets. Here, the first step is testing a general framework for segmenting the datasets from multiple instruments and identifying wildfires and smoke plumes. The detection and tracking of objects, like wildfires and smoke plumes, within a single instrument data has long required developing instrument-specific retrieval algorithms. Such development is labor-intensive and requires domain-specific parameters and instrument-specific calibration metrics, alongside the manual effort to track retrieved objects across multiple scenes Barmpoutis et al. (2020) . The recent development of retrieval algorithms is actively underway in the field of supervised deep learning (DL), and