Real-Time Wildfire Localization on the NASA Autonomous Modular Sensor using Deep Learning

Yajvan Ravan, Aref Malek, Chester V. Dolph, and Nikhil Behari · 2026

Read Real-Time Wildfire Localization on the NASA Autonomous Modular Sensor using Deep Learning by Yajvan Ravan, Aref Malek, Chester V. Dolph, and Nikhil Behari (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-14475.txt.

Introduction

Yajvan Ravan, Aref Malek, Chester V. Dolph, and Nikhil Behari build a wildfire dataset in this 2026 paper. High-altitude, multi-spectral aerial imagery is scarce and expensive to acquire. Yet such data are necessary for advances in machine learning for high-impact problems like wildfire detection. The team introduces a human-annotated dataset from the NASA Autonomous Modular Sensor.

The sensor takes 12-channel aerial images at medium to high altitude, from 3 to 50 kilometers. The images match those used in current United States wildfire missions. Their system localizes wildfires in that imagery in real time with deep learning. Readers get both new data and a detection method trained for real mission conditions.

Catalog record

CREATORYajvan Ravan, Aref Malek, Chester V. Dolph, and Nikhil Behari
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-14475

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Real-Time Wildfire Localization on the NASA Autonomous Modular Sensor using Deep Learning Yajvan Ravan, Aref Malek, Chester V. Dolph, and Nikhil Behari Abstract High-altitude, multi-spectral, aerial imagery is scarce and expensive to acquire, yet it is necessary for algorithmic advances and application of machine learning models to high-impact problems such as wildfire detection. We introduce a human-annotated dataset from the NASA Autonomous Modular Sensor (AMS) using 12-channel, medium to high altitude (3 - 50 km) aerial wildfire images similar to those used in current US wildfire missions. Our dataset combines spectral data from 12 different channels, including infrared (IR), short-wave IR (SWIR), and thermal. We take imagery from 20 wildfire missions and randomly sample small patches to generate over 4000 images with high variability, including occlusions by smoke/clouds, easily-confused false positives, and nighttime imagery. We demonstrate results from a deep-learning model to automate the human-intensive process of fire perimeter determination. We train two deep neural networks, one for image classification and the other for pixel-level segmentation. The networks are combined into a unique real-time segmentation model to efficiently localize active wildfire on an incoming image feed. Our model achieves 96% classification accuracy, 74% Intersection-over-Union(IoU), and 84% recall surpassing past methods, including models trained on satellite data and classical color-rule algorithms. By leveraging a multi-spectral dataset, our model is able to detect active wildfire at nighttime and behind clouds, while distinguishing between false positives. We find that data from the SWIR, IR, and thermal bands is the most important to distinguish fire perimeters. Our code and dataset can be found here: https://github.com/nasa/Autonomous-Modular-Sensor-Wildfire-Segmentation/tree/main and https://drive.google.com/drive/folders/1-u4vs9rqwkwgdeeeoUhftCxrfe_4QPTn?=usp=drive_link 1 Introduction Wildfires are a pervasive and ever-growing problem across the world. With the advent of climate change, wildfires are becoming stronger, more frequent, and more unpredictable. From property damage to poor air quality, wildfires are the cause of many annual problems for those who live in areas prone to them. In 2021, wildfires generated a cost of $15.5 billion dollars in damages and response [ 30 ] . Over 1 in 6 homes in the US is at risk of wildfires over the next 30 years [ 30 ] . Unfortunately, according to a joint workshop between NASA and the US Forest Service (USFS), numerous challenges are still present in wildfire management, including limited surveillance resources, accurate detection in cloudy conditions, limited data & model fusion, and challenges with integrating new technologies amidst diverse stakeholders which requires simplicity & interoperability [ 30 ] . Recent NASA work pursues other challenges presented in [ 30 ] . For example, [ 64 ] and [ 65 ] describe novel methods to estimate smoke emission and characterize smoke composition using emitted fire radiation. Most current methods for wildfire imaging and localization involve human interpretation to label captured imagery and direct response teams. The National Infrared Operations (NIROPS) component of the National Interagency Fire Center (NIFC) manages wildfire mapping for incident management across the nation [ 3 ] . NIROPS relies on manned aircraft with an onboard infrared sensor to gather large-scale, full-fire aerial imagery at altitudes around 10,000 feet and transmit them to ground stations [ 3 , 46 ] . Trained human firespotters then label these images with the location of the fire perimeter and heat sources, among other things, and this information is often used to direct response teams, oftentimes up to 12 hours after the original flight [ 3 , 46 ] . The imaging aircraft employed today by the US Forest Service’s (USFS) National Infrared Operations (NIROPS) [ 3 , 46 ] generate medium-altitude (3-50km), wide-terrain, and wide-spectrum remote-sensing imagery. NASA’s Ikhana Western States Fire Missions (2007–2009) flew the AMS (Autonomous Modular Sensor) at 12-13km and downlinked near-real-time fire products—hotspots, perimeters, and temperature-calibrated imagery—directly to incident command, demonstrating wide-area coverage with 3-50 meter ground sample distance (GSD) and reliable night operation [ 3 , 17 ] . Today’s U.S. fire agencies continue to rely on this modality: the Forest Service’s NIROPS program operates high-altitude line-scanner systems (Phoenix/AMS) to map large incidents—most often at night—with geo-rectified TIFFs (file format) and shapefiles delivered before morning briefings; line-scanner scan volumes reach 100k–400k acres/hour, enabling multiple large fires per sortie [ 61 , 28 , 50 ] . State programs mirror this playbook: California’s Fire Integrated Real-Time Intelligence System (FIRIS, two King Air B200s) provides near-real-time perimeter and hotspot intelligence to California Department of Forestry and Fire Protection (CAL FIRE), California Governor’s Office of Emergency Services (CAL OES), and local agencies [ 15 , 63 ] , and Colorado’s Division of Fire Prevention and Control (DFPC) Multi-Mission Aircraft (PC-12, 5.5-6km) streams IR/EO mapping to Colorado Wildfire Information Management System (CO-WIMS) for incident use without congesting the tactical airspace [ 11 , 10 ] . Beyond operations, NASA’s newer Compact Fire Infrared Sensing Testbed (c-FIRST) instrument flew January–March 2025 on the B-200 over the Palisades/Eaton fires to identify lingering hotspots, reinforcing the continued value of high-altitude thermal, infrared sensing for response and post-fire assessment [ 44 , 6 ] . Such a detection and response pipeline can be subject to expert error and could allow the fire to grow in the downtime between flight and response. Automation with computer vision has been explored in the domain of active wildfire detection. Some efforts have involved using algorithms with pre-determined thresholds for the intensities or ratios of various spectral bands [ 55 , 43 , 33 ] . However, this approach is strongly prone to false positives [ 13 ] . More recent works have explored deep learning [ 68 , 13 , 48 , 72 ] , but these focus on limited domains that are not widely used in current wildfire response missions, sticking to low-altitude imagery, satellite imagery, daytime imagery, RGB spectral data, or offline processing. As a result it is difficult to integrate these solutions into current wildfire operations. This work is organized as follows. In Section 2 , we review past work towards solving this problem. In Section 3 we explain existing challenges in past work and describe our dataset and imagery. We then describe the neural networks that comprise our model, their training, evaluation, and combination. Finally, in Section 3 we explain the results of testing our model, benchmark it against previous work, depict examples of simulated real-time inference, and compare it with ablated versions of our model using less spectral data. With this work, we hope to demonstrate a proof-of-concept of an automated wildfire localization system that can be integrated alongside humans into the aforementioned response pipeline and spark future work in this domain to eventually automate this process entirely. Our main contributions are as follows: 1. We create a manually-annotated dataset that mirrors modern-day wildfire observation missions using flights taken with the NASA Autonomous Modular Sensor (AMS) [ 3 ] 2. We train classification and segmentation networks on our dataset and combine these into a two-tier wildfire localization model. We demonstrate our algorithm’s ability to run in real-time on a simulated image feed. 3. We show that the usage of IR imagery and hand-labelled data improves the performance, especially recall, of our model compared to past methods. 2 Related Work 2.1 Datasets Given the niche domain of this problem, very few datasets exist. This presents

Read the complete text