Fighting Fires from Space: Leveraging Vision Transformers for Enhanced Wildfire Detection and Characterization

Aman Agarwal, James Gearon, Raksha Rank, Etienne Chenevert · 2025

Read Fighting Fires from Space: Leveraging Vision Transformers for Enhanced Wildfire Detection and Characterization by Aman Agarwal, James Gearon, Raksha Rank, Etienne Chenevert (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-13776.txt.

Introduction

Aman Agarwal and co-authors test vision transformers for wildfire detection from space in a 2025 paper. Fires are growing in intensity and length as the climate warms, and response systems are strained. Neural networks trained on satellite images can spot fires, but common designs are costly and use only local image context.

Transformers train more efficiently and use both local and global context. On a published Landsat data set, a transformer beat a specialized network baseline by a small margin. Yet the team own tuned U-Net design performed best overall. The results show transformers are capable, while well tuned networks still lead.

Catalog record

CREATORAman Agarwal, James Gearon, Raksha Rank, Etienne Chenevert
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-13776

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Fighting Fires from Space: Leveraging Vision Transformers for Enhanced Wildfire Detection and Characterization Aman Agarwal, James Gearon, Raksha Rank, Etienne Chenevert Abstract Wildfires are increasing in intensity, frequency, and duration across large parts of the world as a result of anthropogenic climate change. Modern hazard detection and response systems that deal with wildfires are under-equipped for sustained wildfire seasons. Recent work has proved automated wildfire detection using Convolutional Neural Networks (CNNs) trained on satellite imagery are capable of high-accuracy results. However, CNNs are computationally expensive to train and only incorporate local image context. Recently, Vision Transformers (ViTs) have gained popularity for their efficient training and their ability to include both local and global contextual information. In this work, we show that ViT can outperform well-trained and specialized CNNs to detect wildfires on a previously published dataset of LandSat-8 imagery de Almeida Pereira et al. 2021 . One of our ViTs outperforms the baseline CNN comparison by 0.92%. However, we find our own implementation of CNN-based UNet to perform best in every category, showing their sustained utility in image tasks. Overall, ViTs are comparably capable in detecting wildfires as CNNs, though well-tuned CNNs are still the best technique for detecting wildfire with our UNet providing an IoU of 93.58%, better than the baseline UNet by some 4.58%. Keywords CNN \cdot Transformers \cdot Wildfire Figure 1: Publication counts containing the keyword “Wildfire Detection” in recent years source: Web of Science. 1 Introduction As a consequence of anthropogenic climate perturbation along with a century of fire-management practices that left considerable amounts of natural fuel covering large parts of the land-surface, wildfires have increased in frequency, intensity, and duration over the past two decades UN2 2022 . Wildfires can have disastrous impacts on ecosystems, human society, and the global economy. Indeed, changes in air-quality in the western US, Australia, and elsewhere, have increased in recent years leading to healthcare impacts (IPCC). Furthermore, wildfire has ravaged agricultural and pastoral land, leading to quantifiable economic losses. It is therefore imperative to detect wildfire activity as early as possible so that real-time risking can be done and relevant information relayed to regional and local officials. The conventional method for early fire detection consists of specialized fire lookouts or localized camera monitors deployed in previously identified fire-prone areas Dewangan et al. 2022 . Clearly, these methods are only effective at a local scale, whereas wildfire is a regional or landscape-scale phenomenon. The era of satellite observation has allowed for complete near-real time coverage of the global landscape. In this work, we aim to recreate a published method de Almeida Pereira et al. 2021 for wildfire detection using Vision Transformers (ViT) trained on a suite of labeled satellite images. These techniques that incorporate global imagery can scale to match the spatial area of regional wildfire events and can be deployed to give updates. The utility of an accurate, robust, and efficient wildfire detection system cannot be understated. Wildfire studies is a fast-growing subfield of earth science that has received increased attention from both state and federal government funding agencies over the last 30 years (Figure 1 ). Record counts from the popular Web of Science database demonstrate the increased demand for studies concerning automated or semi-automated wildfire detection. An additional motivation for this work is the need in the remote sensing community for computer vision practitioners and subject matter experts. Both fields involve image processing, but rarely communicate. Furthermore, the amount of data produced and telemetered by earth observing satellites is immense, amounting to approximately 10 Terabits per day and growing still UN2 2022 . This volume and velocity of data necessitates sophisticated computer vision algorithms for processing. However, this volume of data also makes training remote-sensing based algorithms like convolutional neural networks computationally costly, as individual images can be several megabytes in size and contain 10s of channels in the form of image bands. To realize efficient and reliable remote wildfire detection, it is imperative for the designer to reduce training time as much as possible, as to incorporate new data quickly. 2 Background Recently, ‘Vision Transformers’ or ViTs have become popular in the field of Computer Vision for their efficiency and flexibility for a suite of vision related tasks. ViTs require substantially less computational resources, making them a fit tool to identify wildfires remotely and accelerate emergency response time. The ViT concept comes from a pioneering publication by Dosovitskiy et al. Dosovitskiy et al. 2020 , where the authors implement a transformer architecture for images and compare their results against the a CNN architecture, finding that they are able to achieve similar results as the CNN by subdividing the input image into ‘patches’ and applying a transformer to the patches as they propagate information through the network. As applied to remote sensing, the ViT architecture has recently been used by Bazi et al. Bazi et al. 2021 where they test the model’s performance in land type classification. This is a promising finding that indicates that the ViT architectural approach can be readily applied to many scientific questions in remote sensing as long as there is sufficient training data and a desired classification output. Figure 2: Fire as visualized from three different bands of a Landsat image. Part (a), (b), and (c) show a range of bands (Blue, Near Infrared, and SWIR2) to demonstrate transparency to clouds at different wavelengths, and part (d) shows the ground truth mask of wildfire. Bands 2 (Blue), 3 (Green), and 4 (Red) fall in the visible light spectrum and may not show fire most of the times due to occlusion by clouds and smoke. This is also the case for the near infrared portion of the spectrum (band 5 NIR). However, band 6 (SWIR1) and 7 (SWIR2) part of the short wave infrared spectrum and are therefore resolve fire more readily. In this work, we propose to integrate the Vision Transformer introduced by Dosovitskiy et al. Dosovitskiy et al. 2020 into the wildfire detection framework of Pereira et al. de Almeida Pereira et al. 2021 . As a part of that project, the authors generated a large (200 GB compressed) dataset of annotated LandSat-8 Operational Land Imager (OLI) satellite images for active fire detection using semantic segmentation. More specifically, the authors include a comparison of handcrafted fire detection algorithms using Landsat spectral bandwidth data and three variations of CNN algorithms derived from a U-Net architecture. The first network (U-Net 10c) was assembled with the traditional U-Net structure taking a 10-channel Landsat image as input, the second design (U-Net 3c) sought to reduce memory usage by taking a 3-channel Landsat image as input, and a third design (U-Net-Light 3c) was created from a structure like U-Net 3c, but with the number of filters per layer being reduced by 4 times. The results proved that the author’s trained CNNs were able to reproduce the fire detection accuracy of previous fire detection algorithms reasonably well. Interestingly, they found each of the CNN model designs performed to roughly the same accuracy, indicating that large, complex models (U-Net 10c) are not necessary in properly identifying wildfires. Rather, smaller, less complex models (U-Net 3c and U-Net-Light 3c) created from 3 channel inputs, specifically channels 7, 6, and 2

Read the complete text