NOT EVERY TREE IS A FOREST: BENCHMARKING FOREST TYPES FROM SATELLITE REMOTE SENSING

Yuchang Jiang ∗, Maxim Neumann · 2025

Read NOT EVERY TREE IS A FOREST: BENCHMARKING FOREST TYPES FROM SATELLITE REMOTE SENSING by Yuchang Jiang ∗, Maxim Neumann (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-01805.txt.

Introduction

Yuchang Jiang and Maxim Neumann build a world data set for telling forest types apart from space in a 2025 paper. Most land maps lump all forest into one class, yet saving nature means knowing a wild forest from a planted one or a tree crop, a need sharpened by new trade rules.

Their benchmark, ForTy, holds two hundred thousand time series of satellite patches. Each mixes two satellite eyes with climate and height data across the seasons. Every pixel is labeled by forest type or other land use. The authors test several standard models and add a new transformer built for this multi-source, time-stamped input. Their model topped the baselines at sorting the three forest kinds.

Catalog record

CREATORYuchang Jiang ∗, Maxim Neumann
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE18 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-01805

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

NOT EVERY TREE IS A FOREST: BENCHMARKING FOREST TYPES FROM SATELLITE REMOTE SENSING Yuchang Jiang ∗, Maxim Neumann Abstract Developing accurate and reliable models for forest types mapping is critical to support efforts for halting deforestation and for biodiversity conservation (such as European Union Deforestation Regulation (EUDR)). This work introduces ForTy, a benchmark for global-scale FORest TYpes mapping using multi-temporal satellite data 1 1 1 ForTy (v1) is released under CC-BY-SA 4.0 license. Access instructions at github.com/google-deepmind/forest_typology . . The benchmark comprises 200,000 time series of image patches, each consisting of Sentinel-2, Sentinel-1, climate, and elevation data. Each time series captures variations at monthly or seasonal cadence. Per-pixel annotations, including forest types and other land use classes, support image segmentation tasks. Unlike most existing land use products that often categorize all forest areas into a single class, our benchmark differentiates between three forest types classes: natural forest, planted forest, and tree crops. By leveraging multiple public data sources, we achieve global coverage with this benchmark. We evaluate the forest types dataset using several baseline models, including convolution neural networks and transformer-based models. Additionally, we propose a novel transformer-based model specifically designed to handle multi-modal, multi-temporal satellite data for forest types mapping. Our experimental results demonstrate that the proposed model surpasses the baseline models in performance. I Introduction Forests play a crucial role in mitigating climate change while providing social, economic, and cultural benefits. It is especially important to differentiate between natural forests, planted forests, and tree crops to create actionable data supporting policy-making, conservation, and sustainable forest management [ 1 ] . However, AI and computer vision research mostly focuses on forest recognition, differentiating only between forested and non-forested areas [ 2 , 3 , 4 , 5 ] . For instance, forest plantations for rubber or timber are still classified as forest cover [ 6 ] . While these maps provide a basic overview, they are inadequate for addressing deforestation risks and monitoring degradation, particularly under regulations like the European Union Deforestation Regulation (EUDR). Satellite imagery and remote sensing, combined with machine learning, have become vital tools for forest monitoring. Foundation models trained on large-scale datasets are gaining traction in remote sensing but primarily capture general satellite image representations [ 7 , 8 ] . A large-scale benchmark tailored for forest types mapping could advance this field and enable the development of forest-specific foundation models. While existing forest-related machine learning benchmarks provide valuable resources, they have notable limitations. For instance, BigEarthNet [ 9 ] is a large dataset designed for deep learning but focuses on general land-cover classification rather than forest type mapping and provides only per-image labels. Regionally constrained datasets, such as TreeSatAI [ 10 ] and BioMassters [ 11 ] , are tailored to specific forest-related tasks but are not designed for forest type mapping. A more closely related dataset is Planted [ 12 ] , which utilizes the Spatial Database of Planted Trees (SDPT) [ 1 ] (a collection of data sources, including among others [ 13 , 14 , 15 , 16 , 17 ] ) to identify planted forests and tree crops. However, it also provides only per-image labels and lacks negative samples for non-planted forests. These limitations underscore the need for a comprehensive benchmark that enables detailed forest types mapping with per-pixel labels on a global scale. We introduce ForTy, a new global-scale, multi-modal multi-temporal benchmark dataset designed to advance research in forest types mapping. ForTy features 200,000 globally distributed locations annotated with per-pixel labels and includes detailed forest classes: natural forests, planted forests, and tree crops, alongside non-forest categories. We propose a new transformer-based model (MTSViT) for forest type mapping and provide initial baselines results for the benchmark. II The ForTy dataset Fig. 1 : ForTy dataset stratified random sample locations. To enable global wall-to-wall mapping, our reference data contain 8 classes: three forest classes (natural forest, planted forest, tree crops), other vegetation, water, ice, bare ground, and built areas. For natural forest class, we integrate data from diverse sources to achieve a global coverage: primary humid tropical forests [ 2 ] , primary forests in Europe [ 3 ] , Canada [ 18 ] , and USA [ 19 ] , natural forests from tropical moist forests (TMF) [ 20 ] , and natural lands from Science Based Targets Network (SBTN) [ 21 ] . For planted forest class, we merge planted forests from the planted areas from TMF [ 20 ] and SDPT [ 1 ] . The tree crop class integrates data from SDPT [ 1 ] , CORINE Land Cover [ 22 ] , and tree crop species in cropland from national agricultural statistics service (USDA) [ 23 ] with several regional tree crop datasets covering a diverse range of tree crops, including palm, cocoa, rubber, coffee, coconut, cashew, and other orchards [ 24 , 25 , 26 , 27 , 28 , 29 , 30 , 31 , 32 ] . The other vegetation class includes areas identified as shrubland, grassland, and cropland in WorldCover [ 4 ] and areas labeled as vegetation in SBTN [ 21 ] . Only pixels confirmed by both data sources are assigned to the other vegetation class. For non-vegetation classes ( water , ice , bare ground , built areas ), we use labels from World Cover [ 4 ] . When integrating the three forest layers, we address disagreements between forest types by assigning a forest label only when there is consensus among the layers. In cases of disagreement, the pixels are labeled as unknown . To incorporate non-forest classes, we use a tree height map [ 33 ] , adding non-forest labels only to areas where the tree height is less than 5 m. For regions affected by deforestation with high confidence of tree regrowth based on identified drivers [ 34 ] , we assign planted forest label if no other valid label is applied. We acknowledge the presence of noise in these data sources. Our goal is to develop methods that can effectively handle such noise, reflecting the complexities of real-world scenarios. II-A Satellite Data This benchmark dataset includes mutli-modal satellite inputs: Sentinel-2, Sentinel-1, climate, and elevation data (examples are shown in Figure 2 ). • Sentinel-2 provides multispectral optical satellite imagery. For this benchmark, we extract seasonal and monthly mosaics from Sentinel-2 imagery for up to three years (2018-2020). We use 10 spectral bands with nominal resolutions of 10 m and 20 m, which are particularly useful for land cover mapping. • Sentinel-1 is a Synthetic Aperture Radar (SAR) satellite with 10 m resolution. Similar to Sentinel-2, we create mosaics for three years and use VV and VH polarizations from both ascending and descending orbits. • Climate [ 35 ] is a monthly climate dataset with a spatial resolution of approximately 4 km. This dataset provides key climate and water balance variables globally. • Elevation is sourced from FABDEM [ 36 ] , based on Copernicus GLO 30 DEM with forests and buildings removed, providing elevation, slope, and aspect. Fig. 2 : Examples from left to right: (1) Sentinel-2 RGB bands, (2) Sentinel-2 SWIR-NIR-Red bands, (3) multi-temporal Sentinel-1 VV winter-spring-summer composition, (4) elevation, (5) labels. Bottom row:

Read the complete text