Leveraging Image Generators to Address Training Data Scarcity: The Gen4Regen Dataset for Forest Regeneration Mapping
Gabriel \surname Jeanson 1,2,∗, David-Alexandre \surname Duclos 1,2, William \surname Larrivée-Hardy 1,2, Noé \surname Cochet 1,2, Matěj \surname Boxan 1,2, Anthony \surname Deschênes 2, François \surname Pomerleau 1,2, and Philippe \surname Giguère 1,2,∗ · 2026
Read Leveraging Image Generators to Address Training Data Scarcity: The Gen4Regen Dataset for Forest Regeneration Mapping by Gabriel \surname Jeanson 1,2,∗, David-Alexandre \surname Duclos 1,2, William \surname Larrivée-Hardy 1,2, Noé \surname Cochet 1,2, Matěj \surname Boxan 1,2, Anthony \surname Deschênes 2, François \surname Pomerleau 1,2, and Philippe \surname Giguère 1,2,∗ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-05627.txt.
Introduction
Forest managers need maps of which young tree species are growing back, but expert annotation of aerial imagery is slow and scarce. Gabriel Jeanson and sixteen co-authors attack that bottleneck with generated data. Their Gen4Regen framework uses a large vision-language image generator to synthesize high-resolution aerial views of forest regeneration zones.
The synthetic images supplement real drone photography for training segmentation models. The approach targets extreme class imbalance, since rare species appear in few real photographs. By reducing dependence on manual photo-interpretation, the framework aims to make fine-grained species mapping practical over much larger areas.
Catalog record
| CREATOR | Gabriel \surname Jeanson 1,2,∗, David-Alexandre \surname Duclos 1,2, William \surname Larrivée-Hardy 1,2, Noé \surname Cochet 1,2, Matěj \surname Boxan 1,2, Anthony \surname Deschênes 2, François \surname Pomerleau 1,2, and Philippe \surname Giguère 1,2,∗ |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 89 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.05627
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Leveraging Image Generators to Address Training Data Scarcity: The Gen4Regen Dataset for Forest Regeneration Mapping Gabriel \surname Jeanson 1,2,∗, David-Alexandre \surname Duclos 1,2, William \surname Larrivée-Hardy 1,2, Noé \surname Cochet 1,2, Matěj \surname Boxan 1,2, Anthony \surname Deschênes 2, François \surname Pomerleau 1,2, and Philippe \surname Giguère 1,2,∗ Abstract Sustainable forest management relies on precise species composition mapping, yet traditional ground surveys are labour-intensive and geographically constrained. While UAV offer scalable data collection, the transition to deep learning-based interpretation is bottlenecked by the severe scarcity of expert-annotated imagery, particularly in complex, visually heterogeneous regeneration zones. This paper addresses the dual challenges of data scarcity and extreme class imbalance in the semantic segmentation of fine-grained forest regeneration species by providing a scalable framework that reduces reliance on manual photo-interpretation for high-resolution, millimetre-level aerial imagery. Importantly, we leverage the large-scale vision-language Nano Banana Pro model to simultaneously generate high-fidelity images and their corresponding pixel-aligned semantic masks from prompts. We introduce WilDReF-Q-V2 , an expansion of a natural forest dataset with 13 977 13\,977 new unlabelled and 50 50 labelled real images, as well as the Gen4Regen dataset, featuring 2101 2101 pairs of synthetic images and semantic masks. Our methodology integrates real-world data with AI-generated images, addressing both data scarcity and class imbalance in forest regeneration mapping. We evaluate the orthogonality of manual labels, automated pseudo-labels, and synthetic data using Mask2Former and DINOv2 architectures, highlighting that AI-generated data is highly complementary to real-world pseudo-labels, with unified training yielding an F1 score improvement of over 15 % pt 15\text{\,}\mathrm{\%pt} compared to purely supervised baselines. Furthermore, we demonstrate that even small quantities of prompt-generated data significantly improve performance for underrepresented species, some of which saw per-species F1 score gains of up to 30 % pt 30\text{\,}\mathrm{\%pt} . We conclude that vision-language models can serve as agile data generators, effectively bootstrapping perception tasks for niche AI domains where expert labels are scarce or unavailable. This paradigm enables practitioners to bypass seasonal data collection constraints and develop specialized ecological monitoring systems with minimal manual effort. Our datasets, source code, and models will be available at https://norlab-ulaval.github.io/gen4regen . \DOI xxxxx \Year 2026 \corres ∗ Corresponding authors. E-mails: [email protected], [email protected] 1 Introduction Forest regeneration is critical for sustainable land management and biodiversity conservation, particularly following disturbances such as wildfire, disease, or logging. Effective silvicultural operations play a crucial role in forest regeneration, especially with changing climate conditions ( 46 ; 1 ) . However, the success of these operations depends on precise monitoring. This includes assessing restoration success and optimizing interventions like planting, thinning and plant control. An important challenge of this forest regeneration surveillance lies in the accurate identification of species composition, which is crucial for detecting competing vegetation, dead trees, and debris. These components are essential for supporting informed and timely management decisions. Traditionally, these data were gathered via ground-based surveys, but their time-intensive nature and the logistical challenges of accessing remote, rugged terrain make them inefficient for surveying large forest areas. Consequently, alternative approaches have received increasing attention, as reflected in a recent survey of over 300 forest practitioners highlighting strong interest in species composition mapping using remote sensing for silvicultural planning ( 17 ) . Figure 1 : Overview of our model training pipeline, combining 199 manually-labelled, 25\,106 pseudo-labelled real images, and 2101 synthetic labelled images. The pseudo-labelled real images are equivalent to over 550\,000 image crops of 1 MP. The top left (purple outline) represents our primary contribution, the Gen4Regen dataset, which serves to demonstrate that image generators can now produce photorealistic images and corresponding annotations as viable training data for semantic segmentation. For this, we leverage the Nano Banana Pro model to produce 2101 synthetic, drone-view images and masks of boreal forest regeneration. This component is key in addressing the scarcity of labelled data and class imbalance. The transition to UAV imagery provides a highly scalable alternative for data collection, but it fundamentally shifts the bottleneck from physical field access to data interpretation . Deep learning is a promising approach to the latter, but supervised learning algorithms require large quantities of precisely labelled data to generalize effectively across environments. While the broader machine learning community has directed significant resources to create datasets toward mainstream perception tasks like urban autonomous driving or robotic grasping, fine-grained ecological perception remains an orphaned AI ( AI ) problem ( 42 ) . Thus, from a computer vision perspective, our species composition mapping represents a data-scarce problem. Moreover, the task requires models to navigate widespread class imbalance, visual heterogeneity, and fuzzy boundaries, particularly at fine spatial scales such as small grass leaves. Furthermore, unlike urban environments where bounding boxes are easily drawn by crowd-sourced workers, annotating high-resolution overhead images of vegetative cover requires specialized photo-interpretation by forestry or botanical experts, resulting in a severe scarcity of real annotated images. Figure 2 presents on the left side an example of a UAV image and its corresponding expert annotation. It highlights two problems: 1) expert annotations are generally approximations, and 2) the labelling process is time-consuming, as every pixel of the high-resolution image needs an annotation. Figure 2 : UAV image (top left) with its corresponding manually labelled semantic segmentation mask (bottom left), compared to a prompt-generated image (top right) and its associated prompt-generated mask (bottom right) produced using Nano Banana Pro. The manually annotated mask is intentionally coarser to reduce labelling costs. In contrast, the generated mask captures significantly finer detail, delineating individual plant structures with high precision. Furthermore, the synthetic image (top right) highlights the level of photorealism achievable with image generators. Previous approaches of doing photo-interpretation tasks on UAV imagery have focused more on mature forests, with a traditional supervised learning approach relying on hand-labelled images. For instance, Detectree2 ( 2 ) was trained to perform tree crown segmentation in natural environments with 3.8k annotations, while BAMFORESTS ( 54 ) relied on 27k annotations. Similar approaches have been done for tree species identification ( 18 ; 16 ) . In all cases, they required significant manual annotation efforts. These limitations have increasingly motivated interest in alternative strategies that reduce reliance on exhaustively labelled real‑world imagery. In parallel, one way to solve class imbalance in semantic segmentation, a key issue in our situation, is to perform random oversampling of minority classes. However, this approach is ill-suited to images with strong intra-image class imbalance, such as vegetative cover scenes. To mitigate this limitation, some alternative approaches exist, for instance, 53 present an automatic way of segmenting images of plants from one data source (citizen science data), and then pasting them into UAV imagery. However, the quality of the augmentation is limited by the ability to segment the plant accurately, and then to harmonize its appearance with the target domain ( UAV imagery). An alternative approach to tackle both issues is the use of synthetic data ( 22 ; 5 ) . These efforts have historically relied on explicit procedural modelling using 3D assets and game engines, which struggle to accurately replicate the chaotic photorealism of the natural regeneration forests that define our operating environment. In response to these considerations, we propose a comprehensive methodology that combines several techniques to address the lack of labelled data and class imbalance, depicted