Bridging Domain Gaps for Fine-Grained Moth Classification Through Expert-Informed Adaptation and Foundation Model Priors

Ross J. Gardiner, Guillaume Mougeot, Sareh Rowlands, Benno I. Simmons, Flemming Helsing, Toke Thomas Høye · 2025

Read Bridging Domain Gaps for Fine-Grained Moth Classification Through Expert-Informed Adaptation and Foundation Model Priors by Ross J. Gardiner, Guillaume Mougeot, Sareh Rowlands, Benno I. Simmons, Flemming Helsing, Toke Thomas Høye (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-20089.txt.

Introduction

Ross Gardiner and five co-authors classify moth species from field camera photos by borrowing knowledge from a big foundation model. Their work appeared in twenty twenty-five. Automated cameras can track insect decline, but their messy field images differ sharply from clean reference photos.

The team worked with one hundred one Danish moth species caught by camera systems. A large model called BioCLIP2 beat other methods by a wide margin. The authors then distilled its skill into a small network that runs cheaply. The small model matched the big one's accuracy at far lower cost. Expert-labeled field examples were the bridge between the two image worlds. The paper gives practical guidance for cheap, accurate insect monitoring.

Catalog record

CREATORRoss J. Gardiner, Guillaume Mougeot, Sareh Rowlands, Benno I. Simmons, Flemming Helsing, Toke Thomas Høye
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE16 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-20089

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bridging Domain Gaps for Fine-Grained Moth Classification Through Expert-Informed Adaptation and Foundation Model Priors Ross J. Gardiner, Guillaume Mougeot, Sareh Rowlands, Benno I. Simmons, Flemming Helsing, Toke Thomas Høye Abstract Labelling images of Lepidoptera (moths) from automated camera systems is vital for understanding insect declines. However, accurate species identification is challenging due to domain shifts between curated images and noisy field imagery. We propose a lightweight classification approach, combining limited expert-labelled field data with knowledge distillation from the high-performance BioCLIP2 foundation model into a ConvNeXt-tiny architecture. Experiments on 101 Danish moth species from AMI camera systems demonstrate that BioCLIP2 substantially outperforms other methods and that our distilled lightweight model achieves comparable accuracy with significantly reduced computational cost. These insights offer practical guidelines for the development of efficient insect monitoring systems and bridging domain gaps for fine-grained classification. 1 Introduction Insects are vital to terrestrial ecosystems and global agriculture [ 18 ] . They constitute roughly half of all animal species [ 29 ] , and terrestrial arthropods collectively account for 20 times the biomass of all wild mammals and birds combined [ 2 ] . Despite their importance, insect populations are declining worldwide [ 33 , 31 ] , this remains poorly understood due to a lack of scalable field monitoring methods [ 20 ] . In response, automated insect camera traps [ 27 , 4 , 10 ] autonomously photograph insects in-situ, enabling long-term and resource-efficient population monitoring [ 26 ] . But, the resulting raw imagery must be processed before it can provide actionable ecological insights. Advances in detection [ 6 , 5 ] and classification [ 7 , 23 ] have made computer vision the leading approach for this task [ 13 ] . Species-level recognition from camera-trap images remains difficult: morphological differences are subtle and expert taxonomists are scarce [ 9 ] , making annotation expensive. Citizen science repositories such as the Global Biodiversity Information Facility (GBIF) [ 1 ] provide labelled images for many taxa and are popular sources of training data. However, domain shift (differences in pose, lighting, and image quality between GBIF and automated camera trap imagery) reduces performance when models are trained exclusively on “source-domain” GBIF images and evaluated on “target-domain” in-situ insects [ 14 ] . In addition, developing lightweight computer vision models for insect monitoring remains important because: (1) ecologists worldwide may lack the computing infrastructure to run large models efficiently; (2) lightweight models are easier to retrain, which is valuable as most insect species remain undiscovered [ 29 ] and new species must be integrated; (3) lightweight architectures facilitate ‘edge’ computing directly on camera trap hardware in remote environments. This is common in insect camera trap designs [ 8 , 3 , 26 ] where on-device inference is critical when connectivity constraints prohibit remote inference. Edge inference also allows the detection of specific species of interest on the device, allowing for the removal of unwanted images, conserving storage space for long deployments [ 10 , 25 ] . We develop and evaluate a lightweight architecture that addresses domain shift through two strategies: (1) integrating expert-labelled target-domain data into training, and (2) guiding learning via knowledge distillation (KD) from large-scale pretrained foundation models. We evaluate on a fine-grained and domain-shifted dataset of moth images from Automated Monitoring of Insects (AMI) cameras [ 14 ] deployed around 12 sites in Denmark. Combining expert-labelled target-domain data and KD enables our lightweight model to achieve comparable performance to BioCLIP and BioCLIP2, despite significantly lower parameter count. We provide recommendations for ecologists to use foundation models for their applications, and for the computer vision community towards fine-grained domain adaptation. Figure 1 : Data processing pipeline showing how moth images from AMI (target-domain) and GBIF (source-domain) are curated, labelled at the species level, and split into training and test sets. Controlled mixing of domains enables analysis of domain shift effects. Example images illustrate differences between the two domains. 1.1 Related Work There are many established methods for domain adaptation [ 34 ] , including feature alignment, adversarial learning and self-training. Synthetic data generation [ 15 ] has also previously been shown to improve generalisation for insect images. Here, we explore domain adaptation through supervised mixing of the training set as it is straightforward to implement and understand and allows us to leverage the limited expert-labelled target data available in our scenario. The use of CLIP-style [ 24 ] foundation models offers another route to cross-domain generalisation, pre-training large-scale representations transferable to diverse target domains. For biological images, recent models such as Insect-Foundation [ 22 ] , CLIBD [ 11 ] and Biotrove [ 35 ] have shown strong performance on fine-grained insect identification tasks. Notably, BioCLIP [ 28 ] , trained on the TreeOfLife-10M dataset, and its successor BioCLIP2 [ 12 ] , scaled to 214 million mostly GBIF-sourced images, achieve state-of-the-art accuracy. To retain the broad domain knowledge of such models while adapting to specific target tasks, we use KD, training smaller student model is to match the features of a larger pre-trained teacher [ 21 ] . In this context, KD serves as a domain adaptation strategy, transferring generalisable representations from teacher to student [ 16 ] . Our work is related to [ 14 ] , which introduced the AMI dataset and demonstrated ConvNeXt [ 17 ] performance on cross-domain insect classification. We benchmark foundation models using a balanced dataset of Danish moth species and explore specialist model training with limited domain-specific data. Foundation models have also been used for camera trap classification; [ 32 ] applied pre-trained models for zero-shot vertebrate identification, showing strong adaptability. We extend this by evaluating BioCLIP2 on AMI insect images, assessing the impact of expert-labelled target data and knowledge distillation for smaller models. 2 Dataset We used a dataset of images of moths species collected from 12 AMI systems deployed in three regions of Denmark across three years (2022-2024) [ 3 ] . Images captured by AMI are high resolution photographs of a large white screen, where moths are attracted to a UV light. Moths themselves make up small portions of each image and pre-existing object detection methods give crops for each moth instance [ 20 ] . Crops can be highly variable in size, lighting and quality, Figure 1 shows some examples. And, following the long-tailed distribution typical of ecological scenarios, there are typically many images of the most common species, and relatively few of the others [ 30 ] . Identifiable moths in the AMI images have been labelled to the species level by one of the authors, an expert insect taxonomist specialised in moth species identification. As a primary focus in this study is domain shift, for our experiments, we use a subset of AMI moth crops represented by 101 species, where each species is represented by 110 AMI images, to isolate and study domain-shift effects. We refer to these throughout as the “target-domain” examples. Individual images in the target-domain can be highly correlated, as data are obtained by time-lapse, and frequently an individual is stationary for long periods and is therefore imaged repeatedly in the same position. To prevent leakage of highly correlated images from the training set into our test set,

Read the complete text