Perch 2.0: The Bittern Lesson for Bioacoustics

Bart van Merriënboer, Vincent Dumoulin, Jenny Hamer, Lauren Harrell, Andrea Burns, Tom Denton · 2025

Read Perch 2.0: The Bittern Lesson for Bioacoustics by Bart van Merriënboer, Vincent Dumoulin, Jenny Hamer, Lauren Harrell, Andrea Burns, Tom Denton (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-04665.txt.

Introduction

Bart van Merriënboer and co-authors released Perch 2.0 in 2025, an updated pre-trained model for bioacoustics, the study of animal sounds. The first version was trained only on birds and gave both species scores and reusable sound features. Field recordings span many species, so a broader model could serve more uses.

The new model trains on a large multi-taxa data set with a self-distillation scheme and a new source-prediction task. It set new best scores on two major benchmarks. Surprisingly, it also beat specialist marine models on marine tasks despite almost no marine training data. The authors offer hypotheses on why fine-grained species training makes such a robust base.

Catalog record

CREATORBart van Merriënboer, Vincent Dumoulin, Jenny Hamer, Lauren Harrell, Andrea Burns, Tom Denton
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-04665

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Perch 2.0: The Bittern Lesson for Bioacoustics Bart van Merriënboer, Vincent Dumoulin, Jenny Hamer, Lauren Harrell, Andrea Burns, Tom Denton Abstract Perch is a performant pre-trained model for bioacoustics. It was trained in supervised fashion, providing both off-the-shelf classification scores for thousands of vocalizing species as well as strong embeddings for transfer learning. In this new release, Perch 2.0, we expand from training exclusively on avian species to a large multi-taxa dataset. The model is trained with self-distillation using a prototype-learning classifier as well as a new source-prediction training criterion. Perch 2.0 obtains state-of-the-art performance on the BirdSet and BEANS benchmarks. It also outperforms specialized marine models on marine transfer learning tasks, despite having almost no marine training data. We present hypotheses as to why fine-grained species classification is a particularly robust pre-training task for bioacoustics. 1 Introduction Bioacoustics is an important tool in the fields of biology and ecology with vital applications in conservation and biodiversity monitoring ( Laiolo 2010 ) . In recent years machine learning methods such as deep learning have largely replaced ( Stowell 2022 ) more traditional signal processing methods such as template matching ( Towsey et al. 2012 ) for event detection and classification in bioacoustics. Moreover, models trained on large amounts of avian, labeled bioacoustics data such as BirdNET ( Kahl et al. 2021 ) and the previous iteration of Perch ( Hamer et al. 2023 , Perch 1.0,) have been shown to transfer to novel tasks such as individual identification ( Huang et al. 2025 ) as well as non-avian bioacoustics problems ( Ghani et al. 2023 ) . Figure 1: Australasian bittern. In the famous essay The Bitter Lesson ( Sutton 2019 ) it was argued that advancements in AI come from simple, general-purpose methods. The ‘bittern lesson’ from Perch 2.0 is that simple, supervised models are difficult to beat. Bitterns are a subfamily of herons; the Australasian bittern pictured here is an elusive, endangered species whose distinctive booming vocalizations can carry long distances. (Image by Imogen Warren licensed under CC BY-SA 4.0 .) In this paper we introduce Perch 2.0, a new iteration of the Perch model that achieves state-of-the-art results on two bioacoustics benchmarks: BirdSET and the BEnchmark of Animal Sounds (BEANS) ( Section 3 ). Perch 2.0 was primarily trained with the task of species classification. Although self-supervised learning has been explored in the literature as a way to further improve bioacoustics models—Bird-MAE ( Rauch et al. 2025 ) , BirdAVES ( Hagiwara 2023 ) and SimCLR-style models ( Moummad et al. 2024 ) —these approaches generally struggle to outperform strong supervised baselines ( Ghani et al. 2023 ; Kather et al. 2025 ) . In our exploratory research we too have experimented with a variety of self-supervised methods such as MAEs, HuBERT and SimCLR but experienced a similar inability to consistently outperform supervised models. We present some hypotheses as to why the fine-grained task of (avian) species classification is a particularly useful pre-training task ( Section 4 ). Compared to previous iterations of the Perch model we use additional training data (including non-avian taxa; Section 2.1 ) and new data augmentations and training objectives. We generally find that increasing the difficulty of the classification problem increases the overall quality of the embedding model: To that end, we introduce a novel generalization of mixup ( Zhang et al. 2018 ) that mixes more than two sources ( Section 2.1 ). Additionally, recent BirdCLEF competitions have demonstrated strong results with iterative pseudo-labeling ( Kahl et al. 2024 ) . Building on this observation, we introduce a variation of self-distillation ( Allen-Zhu and Li 2022 ) where a prototype learning classifier ( Chen et al. 2019 ; Heinrich et al. 2025 ) is used to generate predictions that are used as soft targets for the network’s dense linear classifier ( Section 2.2 and Section 2.3 ). Finally, noting that label granularity contributes to transfer learning performance ( Section C.1 ), we add an auxiliary self-supervised loss in the form of source prediction ( Balestriero 2023 , DIET,) , asking the model to predict the source recording of an audio window ( Section 2.2 and Section 2.3 ). Beyond raw performance on bioacoustics benchmarks, the goal of the Perch model is to satisfy properties we believe are important for downstream applications: a relatively small model that can adapt to a wide variety of domains and tasks using linear probing, since this requires fewer computational resources, less machine learning expertise, and less labeled data than full fine-tuning. These constraints enable practitioners to run the model on consumer-grade hardware, enabling robust clustering, nearest-neighbor search 1 1 1 https://search.acousticobservatory.org/ or agile modeling ( Dumoulin et al. 2025 ) workflows. To meet these constraints, the Perch 2.0 model is based on EfficientNet-B3 ( Tan and Le 2019 ) , a small model by modern machine learning standards, reducing the processing time of large datasets. We develop an extensive model selection procedure ( Section 2.5.1 ) which evaluates the model in a variety of domain shift and transfer learning tasks using linear probing and retrieval. 2 Methodology In this section we provide a breakdown of the training data, model architecture, training objectives, and evaluation procedure. 2.1 Training data Data sources We train on a combination of four labeled audio datasets: Xeno-Canto ( Vellinga and Planqué 2005 ) , iNaturalist ( iNaturalist contributors 2025 ) , the Tierstimmenarchiv ( Frommolt 1996 ) and FSD50K ( Fonseca et al. 2022 ) . The first three contain bioacoustics recordings with species labels while the latter contains a variety of non-bird sounds ( Table 1 ). In total the data contains 14,795 different classes of which 14,597 are species labels and the remaining 198 classes are general sound event classes from FSD50K. Table 1: Recordings per taxonomic class represented in the training data. *Note that FSD50k contains some coarsely-labeled animal sound classes, which we treat as ‘Other’ in this table. Aves Amphibia Insecta Mammalia Other Total Xeno-Canto 860,701 2,260 31,971 1,323 0 896,255 iNaturalist 480,230 51,450 30,535 9,074 409 571,698 Tierstimmenarchiv 26,622 1,341 860 4,992 44 33,859 FSD50k 0 0 0 0 40,966* 40,966 Total 1,367,553 55,051 63,366 15,389 41,419 1,542,778 Xeno-Canto and iNaturalist are large citizen-science repositories. The Xeno-Canto data was obtained from the public API 2 2 2 https://xeno-canto.org/explore/api and the iNaturalist data was obtained by collecting the ‘research-grade’ audio examples reported to the Global Biodiversity Information Facility (GBIF) 3 3 3 https://www.gbif.org/ , similarly to Chasmai et al. 2025 . Our training datasets for iNaturalist and Xeno-Canto were downloaded in March 2025. The Tierstimmenarchiv (Animal Sound Archive) is a repository from the Berlin Natural History Museum. We collected these recordings from the website 4 4 4 https://suche.tierstimmenarchiv.de/ in April 2025. Since Xeno-Canto, iNaturalist and the Tierstimmenarchiv use different taxonomies (species names) we manually mapped the classes from Xeno-Canto and the Tierstimmenarchiv into the iNaturalist classes. We also removed all bat recordings from the datasets (as their vocalizations cannot be represented using the spectrogram parameters we selected). Window selection All of our data sources contain recordings of variable length, ranging from less than a second to over an hour (with the majority in the 5–150 s range). As

Read the complete text