bacpipe: a Python package to make bioacoustic deep learning models accessible

Vincent S. Kather, Sylvain Haupert, Burooj Ghani, Dan Stowell · 2026

Read bacpipe: a Python package to make bioacoustic deep learning models accessible by Vincent S. Kather, Sylvain Haupert, Burooj Ghani, Dan Stowell (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-11560.txt.

Introduction

Kather and three colleagues present bacpipe, a Python package that makes bioacoustic deep learning models easy to use for ecologists and computer scientists. It gathers models and test pipelines behind visual and code interfaces, turning custom audio into vectors and class predictions. A modular design supports benchmarking through plots, clustering, and probing. By widening access to top models, bacpipe aims to open new ecological and evolutionary questions in bioacoustics.

Catalog record

CREATORVincent S. Kather, Sylvain Haupert, Burooj Ghani, Dan Stowell
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39186
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.11560

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

bacpipe: a Python package to make bioacoustic deep learning models accessible Vincent S. Kather, Sylvain Haupert, Burooj Ghani, Dan Stowell Abstract 1. Natural sounds have been recorded for millions of hours over the previous decades using passive acoustic monitoring. Improvements in deep learning models have vastly accelerated the analysis of large portions of this data. While new models advance the state-of-the-art, accessing them using tools to harness their full potential is not always straightforward. 2. Here we present bacpipe , a collection of bioacoustic deep learning models and evaluation pipelines accessible through a graphical and programming interface, designed for both ecologists and computer scientists. 3. Bacpipe streamlines the usage of state-of-the-art models on custom audio datasets, generating acoustic feature vectors (embeddings) and classifier predictions. A modular design allows evaluation and benchmarking of models through interactive visualizations, clustering and probing. 4. We believe that access to new deep learning models is important. By designing bacpipe to target a wide audience, researchers will be enabled to answer new ecological and evolutionary questions in bioacoustics. \papertype Application \corraddress Vincent S. Kather \corremail [email protected] \fundinginfo Supported by Marie Skłodowska-Curie Action Bioacoustic AI ,grant agreement No 101116715 keywords bioacoustics, ecoacoustics, biodiversity monitoring, PAM, deep learning, embeddings, clustering 1 Introduction In bioacoustics, recordings of natural soundscapes span massive spatial and temporal scales [ 51 ] , the analysis of which has for a long time relied on automated processing for animal species detection [ 3 ] and soundscape characterization [ 44 ] 1 1 1 https://github.com/bioacoustic-ai/bioacoustics-datasets . Bioacoustic recordings are evaluated to study evolutionary and ecological phenomena, i.e. animal behaviour [ 46 ] , interaction with environments [ 38 , 8 ] , sound production [ 39 ] and more. Data is commonly gathered using passive acoustic monitoring (PAM) setups [ 23 , 4 , 45 ] . Studying changes of phenomena in large datasets was previously restricted to portions of datasets that were annotated manually by bioacousticians listening to recordings [ 45 ] . This precise study of recordings is a time-consuming practice, that therefore limits the amount of data that can be processed [ 23 , 45 ] . In recent years, the rapid advance of deep learning in terrestrial, freshwater and marine bioacoustics has opened up the opportunity to develop tools to process and organize large acoustic datasets which has vastly improved automated species detection [ 43 ] . New bioacoustic deep learning models (see Glossary) are trained and released at increasing rates [ 43 , 37 , 25 ] . At the same time, means to compare and use models are often limited by how well their respective code is maintained. Computing acoustic indices and unsupervised classification of soundscapes have been made accessible through numerous Python software packages, e.g. for acoustic indices, scikit-maad [ 47 ] and for unsupervised classification, bambird [ 24 ] , open soundscape [ 21 ] , soundscape explorer [ 41 ] and pykanto [ 32 ] . This accessibility is lacking for bioacoustic deep learning models making it hard for users to switch and compare between models. Recent reviews [ 25 , 37 , 50 ] give some guidance about model capabilities. However, reproducing these results and comparing between models remains cumbersome. For example, BirdNET , a model trained on a large corpus of bird vocalizations, is available with a graphical user interface (GUI) tool, making it accessible which explains its widespread use [ 18 , 30 ] . As the field of computational bioacoustics is an interdisciplinary field with researchers coming from varying degrees of ecological/computational backgrounds, the accessibility of newly developed methods to researchers with different skill sets, directly impacts if these methods get included in ecological workflows or not. Deep learning models compute rich, high-dimensional embeddings for any given input. Embeddings can then be used for classification tasks, e.g. providing predictions on species presence. Recent studies show that while models are trained to classify specific species, using these models to organize large acoustic datasets based on the extracted embeddings offers up a plethora of opportunities for other bioacoustic applications [ 10 , 11 , 2 , 25 ] . Furthermore, using deep learning embeddings rather than model predictions provides a continuous space where all data is represented rather than relying on model predictions to filter datasets. Models are being trained on broader datasets, going from bird-focused training sets like BIRB [ 14 ] and the annotated bird recordings on the citizen science platform xeno-canto [ 54 ] to incorporate more species groups like amphibians [ 5 ] , mammals [ 36 ] and insects [ 6 ] . Models trained on general audio are also being trained for bioacoustic datasets [ 37 , 25 ] . Yet, at this point, clear tendencies on what models to use for an acoustic environment are inconclusive and require researchers to have the tools to test and compare models in order to identify the best method for their research needs. Here, we present bacpipe (bioacoustic collection pipeline), a Python software package to facilitate the use of state-of-the-art bioacoustic deep learning models. By centering bacpipe on extracting acoustic representations using deep learning models (generating embeddings), large acoustic datasets can be structured and investigated without limiting the models to their classifier predictions. Thereby generating embeddings for a variety of models can be incorporated into existing workflows and models can be compared. As a stand-alone software, bacpipe provides interactive visualizations of acoustic representations (embeddings) from different models in a dashboard GUI enabling users to explore large datasets and benefit from the structuring capabilities of state-of-the-art deep learning models. As an add-on, the package comes with a variety of evaluation tools enabling researchers to probe model performance on their own data. Bacpipe is built in a modular design ensuring that with further development, new deep learning models can be easily included. In the following we will describe how bacpipe enables researchers to 1. process large PAM datasets with a variety of state-of-the-art deep learning models, 2. interactively explore acoustic representations visually and aurally, 3. extract classifier predictions from a variety of models and 4. use bacpipe to evaluate models on alternative bioacoustic tasks. 2 Basic workflow Bacpipe can be used via its API or as a stand-alone software. The user can therefore decide which of bacpipe’s processing steps to run. Figure 1 shows a schematic overview of these processing steps. In the following section the package concept and workflow will be explained in more detail. {biography} Glossary Key vocabulary used in this manuscript with their specific meaning in the field of computational bioacoustics. Deep learning model : Deep neural network machine learning model based on (for example) convolutional neural network (CNN) or transformer architecture and in this manuscript trained using acoustic recordings. Deep learning models usually consist of feature extractors and classifiers, the former of which is used to generate embeddings. In this manuscript deep learning model refers to the feature extraction part of the model. Embeddings : High-dimensional feature vectors created by deep learning models based on a section of audio. Embedding space : High-dimensional vector space containing embeddings of a model. Dimensionality reduction tools can be used to visualize these spaces. Classification : Class predictions are generated by the deep

Read the complete text