Beyond the Baseband: Adaptive Multi-Band Encoding for Full-Spectrum Bioacoustics Classification

Eklavya Sarkar ⋆, Marius Miron, David Robinson, Gagan Narula, Milad Alizadeh, Ellen Gilsenan-McMahon, Felix Effenberger, Emmanuel Chemla, Olivier Pietquin, Matthieu Geist · 2026

Read Beyond the Baseband: Adaptive Multi-Band Encoding for Full-Spectrum Bioacoustics Classification by Eklavya Sarkar ⋆, Marius Miron, David Robinson, Gagan Narula, Milad Alizadeh, Ellen Gilsenan-McMahon, Felix Effenberger, Emmanuel Chemla, Olivier Pietquin, Matthieu Geist (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-27936.txt.

Introduction

Sarkar and eight colleagues push animal-sound classification past the human hearing band, where most audio models stop at 8 kilohertz. Animals call well above that range, into ultrasound, so the team splits the full call spectrum into band features and fuses them into one shared picture. Tests show some encoders yield band pictures that barely overlap, sharpening class splits after fusion. Across three data sets, eight ready-made models, and five fusion plans, fused pictures beat both baseband and time-stretch baselines on two sets.

Catalog record

CREATOREklavya Sarkar ⋆, Marius Miron, David Robinson, Gagan Narula, Milad Alizadeh, Ellen Gilsenan-McMahon, Felix Effenberger, Emmanuel Chemla, Olivier Pietquin, Matthieu Geist
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21691
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.27936

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Beyond the Baseband: Adaptive Multi-Band Encoding for Full-Spectrum Bioacoustics Classification Eklavya Sarkar ⋆, Marius Miron, David Robinson, Gagan Narula, Milad Alizadeh, Ellen Gilsenan-McMahon, Felix Effenberger, Emmanuel Chemla, Olivier Pietquin, Matthieu Geist Abstract Animals hear and vocalize across frequency ranges that differ substantially from humans, often extending into the ultrasonic domain. Yet most computational bioacoustics systems rely on audio models pre-trained at 16 kHz, restricting their usable bandwidth to the 0-8 kHz baseband and discarding higher-frequency information present in many bioacoustic recordings. We investigate a multi-band encoding framework that decomposes the full spectrum of animal calls into band features and fuses them into a unified representation. Similarity analyses on models show that certain encoders produce decorrelated band embeddings that improve class separation after fusion. Classification experiments on three bioacoustic datasets using eight pre-trained models and five fusion strategies show that fused representations consistently outperform the baseband and time-expansion baselines on two datasets, showing the potential of multi-band methods for full-spectrum encoding of animal calls. $\star$ $\star$ footnotetext: Corresponding author: [email protected] 1 Introduction Bioacoustics, the study of animal sounds, has emerged as a prominent domain within machine learning, as a means to study the origins and evolution of language and vocal learning ( 15 ; 10 ) , and deepen our understanding of communication in the natural world. Computational bioacoustics aims to ‘decode’ animal vocalizations to gain insights into their communication by deriving information from their calls ( 29 ) . In recent years, neural representations learnt on human speech have shown remarkable transferability to the domain of bioacoustics for decoding non-human vocal communication ( 26 ; 7 ; 21 ) . Indeed, modern state-of-the-art foundation models pre-trained on human speech and/or general audio have achieved strong performance benchmark across a range of species for tasks such as call detection ( 12 ; 13 ; 27 ) , call-type classification ( 8 ; 28 ; 20 ; 1 ; 25 ) , or caller identification ( 24 ; 6 ; 19 ) , thus providing a reliable framework for bioacoustics tasks, and significantly advancing the field. However, a critical limitation in leveraging these models is that they are typically pre-trained at a 16 kHz sampling rate (SR), corresponding to the human audible range, and resample any input to the constrained 0–8 kHz baseband, including bioacoustic recordings. As depicted in Figure 1 , this bandwidth (BW) is highly insufficient to cover the higher frequency content contained in the full-spectrum of many animals and their vocalizations, which extend well beyond this threshold, and results in a significant loss of useful information. For example, bat echolocation calls can reach up to 200 kHz ( 2 ) , insect signals to 100 kHz ( 9 ) , and marine mammal calls to 150 kHz ( 3 ) . However, training entire foundation models at higher SRs is very computationally expensive, and only a few such models exist, such as BirdNET ( 17 ) and Perch ( 11 ; 31 ) , pre-trained at 48 and 32 kHz, respectively, on bioacoustics. Thus, the fixed pre-training bandwidth of existing audio models is a major limitation in all current computational bioacoustics works. A common signal-processing approach to address this problem is time-expansion, i.e. slowing down the audio recordings by a fixed factor to shift the high-frequency components down to the baseband of the pre-trained model ( 22 ; 18 ; 16 ) , and using the resulting signal as input. However, this approach considerably reduces the spectral resolution and proportionally stretches the recording, as illustrated in Figure 1 (middle), thus increasing the model’s computational cost of processing the signal. Figure 1: Spectrograms of an ultrasonic bat vocalization. Inspired by classical sub-band processing approaches in automatic speech recognition (ASR), where the signal is decomposed into frequency bands that are processed independently before combining their evidence to improve robustness ( 5 ; 4 ; 30 ; 14 ) , we investigate an adaptive multi-band (MB) encoding strategy for bioacoustics. Unlike in ASR, where such methods operated on sub-bands within the 0–8 kHz baseband, we instead decompose the full spectrum of animal vocalizations into multiple basebands, compatible with modern pre-trained audio models, and explore combining them into a unified representation through various fusion strategies. Based on this proposed approach, this paper investigates the following two central questions: 1. Can MB representations effectively exploit the unused high-frequency information in bioacoustic calls, and improve over the conventional baseband and time-expansion approaches? 2. How does this approach compare to simply using the baseband of a model trained at a higher SR, such as BirdNET, at 48 kHz? Moreover, when applied to such a model, does it yield additional gains over its application to standard 16 kHz models? To answer these questions, we conduct a systematic evaluation across multiple bioacoustics datasets and pre-trained audio models. It is to be noted that we do not provide a foundation model pre-trained for higher SRs in this paper, but instead propose an approach that can work with any existing model. To provide practical use to the bioacoustics community, we also release the framework as an open-source toolkit. 1 1 1 Source code: https://github.com/earthspecies/multiband-audio . The rest of this paper is organized as follows. Section 2 details the MB encoding approach, and section 3 gives our experimental setup. Section 4 – 5 respectively present a representation and classification analysis. Section 6 concludes the paper. 2 Adaptive Multi-Band Encoding Figure 2: Complete pipeline of the heterodyning-based multi-band encoding. This section details the heterodyning-based multi-band processing approach, illustrated in Figure 2 . It consists of three main stages: (i) spectral band decomposition and baseband mapping, (ii) per-band representation extraction using a frozen pre-trained encoder, and (iii) fusion of the resulting band-level representations into a unified embedding for downstream classification. Given a raw audio recording \mathbf{s} sampled at its native rate f_{s} , a pre-trained model operating at f_{m} can only access frequencies up to its Nyquist f_{m}/2 . To leverage the higher spectral information \mathbf{s} , we split its full spectrum into B=\lceil f_{s}/f_{m}\rceil non-overlapping bands of width f_{m}/2 . The first band ( 0 – f_{m}/2 Hz) corresponds to the standard baseband, and is not further processed. For each subsequent band b , we first extract the corresponding spectral slice by applying a band-pass filter to the raw signal \mathbf{s} , yielding \mathbf{s}_{b} centered at frequency f_{b} . We then heterodyne it down to the baseband by multiplying it by a cosine at the band’s center frequency f_{b} , followed by low-pass filtering \mathcal{H}_{\mathrm{LP}} . The resulting baseband signal \bar{\mathbf{s}}_{b} is given by: \bar{\mathbf{s}}_{b}=\mathcal{H}_{\mathrm{LP}}\bigl[\mathbf{s}_{b}\cdot\cos(2\pi f_{b}t)\bigr] Applying this to each band produces B baseband waveforms \bar{\mathbf{S}}=\{\bar{\mathbf{s}}_{1},\ldots,\bar{\mathbf{s}}_{B}\} , each representing a distinct portion of the original spectrum. We resample them to f_{m} , matching the SR expected by the pre-trained model, and then pass them individually through the frozen encoder \mathcal{F} , yielding B variable-length multi-dimensional embeddings. These are then transformed into B fixed-length vocalization-level functionals \mathbf{f}_{b}\in\mathbb{R}^{D} by computing the first-order statistics across the temporal axis, where D denotes the embedding dimension of the model. Finally, a learned fusion module combines these functionals into a final representation \mathbf{x}\in\mathbb{R}^{D} , on which a linear classifier is trained for the downstream task. In this paper,

Read the complete text