Comparing Self-Supervised Learning Models Pre-Trained on Human Speech and Animal Vocalizations for Bioacoustics Processing

Eklavya Sarkar 1 2 , Mathew Magimai.-Doss 1 · 2025

Read Comparing Self-Supervised Learning Models Pre-Trained on Human Speech and Animal Vocalizations for Bioacoustics Processing by Eklavya Sarkar 1 2 , Mathew Magimai.-Doss 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-05987.txt.

Description

Eklavya Sarkar and Mathew Magimai-Doss compare sound models in a 2025 paper on animal calls. Models that learn from raw sound without labels have become strong general tools. Ones trained on human speech transfer surprisingly well to animal sound tasks, which raises a fair question: does training on animal sounds do better?

Three bioacoustic datasets and two tasks framed the test. Models trained on animal calls gained only a slight edge over speech trained ones. Tuning a speech model on speech recognition, in turn, could lift its animal sound scores. The results help labs pick a base model without costly retraining on rare animal data.

Catalog record

CREATOREklavya Sarkar 1 2 , Mathew Magimai.-Doss 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-05987

Browse the full library · About the Tower of Babel