Masked Autoencoders with Limited Data: Does It Work? A Fine-Grained Bioacoustics Case Study
Wuao Liu, Mustafa Chasmai, Subhransu Maji, Grant Van Horn · 2026
Read Masked Autoencoders with Limited Data: Does It Work? A Fine-Grained Bioacoustics Case Study by Wuao Liu, Mustafa Chasmai, Subhransu Maji, Grant Van Horn (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14031.txt.
Description
Liu, Chasmai, Maji and Van Horn ask if masked autoencoders still pay off for bioacoustics when data is thin. Telling like-sounding species apart needs fine acoustic detail, yet big stores like iNaturalist often tag each clip with just one species. Masked autoencoders transfer well on huge audio sets, but modest bioacoustic use is less tested. The paper runs a systematic study of pretraining scale and domain fit for species sorting on iNatSounds.
Catalog record
| CREATOR | Wuao Liu, Mustafa Chasmai, Subhransu Maji, Grant Van Horn |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35881 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.14031