Diffusion in Zero-Shot Learning for Environmental Audio

Ysobel Sims, Stephan Chalup, Alexandre Mendes · 2024

Read Diffusion in Zero-Shot Learning for Environmental Audio by Ysobel Sims, Stephan Chalup, Alexandre Mendes (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-03771.txt.

Description

Ysobel Sims, Alexandre Mendes, and Stephan Chalup run the first benchmark of generative methods for naming sounds never heard in training. Zero-shot learning lets a model tag new classes from descriptions alone. Vision research uses it widely, but environmental audio lags behind. The team tests whether methods that invent training features can close the gap.

Four generative approaches faced off, two borrowed from vision and two built for this study. Tests ran across five sound data sets plus one music set. The generative methods matched strong classic baselines overall. One new method, a conditional denoising network, topped the group on average. It clearly beat the diffusion and adversarial entries. Training stability, the authors argue, decides who wins in this corner of audio AI.

Catalog record

CREATORYsobel Sims, Stephan Chalup, Alexandre Mendes
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-03771

Browse the full library · About the Tower of Babel