Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities

Sreyan Ghosh, Zhifeng Kong, Sonal Kumar, S Sakshi, Jaehyeon Kim, Wei Ping, Rafael Valle, Dinesh Manocha, Bryan Catanzaro · 2025

Read Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities by Sreyan Ghosh, Zhifeng Kong, Sonal Kumar, S Sakshi, Jaehyeon Kim, Wei Ping, Rafael Valle, Dinesh Manocha, Bryan Catanzaro (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-03983.txt.

Description

Sreyan Ghosh and co-authors present Audio Flamingo 2, a model that listens to sound and music and reasons about them in words. Grasping non-speech sound is a key skill for any agent that must act in the real world, yet most models still focus on speech alone.

The model pairs a custom ear for sound with made-up question data that teach fine audio reasoning, trained in stages. With a small word model it beat larger open and closed models on more than twenty tests. The team also build a data set for long clips, up to five minutes, and a hard bench for that skill.

Catalog record

CREATORSreyan Ghosh, Zhifeng Kong, Sonal Kumar, S Sakshi, Jaehyeon Kim, Wei Ping, Rafael Valle, Dinesh Manocha, Bryan Catanzaro
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE87 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-03983

Browse the full library · About the Tower of Babel