Mellow: a small audio language model for reasoning

Soham Deshmukh, Satvik Dixit, Rita Singh, Bhiksha Raj · 2025

Read Mellow: a small audio language model for reasoning by Soham Deshmukh, Satvik Dixit, Rita Singh, Bhiksha Raj (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-08540.txt.

Description

Soham Deshmukh and three co-authors build a small audio language model that can reason about sound in a 2025 paper. Big audio models top most tests, yet their size bars use on phones and small gear. No past work had taught a small audio model to reason step by step. Their model, Mellow, was built for that gap and trained on a fresh question set about sound.

The training set mixes past sets with a large share of made-up items. Those items ask about sound events, scenes, traits, and the feel a sound gives a listener. On a top audio test, Mellow scored near the best big model while using a small slice of its size. Training data ran to a small share of the big model diet as well. Small gear gains a sound brain that fits.

Catalog record

CREATORSoham Deshmukh, Satvik Dixit, Rita Singh, Bhiksha Raj
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE112 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-08540

Browse the full library · About the Tower of Babel