Mellow: a small audio language model for reasoning
Soham Deshmukh, Satvik Dixit, Rita Singh, Bhiksha Raj · 2025
Read Mellow: a small audio language model for reasoning by Soham Deshmukh, Satvik Dixit, Rita Singh, Bhiksha Raj (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-08540.txt.
Description
Soham Deshmukh and three co-authors build a small audio language model that can reason about sound in a 2025 paper. Big audio models top most tests, yet their size bars use on phones and small gear. No past work had taught a small audio model to reason step by step. Their model, Mellow, was built for that gap and trained on a fresh question set about sound.
The training set mixes past sets with a large share of made-up items. Those items ask about sound events, scenes, traits, and the feel a sound gives a listener. On a top audio test, Mellow scored near the best big model while using a small slice of its size. Training data ran to a small share of the big model diet as well. Small gear gains a sound brain that fits.
Catalog record
| CREATOR | Soham Deshmukh, Satvik Dixit, Rita Singh, Bhiksha Raj |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 112 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-08540