ADIFF: Explaining audio difference using natural language
Soham Deshmukh, Shuo Han, Rita Singh, Bhiksha Raj · 2025
Read ADIFF: Explaining audio difference using natural language by Soham Deshmukh, Shuo Han, Rita Singh, Bhiksha Raj (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04476.txt.
Description
Soham Deshmukh and co-authors teach machines to explain, in words, how two sounds differ. Spotting and describing audio differences matters for forensics, quality checks, and sound generation. Their 2025 paper is the first to frame that task fully, with datasets, benchmarks, and a working model.
The team built two datasets from existing audio-caption collections. Large language models wrote the difference reports at three depths. The shallowest list the events and objects heard, while the deepest add scenes, signal traits, and listener feelings. A simple baseline that feeds two sound embeddings into a frozen language model stumbled on similar sounds. Their ADIFF model adds a cross-projection module, position captioning, and a three-step training plan. It wrote fuller, sharper explanations, judged by both scoring metrics and human raters. The work opens a new corner of audio understanding.
Catalog record
| CREATOR | Soham Deshmukh, Shuo Han, Rita Singh, Bhiksha Raj |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 114 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-04476