Benchmarking Music Generation Models and Metrics via Human Preference Studies
Florian Grötschla ∗, Ahmet Solak ∗, Luca A. Lanzendörfer, Roger Wattenhofer · 2025
Read Benchmarking Music Generation Models and Metrics via Human Preference Studies by Florian Grötschla ∗, Ahmet Solak ∗, Luca A. Lanzendörfer, Roger Wattenhofer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-19085.txt.
Description
Florian Grötschla, Ahmet Solak, Luca Lanzendörfer, and Roger Wattenhofer benchmark music generation models in a paper from two thousand twenty-five. AI-made music now nears human work, but grading it is hard. Human preference is the gold standard, yet turning taste into objective metrics has proven tricky.
The team generated six thousand songs with twelve leading models. They then ran a survey of fifteen thousand pairwise comparisons with two thousand five hundred participants. The study ranks both the models and the common metrics by how well each matches human taste. To their knowledge, it is the first ranking of its kind. They release the songs and judgments openly to support work on subjective metrics.
Catalog record
| CREATOR | Florian Grötschla ∗, Ahmet Solak ∗, Luca A. Lanzendörfer, Roger Wattenhofer |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 18 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-19085