Benchmarking Music Generation Models and Metrics via Human Preference Studies

Florian Grötschla ∗, Ahmet Solak ∗, Luca A. Lanzendörfer, Roger Wattenhofer · 2025

Read Benchmarking Music Generation Models and Metrics via Human Preference Studies by Florian Grötschla ∗, Ahmet Solak ∗, Luca A. Lanzendörfer, Roger Wattenhofer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-19085.txt.

Description

Florian Grötschla, Ahmet Solak, Luca Lanzendörfer, and Roger Wattenhofer benchmark music generation models in a paper from two thousand twenty-five. AI-made music now nears human work, but grading it is hard. Human preference is the gold standard, yet turning taste into objective metrics has proven tricky.

The team generated six thousand songs with twelve leading models. They then ran a survey of fifteen thousand pairwise comparisons with two thousand five hundred participants. The study ranks both the models and the common metrics by how well each matches human taste. To their knowledge, it is the first ranking of its kind. They release the songs and judgments openly to support work on subjective metrics.

Catalog record

CREATORFlorian Grötschla ∗, Ahmet Solak ∗, Luca A. Lanzendörfer, Roger Wattenhofer
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE18 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-19085

Browse the full library · About the Tower of Babel