Advancing the Foundation Model for Music Understanding

Yi Jiang, Wei Wang, Xianwen Guo, Huiyun Liu, Hanrui Wang, Youri Xu, Haoqi Gu, Zhongqian Xie, Chuanjiang Luo · 2025

Read Advancing the Foundation Model for Music Understanding by Yi Jiang, Wei Wang, Xianwen Guo, Huiyun Liu, Hanrui Wang, Youri Xu, Haoqi Gu, Zhongqian Xie, Chuanjiang Luo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-01178.txt.

Description

Yi Jiang and co-authors introduce a single model for many music tasks in a 2025 paper. Music research has long relied on narrow models, each built for one task. Their model, called MuFun, is meant to grasp music as a whole, handling sound and lyrics together in one design.

Training covered a large set of tasks, from sorting genre and tagging traits to answering questions about songs. The team also built a new test set, called MuCUE, to judge broad music grasp. On those tests, MuFun beat current audio language models by a clear margin. The work points toward one base model for music tools instead of many small ones.

Catalog record

CREATORYi Jiang, Wei Wang, Xianwen Guo, Huiyun Liu, Hanrui Wang, Youri Xu, Haoqi Gu, Zhongqian Xie, Chuanjiang Luo
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-01178

Browse the full library · About the Tower of Babel