MusiScene: Leveraging MU-LLaMA for Scene Imagination and Enhanced Video Background Music Generation

Fathinah Izzati, Xinyue Li, Yuxuan Wu, Gus Xia · 2025

Read MusiScene: Leveraging MU-LLaMA for Scene Imagination and Enhanced Video Background Music Generation by Fathinah Izzati, Xinyue Li, Yuxuan Wu, Gus Xia (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-05894.txt.

Description

Fathinah Izzati, Xinyue Li, Yuxuan Wu, and Gus Xia ask, in a 2025 paper, whether a music language model can imagine the scene a song belongs to. People do this with ease. A slow, sad tune suggests heartbreak, while a bright tune suggests a party. The authors name this task music scene imagination.

They built a data set of 3,371 video and audio pairs with captions, to teach the skill. They then fine tuned a music understanding model on it, making a system called MusiScene. In broad tests, it wrote more fitting scene captions than the base model. The team then fed those captions into a system that picks background music for video. Better scene sense, they argue, leads to better music choices, closing a loop between hearing and seeing.

Catalog record

CREATORFathinah Izzati, Xinyue Li, Yuxuan Wu, Gus Xia
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE16 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-05894

Browse the full library · About the Tower of Babel