MusiScene: Leveraging MU-LLaMA for Scene Imagination and Enhanced Video Background Music Generation
Fathinah Izzati, Xinyue Li, Yuxuan Wu, Gus Xia · 2025
Read MusiScene: Leveraging MU-LLaMA for Scene Imagination and Enhanced Video Background Music Generation by Fathinah Izzati, Xinyue Li, Yuxuan Wu, Gus Xia (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-05894.txt.
Description
Fathinah Izzati, Xinyue Li, Yuxuan Wu, and Gus Xia ask, in a 2025 paper, whether a music language model can imagine the scene a song belongs to. People do this with ease. A slow, sad tune suggests heartbreak, while a bright tune suggests a party. The authors name this task music scene imagination.
They built a data set of 3,371 video and audio pairs with captions, to teach the skill. They then fine tuned a music understanding model on it, making a system called MusiScene. In broad tests, it wrote more fitting scene captions than the base model. The team then fed those captions into a system that picks background music for video. Better scene sense, they argue, leads to better music choices, closing a loop between hearing and seeing.
Catalog record
| CREATOR | Fathinah Izzati, Xinyue Li, Yuxuan Wu, Gus Xia |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-05894