Enhancing Music Recommendation with User Mood Input

Terence Zeng · 2026

Read Enhancing Music Recommendation with User Mood Input by Terence Zeng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-11796.txt.

Introduction

Zeng explores a mood-assisted music recommendation system that picks songs by the listener's desired mood. Standard collaborative filtering leans on similar users' tastes and falters when interactions are sparse. Content-based filtering reads the songs themselves; mood recognition is one less-explored branch of it. Zeng maps songs on an energy-valence spectrum and runs single-blind trials. Listeners rate mood-based picks against baseline picks. Adding mood input lifts the ratings by a statistically significant margin, he reports.

Catalog record

CREATORTerence Zeng
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32981
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.11796

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Enhancing Music Recommendation with User Mood Input Terence Zeng Abstract Recommendation systems have become essential in modern music streaming platforms, due to the vast amount of content available. A common approach in recommendation systems is collaborative filtering, which suggests content to users based on the preferences of others with similar patterns. However, this method performs poorly in domains where interactions are sparse, such as music. Content-based filtering is an alternative approach that examines the qualities of the items themselves. Prior work has explored a range of content-filtering techniques for music, including genre classification, instrument detection, and lyrics analysis. In the literature review component of this work, we examine these methods in detail. Music emotion recognition is a type of content-based filtering that is less explored but has significant potential. Since a user’s emotional state influences their musical choices, incorporating user mood into recommendation systems is an alternative way to personalize the listening experience. In this study, we explore a mood-assisted recommendation system that suggests songs based on the desired mood using the energy-valence spectrum. Single-blind experiments are conducted, in which participants are presented with two recommendations — one generated from a mood-assisted recommendation system and one from a baseline system — and are asked to rate them. Results show that integrating user mood leads to a statistically significant improvement in recommendation quality, highlighting the potential of such approaches. Subject Keywords: Recommendation systems, music recommendation, mood detection, content-based filtering, information retrieval \msthesis \department Electrical and Computer Engineering \degreeyear 2025 \advisor Abhishek Umrawal Acknowledgements. First, I would like to express my gratitude to my advisor, Professor Abhishek Umrawal, for his invaluable guidance throughout this journey. I am also grateful to my family for their continual encouragement. Lastly, I would like to thank all participants for contributing to this study. 1 Introduction Recommendations have played a central role in helping people discover new content for centuries. Traditionally, recommendations were made through word-of-mouth - a friend might suggest a good book they recently read, or recommend a new restaurant they dined at. Nowadays, however, the sheer abundance of available content in various media has made it impractical for users to rely solely on personal recommendations. One such medium is music. Spotify, the largest streaming service, has over 100 million songs. Users will struggle to manually discover new songs that are aligned with their preferences. To address this, music streaming services employ recommender systems, which suggest songs that users are likely to enjoy. Before recommender systems became widely adopted, information retrieval served as a way to filter out vast amounts of content. Spearheaded largely by the foundational work of Rijsbergen [ 7 ] , these systems became widely used in areas such as library science, where the challenging of indexing and accessing large amounts of content required more efficient methods. Recommender systems evolved from information retrieval systems as the demand for personalized access to information grew. While information retrieval systems rely on user queries to search for content, recommender systems offer relevant content by utilizing user behavior, eliminating the need for these queries. The earliest recommender systems relied primarily on collaborative filtering [ 3 ] , a technique that generates recommendations based on user-interaction data. Collaborative filtering works by identifying users with similar listening patterns and recommending items that those similar users enjoyed. This method saw widespread adoption by the early 2000s on platforms such as Amazon [ 4 ] due to its simplicity and effectiveness. However, collaborative filtering has several limitations, particularly in the domain of music. One such limitation is that user-interaction data is sparse. For large song databases, the sparsity can surpass 99.9% [ 2 ] , meaning that most users will have listened to less than 0.1% of all songs. It becomes difficult for recommendation systems to accurately model user preferences when there is so little data about what they have or have not listened to. This sparsity not only limits the system’s ability to find personalized recommendations but also reinforces popularity bias, as the system may disproportionately recommend widely-streamed tracks simply because they have more interaction data. This makes it especially difficult for lesser-known artists to gain visibility, ultimately reducing the diversity of recommendations. This problem is exacerbated by the fact that explicit feedback is rarely provided in music. In other media, such as movies, a numerical rating is assigned by a user to an item. Music streaming services generally lack this functionality - the main types of feedback are a user’s listening history and playlists. In fact, even this implicit data isn’t reliable - there are many reasons why someone may listen to a song they don’t completely enjoy. Therefore, we decided to explore content-based filtering, which examines audio characteristics rather than user-item interactions. Information Retrieval Audio Analysis Music Similarity Rijsbergen (1979) [ 7 ] Tzanetakis & Cook (2000) [ 10 ] Logan & Salomon (2001) [ 5 ] Multimedia (video, audio, text) Audio Music Methods Domains Figure 1 : Timeline of the development of music similarity analysis. One of the earliest frameworks for audio analysis was MARSYAS, developed by Tzanetakis & Cook [ 10 ] . Inspired by the aforementioned information retrieval techniques, the MARSYAS framework audio extracts some information from the raw signals and stores it in a structured text format, allowing for traditional retrieval techniques to be used. A key innovation of MARSYAS was its approach to audio representation: rather than storing audio as raw waveform data, it transformed it into the frequency domain, giving access to powerful features such as spectral centroid and Mel-frequency Cepstral Coefficients (MFCCs). Some of these features were proven to be effective by the work of Davis & Mermelstein [ 1 ] . These features were then used in supervised and unsupervised learning models to perform tasks like emotion recognition, genre classification, and instrument detection. By bridging ideas from information retrieval and audio signal processing, MARSYAS laid the foundation for many future content-based music recommendation systems. Logan & Salomon [ 5 ] further explored MFCCs, using them to filter music based on content. Their work was motivated by the growing need to create playlists with similar-sounding songs, since digital media consumption was moving from albums to individual tracks. To find similar-sounding songs, they used frequency analysis combined with k-means clustering within each song. These clusters represent the musical shape of each song. With this system, the proportion of similar-sounding songs was much higher than with a randomly generated playlist. These methods and results showed that audio analysis was an area worth looking at and paved the way for more sophisticated methods. 1.1 Motivation In recent years, as music streaming platforms have scaled to host tens of millions of songs, the need for effective and personalized recommendation systems has become increasingly central. This has driven a shift from early collaborative filtering approaches to more sophisticated, content-aware techniques that leverage audio signals, lyrics, emotional context, and user demographics. Out of the several content filtering methods discussed in the literature review section, we chose to explore mood-based recommendation based on several factors: • With recent advances in deep learning, signal processing, and natural language processing, there is high potential for progression in this area • It is relatively unexplored compared to other content-filtering techniques

Read the complete text