MelodySim: Measuring Melody-aware Music Similarity for Plagiarism Detection

2025

Read MelodySim: Measuring Melody-aware Music Similarity for Plagiarism Detection (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20979.txt.

Introduction

Two songs can share a tune while everything else about them differs, and plagiarism checks need ears for the tune alone. Tongyu Lu and four co-authors present MelodySim in a 2025 paper, a model and dataset for measuring how alike two melodies are. Their goal is a tool that flags copied melodic fragments even when the rest of the track has been reworked.

To train it, the team started from a MIDI dataset and made altered copies of each piece. The copies keep the melody but change the dressing: notes split, runs added, tracks dropped, instruments swapped. A user study confirmed the copies still sound like the same tune. The model encodes segments of music and learns, by comparing triples, to pull matching melodies close. It beat rival models at spotting similar fragments, and its output shows where in a pair the match sits.

Catalog record

YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-20979

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MelodySim: Measuring Melody-aware Music Similarity for Plagiarism Detection Abstract We propose MelodySim , a melody-aware music similarity model and dataset for plagiarism detection. First, we introduce a novel method to construct a dataset with focus on melodic similarity. By augmenting Slakh2100; an existing MIDI dataset, we generate variations of each piece while preserving the melody through modifications such as note splitting, arpeggiation, minor track dropout (excluding bass), and re-instrumentation. A user study confirms that positive pairs indeed contain similar melodies, with other musical tracks significantly changed. Second, we develop a segment-wise melodic-similarity detection model that uses a MERT encoder and applies a triplet neural network to capture melodic similarity. The resultant decision matrix highlights where plagiarism might occur. Our model achieves high accuracy on the MelodySim test set. * * footnotetext: These authors contributed equally to this work. 1 Introduction In recent years, the popularity of generative music models has rapidly increased. With the rise of commercial models such as Suno 1 1 1 https://suno.com and Udio 2 2 2 https://udio.com , as well as open source models like Mustango [ 1 ] and MusicGen [ 2 ] , the question of artist-protection question arises. There currently is an ongoing discussion as well as legal battles on how artists should be compensated for the use of their music as training data [ 3 ] , e.g. Recording Industry Association of America (RIAA) vs. Udio and Suno (June 2024) 3 3 3 https://shorturl.at/YlQ0P . In addition, the music generated by these models might plagiarize the original training data. In this work, we develop tools that may help with melody-related plagiarism detection. When generative models are trained on (often improperly licensed) copyrighted data, it becomes a strong possibility that the generated music plagiarizes the original training data. In particular, diffusion models have shown to be prone to replicate their training data, as shown by [ 4 , 5 ] on the image generation task. Artists have made public outcries showcasing examples of their work or style replicated by generative models 4 4 4 https://shorturl.at/j5tJb . In literature, we noticed that generative AI models are typically evaluated in terms of their ability to predict similarly to the input data (accuracy) rather in terms of the originality of the generated output [ 6 ] . At the moment there is no clear legal precedent or ruling to tackle the copyright issues on the input data, however, we can examine resulting plagiarism by the output of the generative models. Finding and confirming music plagiarism in general is a complex task. When deciding on plagiarism cases, [ 7 ] highlight the necessity of individually considering each case. An automatic plagiarism detection tool could help speed up the process of both flagging new plagiarism cases, as well as confirming expert opinions in existing lawsuits. Such tools might even be integrated into the music generation models themselves to avoid plagiarized output in the first case. This task, however, is not trivial, as there is no generally accepted, objective definition of what plagiarized music is. In an analysis of 17 lawsuits, [ 7 ] observed that the melody was prioritized when deciding on plagiarism, followed by the ‘overall impression’ of the music. This leads us to believe that there is a need for a melody-aware music similarity tool. The existing work on melody similarity metrics, however, is limited to the field of symbolic music (MIDI) [ 8 , 9 , 10 ] . To be able to deal with real-life court case data and generated music, we develop an audio based melody-aware similarity model in this work. This task is arguably more challenging than using symbolic music, due to the overlay of multiple audio signals, as well as the lack of data to train the model. The contributions of this work include the creation of a novel dataset, MelodySim, which contains 1568 full length instrumental songs, with three additional variations per song, resulting in a total of 6,272 files. These variations contain slight melodic changes in terms of altered pitches, note durations, speed and instrumentation. These changes are subtle such that the resulting matching tracks can still be construed as ‘plagiarized’ in terms of melody. This data is then used to train a Triplet Neural Network with a MERT encoder [ 11 ] , that minimizes the distance in representation of matching segments and maximizes the distance between different segments. This results in a melody-aware similarity embedding that is then used in a classification model to directly predict matching segments. In the following sections, we first provide an overview of related work. Section 3 then describes how we have created the MelodySim dataset. This is followed by a description of the melody-aware triplet neural network that we developed to predict similar music fragments as well as the full-song plagiarism detection method. Finally, the results of our model on the training set as well as an in-the-wild plagiarism dataset are presented, followed by a conclusion. 2 Related Work In this section, we provide a brief overview of how music plagiarism has been defined in existing literature. We then discuss related work on music similarity detection models. 2.1 What is plagiarism? When developing a model for plagiarism, we have to ask ourselves: which elements of music count towards plagiarism? A lot of popular rock, pop, and folk music shares the same 3-chord progression: I-IV-V, and has a similar drum track, making these elements non-eligible copyright infringement. This leaves other musical features such as melody and timbre as potential sources for plagiarism. Currently, there does not exist a fixed rule set that defines plagiarism in music. In a study by [ 7 ] , 17 music plagiarism lawsuits were analyzed. The authors observed that the melody was clearly prioritized when deciding on plagiarism, but always paired with another parameter which in most cases appeared to be the rhythm. Huber also stated that melody is the most discussed aspect in legal disputes, second to ‘overall impression’, which can be considered as the composition of various musical characteristics. Based on this, we decided to build a melody-aware similarity metric, that not yet looks at the melody, but also encodes the music in general through MERT-features [ 11 ] . To achieve this, we carefully constructed a new dataset by thoroughly altering musical features in different levels of detail while maintaining the main melody, as explained in Section 3 . 2.2 Automatic Music Similarity Detection Most existing work on melody similarity detection is in the symbolic domain. Much of this work is not necessarily developed towards plagiarism detection, but could have other goals such as melody retrieval [ 8 ] , repeated (exact) sample detection [ 12 ] . For a more comprehensive historic overview of music similarity models, the reader is referred to [ 13 ] . For instance, [ 8 ] developed a music similarity model for that was trained on the Meertens Tune Collections dataset [ 14 ] . Their recurrent neural network models allowed them to consider melody recommendation as a ranking problem of similarity. More recently, [ 15 ] present a way to generate an originality report, which includes an originality score (based on cardinality) to evaluate how much a

Read the complete text