Unrolled Creative Adversarial Network For Generating Novel Musical Pieces
Pratik Nag · 2025
Read Unrolled Creative Adversarial Network For Generating Novel Musical Pieces by Pratik Nag (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-00452.txt.
Introduction
Pratik Nag explores, in 2024, adversarial networks as composers of new music. Sequence models dominate music generation, while the two-player setup of generative adversarial networks remains little tested there. Nag builds two systems on a creative variant of the framework.
One system learns a body of pieces without style labels. The other learns a composer's style and then deliberately deviates from it, chasing novelty. An unrolling trick is added to fight the collapse where generators repeat a few safe outputs. Both the plain and creative networks are compared for creativity and variety, extending the creative adversarial idea from images into music.
Catalog record
| CREATOR | Pratik Nag |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-00452
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Unrolled Creative Adversarial Network For Generating Novel Musical Pieces Pratik Nag Abstract Music generation has been established as a prominent topic in artificial intelligence and machine learning [ 2 , 13 ] over recent years. In most recent works [ 4 , 7 , 3 ] , RNN-based neural network methods have been applied for sequence generation. In contrast, generative adversarial networks (GANs) and their counterparts have been explored by very few researchers [ 10 ] for music generation. In this paper, a classical system was employed alongside a new system to generate creative music. Both systems were designed based on adversarial networks to generate music by learning from examples. The classical system was trained to learn a set of music pieces without differentiating between classes, whereas the new system was trained to learn the different composers and their styles to generate a creative music piece by deviating from the learned composers’ styles. The base structure utilized was generative adversarial networks (GANs), which are capable of generating novel outputs given a set of inputs to learn from and mimic their distribution. It has been shown in previous work that GANs are limited in their original design with respect to creative outputs [ 5 ] . Building on the Creative Adversarial Networks (CAN) [ 5 ] , this work applied them in the music domain rather than the visual art domain. Additionally, unrolled CAN was introduced to prevent mode collapse. Experiments were conducted on both GAN and CAN for generating music, and their capabilities were measured in terms of deviation from the input set. 1 Introduction Machines have always been shown as devices capable of replicating certain learned behaviours. It has been a dream to make creative machines and is of much desire in the machine learning scope and artificial intelligence. After all if we want machines to mimic human behaviour, one the most important human traits is creativity. Take driving for example; humans are capable of using their creativity and creative problem solving skills, to avoid unexpected road events, preventing accidents. That is a skill that all self driving car developers hope to accomplish. The art of generating music is a very complex problem [ 10 ] and is a different challenge than that of text generation. It includes finding a rhythm between the musical notes and learning polyphony and many more challenges. To study style in music lets take a look at what style means in language. When one speaks or writes their style is defined by their selection of words an vocabulary, their choice of grammar and linguistics, all governed within constraints of the language and dialect one has learned, and have not created. However, since constraints can allow for interpretations of different realizations it produces variety. Therefore, a pattern in a style of writing or a piece of music may not relate in every aspect, only some aspects are selected to convey pattern replication. 1 , 2 shows two examples of musical pieces replicating a pattern of using pitches (8-7/2-1) typically preferred and chosen by classical musicians [ 9 ] . Figure 1: Symphony No.46 in B major Haydn Figure 2: Mozart Piano Quartet in G minor There are two clefs in a music sheets ( 3 ) that are used to differentiate between high and bass notes and are called the treble clef and the bass clef. The treble clef is usually played with the right hand on the piano and the bass clef is usually played with the left hand on the piano. Figure 3: Treble clef and Bass clef In music sheets some note may be represented different graphically yet representing the same note. And sometimes certain music sheets may look identical graphically while actually are representing different notes. That is due to the change in the clef (Check figure 4 ). A professional musician must be able to identify the similarities and differences in the notes. That comes naturally since professional musicians are regularly reading sheet music. Figure 4: Same-Different exercise example [ 12 ] 2 Methodology In this section the methodology of music GAN, CAN and unrolled CAN pipeline is discussed. Starting with the data sets used, data preprocessing technique, and the model architecture. 2.1 Data set Three data sets were used in this project; jazz midi data set, classical music midi data set classified by composers, and Arabic music midi data set. All the data sets are included in the following github repository. Both the jazz data set and the classical music data set were retrieved from kaggle . The Arabic data set was collected manually and cleaned to cancel out some of the repetitive notes such as drums. 2.2 Data Preprocessing The data used in this project contain midi files. In order to pass them to the GAN or the CAN the midi files were converted to images by converting each note to a pixel location. The resulting image file can be converted back to midi file without losing any of the information. (see figure 5 ) Figure 5: Sample of musical piece by the composer Albeniz in image format 2.3 Music GAN architecture The architecture used for the music GAN is presented here. Two networks were included in the architecture: a generator network and a discriminator network. A random vector z was used as input by the generator to produce an image representing a MIDI file. The generated image was then passed to the discriminator, which attempted to distinguish between the real image dataset and the generated (fake) images. The GAN was trained on the three datasets separately, resulting in three distinct generators: one capable of producing jazz musical pieces, another capable of generating classical music pieces, and the third trained on manually collected and cleaned data to generate Arabic musical pieces. Figure 6: GAN architecture A detailed architecture of Discriminator and Generator. 7 , 8 Figure 7: GAN Discriminator block Figure 8: GAN Generator block 2.4 Music CAN and unrolled CAN architecture In the music CAN the architecture [ 11 ] [ 5 ] is still made up of two neural networks that compete against each other. However, the loss here stresses on the generator motivating it to produce a musical piece that cannot be classified as belonging to one class. In other words, the discriminator should be capable of classifying the original real data to their composers or class label. The discriminator should not be able to find a suitable class for the generated piece of music. Thus the input data must be labeled by the class it belongs to in order to reduce the loss on real data classification. The generator architecture is similar to that of the GAN where it takes a random z vector as an input and generates an image representing the midi file. Figure 9: CAN architecture A detailed architecture of Discriminator and Generator. 10 , 11 Figure 10: CAN Discriminator block Figure 11: CAN Generator block For the CAN generator architecture, a size 100 random z vector is converted into a 512\times 4\times 4 tensor through the use of convolution and batch normalization layers. Convolution and batch normalization are then applied sequentially to produce a 256\times 8\times 8 tensor, followed by