GuitarFlow: Realistic Electric Guitar Synthesis From Tablatures via Flow Matching and Style Transfer
Jackson Loth, Pedro Sarmento, Mark Sandler, Mathieu Barthet · 2025
Read GuitarFlow: Realistic Electric Guitar Synthesis From Tablatures via Flow Matching and Style Transfer by Jackson Loth, Pedro Sarmento, Mark Sandler, Mathieu Barthet (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-21872.txt.
Introduction
Jackson Loth, Pedro Sarmento, Mark Sandler, and Mathieu Barthet present GuitarFlow, a system that turns guitar tablature into realistic electric guitar audio. Tablature suits the instrument because it directly encodes bends, muted strings, and slides. A bare symbolic score carries no tone, so making it sound like a real performance is the hard part.
The pipeline first renders the tablature with a simple sample-based virtual guitar, then applies flow matching style transfer to reshape that plain audio into a convincing performance. Because the symbolic draft does much of the work, training stays quick and needs under six hours of recorded material. Objective measures accompany the results, and the authors position the tool as a step toward controllable, expressive guitar synthesis.
Catalog record
| CREATOR | Jackson Loth, Pedro Sarmento, Mark Sandler, Mathieu Barthet |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-21872
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GuitarFlow: Realistic Electric Guitar Synthesis From Tablatures via Flow Matching and Style Transfer Jackson Loth, Pedro Sarmento, Mark Sandler, Mathieu Barthet Abstract Music generation in the audio domain using artificial intelligence (AI) has witnessed steady progress in recent years. However for some instruments, particularly the guitar, controllable instrument synthesis remains limited in expressivity. We introduce GuitarFlow, a model designed specifically for electric guitar synthesis. The generative process is guided using tablatures, an ubiquitous and intuitive guitar-specific symbolic format. The tablature format easily represents guitar-specific playing techniques (e.g. bends, muted strings and legatos), which are more difficult to represent in other common music notation formats such as MIDI. Our model relies on an intermediary step of first rendering the tablature to audio using a simple sample-based virtual instrument, then performing style transfer using Flow Matching in order to transform the virtual instrument audio into more realistic sounding examples. This results in a model that is quick to train and to perform inference, requiring less than 6 hours of training data. We present the results of objective evaluation metrics, together with a listening test, in which we show significant improvement in the realism of the generated guitar audio from tablatures. 1 Introduction Recent advances in generative audio systems have given rise to impressive text-to-music systems that allow users to generate full songs from simple text prompts [ 14 ] [ 15 ] . While this is very interesting from a science and technology perspective, it is arguably lacking as a creative tool due to a lack of fine-grained control over the music missing. Music generation systems with full control over the notes do exist, but typically in the symbolic domain [ 39 ] [ 30 ] , requiring a way to transform a symbolic music score into audio. While this can be achieved through virtual instruments to varying degrees of success, guitars are particularly expressive instruments which are difficult to represent through the standard Musical Instrument Digital Interface (MIDI) [ 33 ] . Guitar timbre itself can even be perceived differently when performed in different playing styles [ 32 ] . Previous attempts at synthesising expressive music instruments have largely focused on MIDI or representations derived from MIDI [ 45 ] [ 24 ] . This paper explores the task of synthesising electric guitar by processing synthetic audio rendered from an expressive symbolic musical representation. Instead of MIDI, we use guitar tablatures (see Figure 1 ) to represent the musical content of a desired audio synthesis. This allows us to incorporate expressive playing techniques such as slides, bends, hammer-ons, etc, something that other music instrument synthesis models struggle to do without additional conditioning mechanisms. We also introduce an intermediary step of first rendering a guitar tablature to audio using a quick and simple sample-based virtual instrument. Our model performs style transfer on this simple audio rendering and transforms it into more realistic sounding audio. We use ‘style‘ here to refer to various performance-related qualities which distinguish natural and more synthetic performances. The style transfer is achieved using Flow Matching [ 28 ] , a recent generative modeling paradigm. This method allows us to greatly simplify the complexity of the training and inference pipeline, requiring less data and less time to train. The contributions of this paper are summarized as: (1) GuitarFlow, a novel model and methodology for realistic electric guitar synthesis from guitar tablatures using Flow Matching and style transfer; (2) an evaluation of the model using both objective metrics and a subjective listening test which shows the success of GuitarFlow in transforming audio rendered with a virtual instrument to sound more realistic; (3) a public repository 1 1 1 https://github.com/JackJamesLoth/GuitarFlow of code to allow other researchers to replicate and extend the research. This paper demonstrates the potential of the technique in greatly lowering data and computational requirements when training generative audio models. 2 Background 2.1 Guitar Tablatures Figure 1: Example of a guitar tablature, from the Guitar Pro editing software. Guitar tablatures (refer to Figure 1 ), also known as tabs, are symbolic representations of guitar music and have seen increased attention in recent years due to their ability to easily represent guitar-specific expressions [ 38 ] . In contrast to MIDI, which simply represents a note’s pitch and velocity over time, tabs represent both the fret and string number of a guitar. They can also support expressive playing techniques such as bends, hammer-ons, pull-offs, strum directions, and more. Tabs have seen an increase in attention from the MIR research community in the past few years in areas such as guitar tablature generation [ 39 ] [ 40 ] , automatic guitar transcription [ 46 ] [ 8 ] and tablature prediction from MIDI [ 11 ] . 2.2 Style Transfer Broadly speaking, style transfer involves transforming the “style” of a signal while preserving the “content” of signal. The task is popular in the image domain [ 16 ] [ 49 ] . A common assumption is that the audio of an instrument can be broken up into “content”, referring to the pitch, length and arguably loudness or intensity of the notes, and “style”, referring to the actual sound of the instrument and expressiveness of the performer playing those notes. Some musical style transfer works use a GAN-based approach, training a generator to convert an audio input to the desired timbre [ 22 ] [ 48 ] . Others use an autoencoder to produce disentangled representations of content and style [ 35 ] [ 1 ] . As with generative tasks recently, Diffusion has also become a popular choice [ 6 ] [ 21 ] , while differential digital signal processing (DDSP) [ 13 ] provides an alternative to all of these models by allowing trainable DSP functions. 2.3 Music Instrument Synthesis Instruments such as guitar have traditionally been simulated by modeling the physics of the instrument and strings [ 27 ] . More recently, models such as WaveNet [ 43 ] opened the door to neural generation conditioned on symbolic musical representations [ 19 ] [ 25 ] . DDSP has seen a lot of use creating audio synthesis models [ 2 ] [ 41 ] due to its flexibility. Despite its large data requirements, diffusion has also become a popular method for neural audio generation. While much work is focused on generating full song mixes [ 15 ] [ 14 ] , synthesising symbolic musical representations such as MIDI allows much finer musical control over the synthesised audio. Hawthorne et al. [ 18 ] trained a Transformer-based Diffusion model for multi instrument synthesis, which was in turn expanded on by Kim et al. [ 24 ] for specifically acoustic guitar. While the models showed promising results, they were held back by lack of annotated data. Maman et al. [ 34 ] used automatic MIDI transcription systems to help address this problem while adding conditioning on instrument timbre. All of these methods have the drawback of requiring large amounts of data and necessitating significant computational resources to train. For example, the training in [ 34 ] took 350 hours over three powerful Nvidia A100 GPUs. 3 Methodology 3.1 Flow Matching Flow Matching (FM) [ 28 ] is a generative modeling