Case Studies and Reflections on Agentic Software Engineering for Rapid Development of Digital Music Instruments

Matthew John Yee-King · 2026

Read Case Studies and Reflections on Agentic Software Engineering for Rapid Development of Digital Music Instruments by Matthew John Yee-King (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14016.txt.

Introduction

Yee-King probes agentic software engineering for new digital music tools, a craft strained by short tool life, poor tool fit, and high entry bars. Three case trials use agent methods with C++ and the JUCE frame. Trial one remakes Laurie Spiegel's Music Mouse as a native plug-in. Trial two moves Pachet's Continuator from Python to a native plug-in. Trial three builds a new tool. The piece weighs if agent coding can cut entry bars and stretch tool life.

Catalog record

CREATORMatthew John Yee-King
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33449
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.14016

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Case Studies and Reflections on Agentic Software Engineering for Rapid Development of Digital Music Instruments Matthew John Yee-King Abstract . The article explores the use of agentic software engineering (ASE) in the development of innovative audio software. It begins with a review of background work that lays out the challenges of longevity, interoperability and barriers to entry in digital music instrument creation, explaining recent developments in ASE and highlighting the possibility that ASE can lower barriers to entry and facilitate creation of interoperable software with greater longevity. Following that, we present case studies wherein we used ASE technology in three distinct ways to develop audio software in the C++ language with the JUCE framework. In case study 1, we re-implement Laurie Spiegel’s ‘Music Mouse’ software as a native plugin. In case study 2, we translate Pachet’s ‘Continuator’ system from Python into a native plugin. In case study 3, we develop a new 3D user interface for an existing ‘tracker’ sequencer using OpenGL. We describe the experiences of the human developer in the case studies via autoethnographic discussion of the prompt logs and snapshots of the software as it was developed. We identify effective practice for ASE use in this domain and suggest future steps for the work involving evaluation of the method with non-programmer musicians. \setcopyright cc \acmYear 2026 \acmDOI \acmConference [Goldsmiths Computing]Technical ReportsLondon, UK \settopmatter printacmref=false \acmISBN {teaserfigure} NIMEs programmed by Codex. \Description . 1. Introduction In this paper, I explore the possibilities of agentic software engineering for audio software development. Agentic software engineering (ASE) involves humans developing software in collaboration with tool-using large language models which through an ‘agentic’ layer, can develop and carry out plans. The human user inputs text, image and other media prompts and the agent enacts its plan by reading and analysing source code and documentation, creating and editing files, running build commands and so forth. The particular type of software I consider in the paper is ‘software digital music instruments’ which I will henceforth refer to as SDMIs for brevity. I focus on two areas of interest to the NIME community: the problem of longevity and interoperability and the challenge of lowering the barrier to entry for the potentially large community of non-programmers who wish to experiment with the creation of new music technology. I explore these questions through three distinct audio software development case studies: re-creating a well-known SDMI (Music Mouse) from the user manual and screenshots, translating an SDMI (Continuator) from Python to C++ and developing a new 3D OpenGL user interface for my own tracker sequencer. This article was inspired by my recent experiences working with ASE tools to develop audio software. My experience has been that the tools very significantly accelerate audio software development cycles and that with an appropriate starting template and documentation, it is possible to develop interoperable audio software plugins in C++ entirely through natural language prompts, with limited knowledge of the underlying implementation. Thus, there is a lot of potential here for increasing interoperability of existing SDMIs (e.g. through translation into plugins) and lowering the barrier to entry to a wider community of SDMI creators. Whilst there is potential, there is limited published work exploring the use of ASE in the audio software domain, which is well-known to be a challenging area for software development. This is especially true when one considers the need to create interoperable, standardised software such as plugins with which musicians are comfortable and familiar because plugins are generally written in C++, a notoriously hard language to learn. To address this gap in the published work, I report on some initial experiments I have conducted to evaluate the capabilities of these emerging technologies. The contributions of the paper are as follows: (1) A description of a methodology for developing native audio software using ASE technology (2) The application of the methodology to three distinct case studies and reflections on problems encountered and how they were overcome (3) A discussion of the potential of ASE technology to address well known problems in research-oriented SDMI development, namely longevity, interoperability and the barrier to entry for non-programmers 2. Previous work 2.1. Making NIME and SDMI development accessible Developing more accessible and efficient means to get from idea to prototype is not a new activity for computer music researchers. There is a long history of specialised programming languages and environments from Music-N through CSound, Max/MSP, PureData, SuperCollider and Faust and onto Bela, Livecoding languages and so forth, many of which are discussed by Dannenberg 6 Whilst Dannenberg claims that “Computer music languages have enabled composers who are not software engineers to nevertheless use computers effectively”, anyone who has taught a class to composers about a textual language such as SuperCollider will be aware of the difficulty learners face in setting up the tools, then the brittleness and abstractness of the languages. For example, seasoned SuperCollider educator Collins discusses the challenges of transitioning learners from parameter editing to more complex program design 5 . A lot of work has been done to address these issues: concerning the problems of brittleness and abstractness, visual languages such as Max/MSP are less brittle and less abstract and educators report significant success with non-programmers 25 . Concerning tool setup, a widely used solution is the use of ‘zero-setup’, web-based environments such as the educationally focused MIMIC platform 27 ; 13 , the web-based version of the Tidal Cycles livecoding system Strudel 14 ; 22 ; 7 , and the web interface provided with the Bela hardware platform 8 . Another problem associated with computer music languages, and a popular subject in the literature, is that of longevity and sustainability of the software created using them. For example, in a review of 40 years of NIMEs, Sullivan and Wanderley stated that “a DMI may not be viable unless basic stability, reliability and compatibility standards have been met” 24 . An emerging trend which addresses compatibility is the development of plugins which interoperate with standard audio software used by musicians 26 . Examples are the DrumGAN and RAVE VSTs 15 ; 2 . The problem with plugins is that they are typically written in the C++ language which is notoriously difficult. To quote Bjarne Stroustrup, the creator of C++: ‘‘C makes it easy to shoot yourself in the foot; C++ makes it harder, but when you do it blows your whole leg off’’ 1 1 1 https://www.stroustrup.com/quotes.html . Given this, it seems reasonable to assert that the barrier to entry for non-programmer musicians to plugin development is higher than that for, say, Max/MSP. Though we should note that plugins are not the only route to interoperability, for example, ‘Max for Live’ allows Max/MSP patches to run inside Ableton Live 2 2 2 https://cycling74.com/products/maxforlive ; the Faust IDE allows users to develop in the Faust language and to use the web platform to directly compile their program into a binary VST plugin (as well as many other formats) 11 . But if musicians wish to develop software that integrates with their other music tools, C++, Max for Live and Faust all share the requirement to operate and express ideas in the unfamiliar medium of a programming language (even if it is a visual

Read the complete text