An investigation of AI integration in sound designer workflows and experiences.
Nelly Garcia, Joshua Reiss · 2026
Read An investigation of AI integration in sound designer workflows and experiences. by Nelly Garcia, Joshua Reiss (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27174.txt.
Introduction
Garcia and Reiss investigate AI integration in sound designer workflows via a survey of 76 practitioners plus interviews with 20 professionals. Five themes emerge: Context, Workflow, Potential, Risks, and Right Use. Current AI tools perform adequately in fast media work but lack story depth for high-end sound design such as films and immersive settings. Practitioners prefer assistive, task-specific tools, especially restoration and library work, over end-to-end generative systems. The authors advise sound technologists and developers to build better AI tools for sound design.
Catalog record
| CREATOR | Nelly Garcia, Joshua Reiss |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26382 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.27174
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
An investigation of AI integration in sound designer workflows and experiences. Nelly Garcia, Joshua Reiss Abstract \correspondence Nelly [email protected] \lastnames Garcia and Reiss AI integration in sound designer workflows {onecolabstract} Artificial intelligence is increasingly being integrated into professional audio production workflows, yet a gap persists between the tools developers produce and the requirements of practising sound designers. This paper investigates this gap through a mixed-methods study comprising a survey of 76 practitioners and follow-up semi-structured interviews with 20 industry professionals. Results were analysed using descriptive statistical analysis and thematic analysis to identify patterns across both datasets. Five themes emerged from our analysis: Context, Workflow, Potential, Risks, and Right Use. Our work indicates that current AI tools perform adequately in fast-consumption media contexts but lack the narrative sophistication required for high-end sound design (films, immersive experiences etc). Practitioners demonstrate a preference for assistive, task-specific applications, particularly in audio restoration and library management, over end-to-end generative systems. This work contributes to the on-going discussion on the use of AI and AI-enhanced tools in the creative industries. We report on the current status of the field from the point of view of sound designers and creative audio practitioners, and offer a set of recommendation for sound technologist and developers based on our findings to guide the development of more informed AI tools for sound design. 1 Introduction Figure 1: Sound design process, adapted from [ 1 , 2 ] The history of audio engineering is defined by transformative paradigm shifts, from acoustic to analog recording, from analog to digital, and now from deterministic to generative workflows [ 3 , 4 , 5 , 6 ] . In this third transition, algorithms move beyond discrete tools to operate as active generative agents capable of producing entirely novel sonic material [ 7 , 8 , 9 , 10 ] . As AI becomes increasingly embedded across the creative industries, significant uncertainty persists regarding its impact on professional identity [ 11 , 12 , 13 ] and the skill development of future practitioners [ 14 , 15 ] . In post-production, sound design constitutes the sonic composition of a scene [ 16 , 17 ] , demanding both rigorous technical knowledge and the aesthetic judgment to serve a narrative moment [ 18 , 19 ] . This tension is particularly pronounced in immersive and spatial audio contexts, where parametric precision requirements exceed what current generative models can reliably deliver. While AI development in audio is accelerating, prevailing research prioritises technical benchmarks and computational efficiency over the practitioner-centred requirements of professional sound design [ 20 , 21 , 22 ] . A focus on machine capability alone risks obscuring the craft-based processes through which designers actually work [ 23 ] . The implications of this study are particularly relevant for immersive and game audio contexts. Sound design is not peripheral to immersion, it is constitutive of it. The demands of spatial audio and real-time interaction place distinct requirements on AI tool design that current generative models are not yet meeting. This paper addresses that gap through a mixed-methods study comprising an online survey of 76 participants and 20 semi-structured interviews, examining how AI is perceived and utilised across diverse professional contexts and the conditions under which these technologies can function as effective collaborative instruments within sound design workflows. 2 Related Work The sound design process begins with a creative partnership between the director and the designer [ 2 ] , progressing from pre-production through asset creation, layering and final mix delivery [ 1 ] , as illustrated in Figure 1 . This study focuses on the technical and creative core of this pipeline (highlighted in green), where designers spend the most time on repetitive, time-consuming tasks, searching for sounds, layering assets, and applying signal processing to serve the scene. In immersive media contexts, spatialisation adds a further layer of technical complexity. Under accelerating production cycles, generative AI has been positioned as a primary solution to workflow bottlenecks. Viewed through Bruno Latour’s Actor-Network Theory [ 24 ] , these technologies are not merely tools but actants that reshape the creative network. Text-to-audio models enable soundscape construction through natural language prompting [ 25 ] , while vocal-to-audio tools offer a more performative approach to asset creation [ 26 ] . However, a significant limitation persists: most generative models carry a music-centric bias, trained on rhythmic and melodic structures [ 27 ] that poorly translate to the nonlinear, texture-based demands of sound design. As a result, these tools often lack the granular control required by professionals working in complex immersive environments [ 28 ] . The integration of AI into creative workflows has also raised significant ethical and legal concerns, centred on data provenance and intellectual property [ 29 , 30 ] . The ’black box’ nature of many generative models, trained on copyrighted material without consent or compensation [ 31 ] — compounds a broader concern regarding the devaluation of professional craft and fair compensation for human expertise. 3 Methodology This study employed a mixed-methods research design to capture both the breadth of industry perspectives and the depth of individual professional experience [ 32 ] . The research was divided into two phases: an online survey and online semi-structured interviews. The survey was distributed via Microsoft Forms 1 1 1 https://forms.microsoft.com/e/VTprJVvVDC over a four-week period, consisting of 15 questions, eight demographic and seven focused on AI integration, workflow optimisation, and ethical positioning. Semi-structured interviews were conducted as guided conversations, allowing participants to address research topics organically rather than following a fixed sequence of questions [ 33 ] . The interview guide covered topics including current AI tool usage, perceptions of AI creativity, workflow boundaries, non-generative AI applications, and ethical considerations. 3.1 Survey The survey reached a diverse global audience of 76 participants across 21 countries, with representation spanning the United Kingdom, United States, Mexico, Italy, Germany, Spain and beyond. Gender representation included 51 male, 18 female, 5 non-binary, and 2 who preferred not to say. The sample was dominated by established professionals: 21 identified as experts, 20 as advanced, and 23 as intermediate, with only 12 identifying as beginners. This is further supported by years of experience, with 38% possessing over five years in the industry. Participants represented a multi-disciplinary workforce, with sound design as the primary professional identity (60.5%), alongside significant overlap with music and audio research (39.5%), post-production (26.4%), and specialised roles including game audio, Foley and dialogue design. 3.2 Semi-structured interview Twenty practitioners from the survey participated in semi-structured interviews. These were conducted remotely, primarily in English, with the option for Spanish-language sessions to ensure linguistic fluency and precision of technical expression among native speakers. The interviewees were 17 male, 2 female, and 1 non-binary participant, representing 9 sound designers, 4 audio researchers, and 7 music producers across various experience levels. This interdisciplinary composition facilitated a comparative analysis between music production workflows, the narrative-driven requirements of sound design, and the theoretical perspectives of active researchers. All sessions were recorded and transcribed for analysis. Thematic analysis was conducted using NVivo 2 2 2 https://lumivero.com to identify recurring workflow bottlenecks and professional concerns within the socio-technical network [ 34 ] . Figure 2: Boxplot representing Likert Scale question