Sound effects in media:A comparative analysis of recorded and synthetic samples in live-action and animation.
Nelly Garcia, Joshua Reiss · 2026
Read Sound effects in media:A comparative analysis of recorded and synthetic samples in live-action and animation. by Nelly Garcia, Joshua Reiss (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-31082.txt.
Introduction
Garcia and Reiss compare real and synthetic sound effects in live-action and cartoons. Creating sound for films and games uses redoing and taping real objects, a time-costly process. Procedural audio, or foley, lets makers build samples, but realism versus real samples remains in doubt. Their study tests made samples from an online engine with cartoon and live-action visuals. Results show built audio sounds real in drama and sci-fi scenes, for lasers, hits, air, and rockets, while made sounds fail in cartoons for daily actions.
Catalog record
| CREATOR | Nelly Garcia, Joshua Reiss |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33632 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.31082
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Sound effects in media:A comparative analysis of recorded and synthetic samples in live-action and animation. Nelly Garcia, Joshua Reiss Abstract Creating sound for storytelling is crucial to establishing the environment in productions such as films, TV series and video games. This process often involves repeating, layering and recording real objects or using sound libraries, which can be time-consuming and repetitive. To address these challenges, procedural audio, also known as digital foley, offers a solution by allowing sound designers to quickly generate samples. Despite its efficiency, questions remain about the believability of synthetic samples compared to real ones. In our study, we compared synthetic samples generated by an online procedural engine and integrated them with both animated and live-action visuals. Our results indicate that procedural audio is highly effective and perceived as believable in drama and sci-fi scenes, particularly for sound models such as lasers, hits, air and rockets, whereas synthetic sounds weren’t as believable in cartoon productions when representing everyday actions. Finally, we identified specific models that needed optimisation and highlighted audio features that needed improvement with feedback from audio professionals. 1 Introduction Sound has two basic roles in film, tv or games. These are story telling and story supporting. Sound is usually exaggerated (´hyper realism´) to create some reaction to the audience. [ 7 ] , refers to story telling as the most important characteristic of films by using dialogues, monologues or off-narration. While story supporting relates on the effects that inhence the tension in film and suggest the audience how to feel. [ 24 ] , states that sound design was properly introduced as a term in a Francis Coppola’s movie. [ 22 ] , defines sound design as an approach to creating ’new’ sounds with the intention that they will be heard in a given context of use. Sound designers’ workflows vary depending on the sources they are working with, such as libraries, Foley, direct sound and re-recording. Foley, named after Jack Foley, [ 1 ] refers to creating the sound of the object using different objects. (e.g. coconut shells for the horse steps). Sound designers need to consider the period and genre of a story, as well as the venue where it takes place, previous work had interviewed professionals and stated their process [ 20 ] .They need to respond to the social, historical and cultural context of the production.This context requires deciding which sounds to include in the soundscape. [ 17 ] . Finding the right sound for an object can be time consuming and involve listening to different samples repeatedly. The hypothesis that creating sounds without spending minutes searching for the right one can help sound designers innovate their libraries, the process of sound designed explain as a scientific method [ 8 ] has confirmed this issue. For example, the sound of a monster can be created from scratch, offering a wide range of models simultaneously, rather than layering sounds. Procedural audio engines give users a wide range of parameters to modify sounds. Though the perception of the ”believability” of sound design could be subjective and depends on which story the sound designer wants to share. [ 2 ] , states a division of the different ways a sound design could be created: • a. Realistic: Incorporation of elements that are meant to represent real life. It’s important to mention the difference between realism and reality . [ 15 ] , described realism as ‘the illusion of reality’,as a representation, without limiting it to truthfulness or authenticity. Reality on the other hand is real life as we experience it. • b. Symbolist: Interest in communicating an idea to the audience rather than representing real life. E.g a whirling sound when the scene transports you to the mind of the character. • c. Fantasy: Allowance to create a new world. Use of a wider range of sound effects,music or soundscapes to create a magical atmosphere. A concept related to the perception of reality used nowadays is hyperrealism , [ 12 ] , which means exaggeration of the image of reality, also understood as making the sound bigger than it is perceived in reality. Overall, soundscapes set location or create a mood. Most designers will use a combination of these types of sound to create the design for a production. According to [ 10 ] the perceived soundscape of a sound effect depends on two key factors: 1. The director’s perspective: The director’s vision and storytelling are paramount. Directors often describe the desired environment to the sound designer, providing a visual and conceptual framework for how the sound should be perceived. 2. Audience perception: The effectiveness of a sound effect is ultimately determined by the audience’s perception. The goal is to evoke the intended emotional response and enhance the overall viewing experience. Once the story and the target audience is decided, we need to discuss the possibilities for creating the audio files that will be in the production.We considered sound synthesis as the artificial creation of sound using analogue, digital or a combination of both [ 14 ] . Procedural audio, also known as digital foley, uses algorithms to generate audio in real time, adapting to changing inputs. Also, procedural audio involves building signal synthesis and processing chains that respond to on-screen events. However, the complexity of implementing DSP algorithms for artistic tasks, combined with the lack of evaluation methods and comparisons, has made this approach less common in the industry, leading to a preference for sample-oriented methods in sound design. Analysing and understanding the characteristics of sounds in both sound synthesis and procedural audio can improve algorithms for different sound categories, establish correlations between algorithms and perceptual concepts to provide objective explainability of the computer processes. This approach provides valuable insights for improvement e.g. [ 6 ] , did an approach trying to describe the ’whoosh’ sound and how it could be improved pointing out the different audio descriptors needed to create form scratch a sound of this type. This project aims to bridge the gap between research and industry practice by comparing the ’realism’ and ’believability’ of synthesis methods with traditional library samples already integrated with visuals. Our research questions are: • How believable are synthetic sounds compared to traditional library samples when combined with visuals? • In which scenarios do procedural audio models perform best in terms of audience perception? • Which specific models and audio features in procedural audio need further optimisation? In this paper we discuss the differences in the perception of realism between synthetic and real(library) audio samples. Section 1.1 introduces the methods and previous work in the field. In Section 2, we outline the experimental design and the dataset used. Sections 3 and 4 deal with the qualitative and quantitative analysis of our results. Finally, Section 5 presents our conclusions. 1.1 Methods To answer the first and third research questions, our primary goal is to identify low-level audio features that can help audio developers and sound designers improve algorithms for creating sounds from scratch. Audio features are defined as contextual information that can be extracted from an audio signal,they are a statistical or computational representation of an audio file. According to [ 13 ] , there could be a