Generative Data Augmentation Challenge: Synthesis of Room Acoustics for Speaker Distance Estimation
Jackie Lin 1,7 , Georg Götz 2 , Hermes Sampedro Llopis 2 , Haukur Hafsteinsson 2 , Steinar Guðjónsson 2 , Daniel Gert Nielsen 2 , Finnur Pind 2 , Paris Smaragdis 1 , Dinesh Manocha 3 , John Hershey 4 , Trausti Kristjansson 5,6 , and Minje Kim 1,5,8 · 2025
Read Generative Data Augmentation Challenge: Synthesis of Room Acoustics for Speaker Distance Estimation by Jackie Lin 1,7 , Georg Götz 2 , Hermes Sampedro Llopis 2 , Haukur Hafsteinsson 2 , Steinar Guðjónsson 2 , Daniel Gert Nielsen 2 , Finnur Pind 2 , Paris Smaragdis 1 , Dinesh Manocha 3 , John Hershey 4 , Trausti Kristjansson 5,6 , and Minje Kim 1,5,8 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-13250.txt.
Introduction
Jackie Lin and co-authors described a 2025 challenge on making synthetic room sound data. The challenge was part of a workshop on generative data at a major signal processing meeting. Its downstream task was guessing how far a speaker is from a microphone.
Rooms differ in how they reflect sound, and measuring or simulating many rooms well is hard. That limits the data used to train distance tools. The challenge asks teams to create extra room response data that is larger and more varied than real sets. Organizers provide a web site, the data set, and code to score entries. The hope is that made-up data can lift tools that depend on spatial sound cues.
Catalog record
| CREATOR | Jackie Lin 1,7 , Georg Götz 2 , Hermes Sampedro Llopis 2 , Haukur Hafsteinsson 2 , Steinar Guðjónsson 2 , Daniel Gert Nielsen 2 , Finnur Pind 2 , Paris Smaragdis 1 , Dinesh Manocha 3 , John Hershey 4 , Trausti Kristjansson 5,6 , and Minje Kim 1,5,8 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-13250
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Generative Data Augmentation Challenge: Synthesis of Room Acoustics for Speaker Distance Estimation Thanks: This material is in part based on work supported by the National Science Foundation under grant numbers 2512987 and 1910940. The authors appreciate Michael Neri at Roma Tre University for the guidance in implementing the baseline distance estimation model, and Anton Ratnarajah for guidance on the GWA dataset. Jackie Lin 1,7 , Georg Götz 2 , Hermes Sampedro Llopis 2 , Haukur Hafsteinsson 2 , Steinar Guðjónsson 2 , Daniel Gert Nielsen 2 , Finnur Pind 2 , Paris Smaragdis 1 , Dinesh Manocha 3 , John Hershey 4 , Trausti Kristjansson 5,6 , and Minje Kim 1,5,8 Abstract This paper describes the synthesis of the room acoustics challenge as a part of the generative data augmentation workshop at ICASSP 2025. The challenge defines a unique generative task that is designed to improve the quantity and diversity of the room impulse responses dataset so that it can be used for spatially sensitive downstream tasks: speaker distance estimation. The challenge identifies the technical difficulty in measuring or simulating many rooms’ acoustic characteristics precisely. As a solution, it proposes generative data augmentation as an alternative that can potentially be used to improve various downstream tasks. The challenge website, dataset, and evaluation code are available at https://sites.google.com/view/genda2025 . I Introduction In recent years, the room acoustics and spatial audio research field has seen a surge of research motivated by new technology such as augmented and virtual reality (AR/VR), deep learning, and parallel computing. The technology is largely based on precise characterization of the room acoustics by considering various factors, such as the shape of the room, furniture layout, positions and directionality of the sources and receivers, the material of the walls, and more. One of the most effective, yet exhaustive characterizations of a room’s acoustics is a dense set of room impulse responses (RIR) recorded at fine enough source-receiver positions in the room. Indeed, the explosion of learning-based approaches for old and new room acoustics tasks has increased the demand for such RIR data. However, when the RIR datasets used to train spatial audio systems are not diverse enough, these systems often struggle to generalize to new, unfamiliar rooms. This leads to poor user experiences or inaccurate results. Furthermore, gathering a diverse and large set of RIRs is in fact quite difficult; the process and equipment for measuring high-quality RIRs are costly and technical, and traditional room acoustics simulation methods suffer strong trade-offs between accuracy and computational cost. Over the years, many dataset papers have attempted to fill gaps in the public dataset ecosystem 1 1 1 An online repository of RIR datasets is maintained at https://github.com/RoyJames/room-impulse-responses . [ 1 , 2 , 3 , 4 , 5 , 6 , 7 ] , demonstrating the demand for and the challenge of obtaining quality room acoustics data. Fig. 1 : Overview of the generative data augmentation pipeline. In this challenge, we recognize the inherent value of generative AI models for data augmentation. As demonstrated in other domain areas such as computer vision [ 8 , 9 , 10 ] , speech synthesis [ 11 , 12 ] , and natural language understanding [ 13 ] , a well-designed generative model can help augment existing datasets that are often limited in quantity and diversity. The proposed challenge promotes research in generating RIR datasets. The synthesized RIRs can be directly used for various applications such as room auralization and spatial audio rendering, but this challenge focuses on using them to augment existing RIR datasets to train a better machine learning (ML) model. To this end, we propose to use the augmented dataset to improve the speaker distance estimation (SDE) task, where the ML model predicts the physical distance between a speech source and the receiver based only on the single-channel reverberant observation. The challenge asks participants to develop a generative model to reconstruct the RIRs of several rooms, given only a limited amount of information about the rooms, such as only a few RIR signals and basic shapes of the rooms. Then, the organizers compare participants’ reconstructed RIRs with the held-out ground-truth RIRs to assess their quality. In addition, participants are asked to train SDE models from a reverberant speech dataset they construct based from the few provided RIR signals. Their distance estimation performance will be evaluated on the hidden test signals, whose actual distances are kept from the participants. The overall pipeline of the generative data augmentation used for SDE is shown in Fig. 1 . In this paper, we describe the challenge, datasets, evaluation methods, and baseline models. The enrollment RIRs, 3D models of the rooms, test room-source-receiver locations, reverberant speech test set, evaluation metric functions, and trained baseline SDE model are provided in this link: https://sites.google.com/view/genda2025 . II Overview of the Challenge The challenge tasks participants to generate a room’s acoustics in the form of RIRs using a limited amount of information about the room. The assumption is that the acoustical information of the room is difficult to measure or acquire for a normal user, while knowing the room acoustics is very important for end-user applications, such as AR/VR. Hence, a data augmentation method can be used to flesh out a specific room’s acoustic information from an elementary set of available information that a non-technical user can easily provide, such as a few RIRs at a handful of locations. The data augmentation system can figure out other RIRs from various locations in the room to the degree that is useful enough for other downstream tasks. The challenge consists of two tasks that evaluate the room acoustics data augmentation on both direct RIR generation and its practical application in a downstream task: II-A Task 1: Evaluating Direct RIR Generation Participants are asked to generate RIRs at organizer-defined source-receiver locations for each of the rooms to directly evaluate their room acoustics data augmentation system. The organizers will also provide other information for advanced generation methods, such as the 3D model of the room shape, furniture layouts, and Ambisonic RIRs. The Task 1 submission is generated RIRs at held-out source-receiver locations. A straightforward method to assess the quality of the participating generative system is to directly compare the submission with the corresponding ground truth by using various objective metrics as listed in Sec. IV . II-B Task 2: Evaluating Usefulness in Downstream Task Beyond direct RIR evaluation metrics, the challenge validates generated RIRs through their effectiveness in a downstream task. Ideally, a successful generative AI system could recover RIRs of the room with near-perfect precision. However, by indirectly measuring the quality of the RIRs in the context of the downstream task, it is expected that the generative AI systems can focus more on the properties that are important for the task’s specificity. We choose the single-channel Speaker Distance Estimation (SDE) task because it is a challenging problem, relying only on the spectral and temporal characteristics of the observed signal in the single-channel scenario. To standardize evaluation and reduce participant workload, the organizers provide a state-of-the-art SDE model as a baseline (detailed in Sec V ). Participants must use this model architecture without modifications, ensuring that comparisons reflect data quality rather than architectural