DARAS: Dynamic Audio-Room Acoustic Synthesis for Blind Room Impulse Response Estimation
Chunxi Wang, Maoshen Jia, and Wenyu Jin · 2025
Read DARAS: Dynamic Audio-Room Acoustic Synthesis for Blind Room Impulse Response Estimation by Chunxi Wang, Maoshen Jia, and Wenyu Jin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-08135.txt.
Introduction
Chunxi Wang, Maoshen Jia, and Wenyu Jin present DARAS, a deep learning system that guesses a room's echo pattern from speech alone. Their 2025 paper targets room impulse responses, which capture how sound bounces indoors. Knowing them helps speech cleanup, recognition, and virtual sound, but measuring them directly is not always possible.
An audio encoder first pulls hidden features from the recording. A module built on the Mamba sequence model then estimates room traits without supervision. A fusion step blends sound and room features, and a tuning decoder shapes early echoes apart from late reverberation. Listening tests and scores showed DARAS beating older methods by a wide margin.
Catalog record
| CREATOR | Chunxi Wang, Maoshen Jia, and Wenyu Jin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-08135
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DARAS: Dynamic Audio-Room Acoustic Synthesis for Blind Room Impulse Response Estimation Chunxi Wang, Maoshen Jia, and Wenyu Jin Abstract Room Impulse Responses (RIRs) accurately characterize acoustic properties of indoor environments and play a crucial role in applications such as speech enhancement, speech recognition, and audio rendering in augmented reality (AR) and virtual reality (VR). Existing blind estimation methods struggle to achieve practical accuracy. To overcome this challenge, we propose the dynamic audio-room acoustic synthesis (DARAS) model, a novel deep learning framework that is explicitly designed for blind RIR estimation from monaural reverberant speech signals. First, a dedicated deep audio encoder effectively extracts relevant nonlinear latent space features. Second, the Mamba-based self-supervised blind room parameter estimation (MASS-BRPE) module, utilizing the efficient Mamba state space model (SSM), accurately estimates key room acoustic parameters and features. Third, the system incorporates a hybrid-path cross-attention feature fusion module, enhancing deep integration between audio and room acoustic features. Finally, our proposed dynamic acoustic tuning (DAT) decoder adaptively segments early reflections and late reverberation to improve the realism of synthesized RIRs. Experimental results, including a MUSHRA-based subjective listening study, demonstrate that DARAS substantially outperforms existing baseline models, providing a robust and effective solution for practical blind RIR estimation in real-world acoustic environments. I Introduction The Room Impulse Response (RIR) is a core parameter that describes acoustic characteristics of a room. It comprehensively reflects the processes of sound wave propagation, reflection, refraction, and attenuation within the indoor environment. When modeling room acoustics as a linear time-invariant system, the RIR precisely characterizes the sound wave propagation path from the source to the receiver, revealing the acoustic properties of the room. An accurate estimation of the RIR is crucial for analyzing and understanding the room’s acoustic environment, as it showcases the interaction between sound waves and the objects within the room. I-A Literature Review Although RIRs have widespread applications in speech enhancement [ 1 , 2 ] , speech recognition [ 3 , 4 ] , room acoustics modeling [ 5 , 6 , 7 ] and sound field rendering [ 8 , 9 , 10 ] , their direct measurements still face many challenges. Traditional methods rely on specific test signals, require a quiet environment, and use high-quality audio equipment. However, background noise, environmental interference and equipment limitations often affect measurement accuracy [ 11 ] . Moreover, the absorption characteristics and reverberation effects of a room can vary in real-world environments due to changes in activities and layouts [ 12 ] . As an alternative, acoustic simulators [ 13 , 14 , 15 ] generate RIRs by simulating sound wave propagation. They take into account factors such as room geometry, positions of sound sources and microphones, and reflection characteristics. However, these methods are computationally complex, and their simulation accuracy is limited when dealing with rooms of intricate shapes. To overcome the above-mentioned challenges, recent studies have shifted towards blind estimation methods for key room acoustic parameters, such as room volume [ 16 , 17 , 18 , 19 , 20 ] , reverberation time ( RT 60 ) [ 21 , 22 , 23 , 24 , 25 , 26 , 27 ] , and direct-to-reverberant ratio (DRR) [ 25 , 28 ] . These methods do not require direct RIR measurement. Instead, they estimate the room’s acoustic characteristics by collecting signals using commercial microphones and other consumer devices. However, in applications requiring high precision and fidelity, such as augmented reality (AR), virtual reality (VR), and reverb matching in audio post-production, limitations of blind estimation methods become increasingly apparent. In these scenarios, a single parameter or a finite set of parameters cannot comprehensively describe acoustic characteristics of the room, making it difficult to meet accuracy requirements [ 29 , 30 , 31 ] . Compared to estimating discrete acoustic parameters and subsequently synthesizing RIRs, directly estimating RIRs from recorded signals is more practically appealing. RIRs not only provide a qualitative description of key room acoustic parameters, but also reveal the time-frequency characteristics of the sound field. In recent years, extensive work has been reported in directly estimating RIRs from reverberant speech signals. Several traditional signal processing techniques have been proposed [ 32 , 33 , 34 , 35 , 36 ] , but these methods often rely on certain assumptions, such as performance dependencies on the choice of regularization parameters [ 35 ] , assuming the signal source to be a modulated Gaussian pulse rather than real speech signals [ 32 , 35 , 36 ] , or requiring prior knowledge of characteristics of the microphones and speakers [ 33 , 34 ] . Although these assumptions have demonstrated good performance under controlled conditions, their applicability remains somewhat limited in more complex and unpredictable real-world scenarios. With continuous advancements in deep learning technology, data-driven RIR estimation models have demonstrated significant advantages. These methods achieve accurate estimation of RIRs by extracting core features from monaural reverberant speech. Considering unique characteristics of RIRs, such as sparsity and sharp transients, some researchers have proposed adaptive generative architectures, including generative adversarial networks (GANs) and the regularized quantized variational autoencoder (RQ-VAE) [ 37 , 38 , 39 ] . However, these methods typically perform better at estimating early RIR components (i.e., direct sound and early reflections) and are more vulnerable when estimating late reverberation components. This is because early RIR components exhibit sparse, impulsive characteristics, whereas late components exhibit noise-like structures with significantly lower amplitude. Inspired by properties of room acoustics, the filtered noise shaping (FiNS) network [ 40 ] provides an efficient estimation approach by modeling RIRs as a combination of direct sound, early reflections, and decaying filtered noise signals through a time-domain encoder-decoder architecture. Additionally, the Demucs-based blind RIR estimation (Dbre) model [ 41 , 42 ] adopts an encoder-decoder architecture with U-Net skip connections, further enhancing the accuracy of RIR estimation. I-B Approach and Contribution by This Paper Although the above-mentioned data-driven RIR estimation models have made significant progress to some extent, they still face notable challenges and limitations. Existing models typically rely on audio features extracted from reverberant speech for RIR estimation. In real-world scenarios, geometries, structural features, and acoustic properties of rooms are often complex and variable [ 43 , 44 ] , especially in spaces with irregular layouts or diverse building materials. Physical and acoustic characteristics of these rooms are typically reflected as complex components in the reverberant signal. Existing estimation models may struggle to accurately separate key acoustic components in these circumstances, such as direct sound, early reflections, and late reflections. Therefore, inadequate modeling of room parameters may result in the model’s insufficient understanding of the room’s acoustic characteristics, causing the generated RIRs to fail to accurately and faithfully reflect the actual room parameters. These discrepancies not only affect the accuracy of acoustic models but may also have detrimental impacts on subsequent sound processing tasks. To address challenges in blind RIR estimation such as difficulties in data collection, high annotation costs, and mismatches between estimated RIRs and actual room acoustic parameters, this paper proposes a novel model, referred to as the dynamic audio-room acoustic synthesis (DARAS) blind RIR estimation model. The DARAS model estimates audio and room acoustic features from reverberant speech signals and adaptively adjusts the