Resounding Acoustic Fields with Reciprocity
Zitong Lan Yiduo Hao Mingmin Zhao · 2025
Read Resounding Acoustic Fields with Reciprocity by Zitong Lan Yiduo Hao Mingmin Zhao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-20602.txt.
Introduction
Zitong Lan, Yiduo Hao, and Mingmin Zhao name a task called resounding: to gauge room echo traits at new source spots from a few gauged spots. Rich sound in a fake world needs source spots that can roam free. The task plays the part that relighting plays for sight. Their way, Versa, leans on the swap law of sound: trade source and ear spots to make true new samples.
Gain shapes of source and ear units block a plain swap, so a self-taught step is built to mend that. Marks show Versa lifts sound field learning on fake and real sets by a lot. User tests with ears in the loop show a much more deep, wrapped sound feel.
Catalog record
| CREATOR | Zitong Lan Yiduo Hao Mingmin Zhao |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-20602
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Resounding Acoustic Fields with Reciprocity Zitong Lan Yiduo Hao Mingmin Zhao Abstract Achieving immersive auditory experiences in virtual environments requires flexible sound modeling that supports dynamic source positions. In this paper, we introduce a task called resounding, which aims to estimate room impulse responses at arbitrary emitter location from a sparse set of measured emitter positions, analogous to the relighting problem in vision. We leverage the reciprocity property and introduce Versa, a physics-inspired approach to facilitating acoustic field learning. Our method creates physically valid samples with dense virtual emitter positions by exchanging emitter and listener poses. We also identify challenges in deploying reciprocity due to emitter/listener gain patterns and propose a self-supervised learning approach to address them. Results show that Versa substantially improve the performance of acoustic field learning on both simulated and real-world datasets across different metrics. Perceptual user studies show that Versa can greatly improve the immersive spatial sound experience. Code, dataset and demo videos are available on the project website: https://waves.seas.upenn.edu/projects/versa . 1 Introduction The rapid development of AR/VR technology has highlighted the role of multi-sensory synthesis, where both visual and audio signal must be rendered coherently to provide immersive experiences [ 11 , 42 , 53 , 64 ] . While significant progress has been made in modeling dynamic visual field [ 17 , 20 , 63 ] , the acoustic counterpart remains largely limited to static scenarios. Recent works have demonstrated impressive results in modeling acoustic fields [ 8 , 34 , 37 , 39 , 44 , 45 , 46 , 54 , 59 ] , but primarily focus on a fixed sound source. This constraint limits auditory experiences where sources move through the scene, such as conversations between walking participants or footsteps echoing through corridors. In this paper, we study a novel task of estimating acoustic fields at arbitrary emitter positions, given observations from only a sparse (i.e., fewer than 10) set of emitters. This setup is motivated by practical deployment constraints: while microphones are compact, inexpensive, and easy to place in dense arrays, speakers are bulky, power-hungry, and challenging to install at scale [ 18 ] . Moreover, simultaneously operating multiple speakers in the same room can introduce significant interference. We frame this task as resounding , parallel to relighting in computer graphics. Just as relighting enables control over illumination in virtual scenes, resounding enables dynamic placement of sound sources while preserving physical realism. The core challenge lies in modeling how acoustic fields vary with emitter positions in a way that is physically consistent and generalizable. Modeling acoustic fields fundamentally relies on estimating impulse responses, which characterize how sound waves propagate within an environment. Existing learning-based approaches to this problem can be broadly categorized into two classes. The first class follows the neural radiance field paradigm [ 41 ] in graphics, where neural networks learn spatially continuous acoustic fields from data [ 34 , 36 , 37 , 39 , 54 ] . However, these methods struggle with sparse emitter locations as they require densely (i.e., hundreds or thousands) deployed emitters to generalize to novel emitter locations. The second class leverages differentiable ray tracing [ 59 , 26 ] to explicitly model acoustic propagation paths. While this approach improves generalization, it relies heavily on simplified geometry (e.g., a few dozen planar surfaces), leading to significant errors in environments with complex structures. Figure 1 : Estimated acoustic field at novel emitter position. For simulated scenes ( five training emitters each), we show loudness distribution (red: loud, blue: quiet) and phase patterns at 1 kHz (periodic blue-red). Purple arrows mark emitter poses. Compared to the baseline (AVR [ 34 ] ), Versa-ELE improves phase map, and Versa-SSL achieves accurate energy map with proper directivity. In this paper, we introduce Versa, a physics-inspired approach that facilitates realistic resounding under sparse emitter configurations. Our method draws inspiration from reciprocity , a fundamental principle in wave propagation. Reciprocity states that if the roles of an emitter and a receiver are exchanged, the wave traverses the same path in reverse , and the cumulative propagation effects remain unchanged . This principle holds across various wave phenomena, including light [ 52 ] , radio-frequency signals [ 6 ] , and acoustic waves [ 31 ] . In graphics, this principle underpins powerful algorithms like bidirectional path tracing [ 32 ] . Similarly, in acoustics, for any path between source and receiver, exchanging their positions preserves wave propagation characteristics [ 31 , 48 , 57 ] . Building on the principle of reciprocity, we propose Emitter Listener Exchange (Versa-ELE), a strategy that generates physically valid virtual training samples by swapping the roles of emitters and listeners while enforcing the same impulse response. This technique addresses a key asymmetry in data collection: dense sampling of listener positions is relatively easier due to the compact and low-cost nature of microphones, whereas emitter deployment is far more limited due to cost, interference, and physical constraints. Versa-ELE effectively transforms densely placed microphones into dense virtual speakers. We implement Versa-ELE as data augmentation and demonstrate that it consistently improves performance across a range of acoustic field models. While Versa-ELE is broadly effective, it assumes same directional patterns between emitters and listeners to ensure that the exchanged impulse responses remain unchanged. In practice, however, real-world devices can exhibit asymmetric directional gain patterns, such as an omnidirectional speaker versus a highly directional shotgun microphone. To address this limitation without discarding the core insight of reciprocity, we introduce a complementary Self-Supervised Learning strategy (Versa-SSL) that incorporates reciprocity as a constraint on the model’s predictions. Our key idea is to decouple directional patterns from the acoustic propagation effects, allowing the model to learn from swapped emitter/listener pairs by enforcing consistency between their predicted outputs. This approach generalizes reciprocity to a broader set of scenarios and leads to more robust and physically grounded acoustic field estimation, as shown in Fig. 1 . We comprehensively evaluate Versa on the resounding task using both simulated and real-world datasets. Versa-ELE is model-agnostic and can be applied to existing neural acoustic field models, yielding average improvements of 34% on C50 and 31% on STFT. On top of the AVR [ 34 ] , Versa-SSL further improves performance by 24% on C50 and 48% on STFT, demonstrating its effectiveness in scenarios with asymmetric gain patterns. Perceptual study additionally confirms that Versa enhances spatial audio realism and directional consistency. In summary, our work makes the following contributions: • We leverage reciprocity in wave propagation and propose Versa-ELE, a simple yet effective strategy to augment sparse emitter data by generating physically valid virtual samples. • We introduce Versa-SSL, a self-supervised learning framework that enforces reciprocity-based consistency in model predictions and generalizes to asymmetric directional gain patterns. These methods serve as a general machine learning training strategy grounded in physical reciprocity. • We implement Versa on multiple models with comprehensive evaluations. Results demonstrate Versa significantly improves acoustic field estimation and enables perceptually realistic resounding. 2 Related Work Room Impulse Response Modeling. Impulse response modeling has recently gained a lot of attention, driven by advances in neural acoustic field learning and immersive audio rendering for virtual environments. Early methods [ 5 , 40 , 58 ] relied on audio