Latent Acoustic Mapping for Direction of Arrival Estimation: A Self-Supervised Approach

2025

Read Latent Acoustic Mapping for Direction of Arrival Estimation: A Self-Supervised Approach (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-07066.txt.

Introduction

Adrian Roman, Iran Roman, and Juan Bello built a sound locator that learns without labeled examples, in a 2025 paper. Finding where a sound comes from matters for hearing aids, robots, and smart rooms. Classic methods draw acoustic maps but run slow and wobble when rooms change. Supervised networks are fast yet hunger for labeled data and hide their reasoning.

Their model, LAM, trains itself and still draws readable maps. It adapts to new rooms and works across different microphone arrays. On two standard benchmarks it matched or beat supervised rivals at pinpointing sources. Its maps can also feed other models as features, lifting their accuracy further.

Catalog record

YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-07066

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Latent Acoustic Mapping for Direction of Arrival Estimation: A Self-Supervised Approach Abstract Acoustic mapping techniques have long been used in spatial audio processing for direction of arrival estimation (DoAE). Traditional beamforming methods for acoustic mapping, while interpretable, often rely on iterative solvers that can be computationally intensive and sensitive to acoustic variability. On the other hand, recent supervised deep learning approaches offer feedforward speed and robustness but require large labeled datasets and lack interpretability. Despite their strengths, both methods struggle to consistently generalize across diverse acoustic setups and array configurations, limiting their broader applicability. We introduce the Latent Acoustic Mapping (LAM) model, a self-supervised framework that bridges the interpretability of traditional methods with the adaptability and efficiency of deep learning methods. LAM generates high-resolution acoustic maps, adapts to varying acoustic conditions, and operates efficiently across different microphone arrays. We assess its robustness on DoAE using the LOCATA and STARSS benchmarks. LAM achieves comparable or superior localization performance to existing supervised methods. Additionally, we show that LAM’s acoustic maps can serve as effective features for supervised models, further enhancing DoAE accuracy and underscoring its potential to advance adaptive, high-performance sound localization systems. \NoHyper 1 Introduction Acoustic mapping techniques have long played a central role in spatial audio processing, particularly for sound direction of arrival estimation (DoAE). Also referred to as acoustic imaging, acoustic mapping offers a spatial visualization of sound sources, facilitating intuitive tracking of sound emissions in complex environments [ 1 , 2 ] . Traditional acoustic mapping methods have laid the foundation for interpretable spatial sound analysis [ 3 , 4 , 1 ] . These typically project a directional sound intensity field onto a spatial representation by steering the array’s sensitivity pattern across directions of interest [ 5 , 4 ] . While computationally efficient, the resulting acoustic images suffer from poor angular resolution due to diffraction limits imposed by array size and sound wavelength [ 2 , 6 ] . Newer compressed sensing methods promise higher fidelity [ 2 ] , but their reliance on iterative solvers makes them computationally prohibitive [ 7 , 6 ] . Deep learning has emerged as a promising alternative for acoustic mapping, offering improved resolution without the computational burden of iterative solvers. DeepWave [ 2 ] exemplifies this shift by integrating graph-based convolutions within a recurrent architecture to produce high-resolution acoustic maps efficiently. It bridges traditional spatial filtering with data-driven learning, enabling practical deployment in real-time settings. However, DeepWave depends on ground-truth labels generated by compressed sensing methods, which constrain its performance ceiling. Its supervised nature and reliance on acoustic maps raise concerns about overfitting and generalization [ 8 ] , prompting growing interest in end-to-end models that learn directly from raw multichannel audio. Building on this body of research, we propose the L atent A coustic M apping (LAM) model, a self-supervised model to generate high-resolution spherical acoustic maps (SAMs) from both low- and high-resolution microphone arrays. Figure 2 shows LAM’s architecture. LAM synthesizes insights from traditional acoustic mapping, signal processing and self-supervised data-driven learning, offering scalability and adaptability to large and diverse datasets. It employs an autoencoder architecture to encode the covariance matrix of a microphone array into a latent space that captures spatially localized energy patterns in an interpretable acoustic map. Inspired by the graph convolutions from DeepWave [ 2 ] and recent image denoising techniques [ 9 , 10 ] , LAM further refines the acoustic map by applying denoising convolutions. LAM’s self-supervised approach leverages a decoder to reconstruct the microphone channel correlation matrix using the array’s steering matrix [ 5 ] . Unlike DeepWave, which inherits the limitations of its supervised training labels, LAM learns directly from raw multichannel data, removing the ceiling imposed by iterative-method-derived ground truth. Additionally, LAM has an upsampling module, enabling its adaptation to different microphone configurations, bridging the gap between low- and high-resolution covariance matrices. Fig. 1: Spherical Acoustic Maps (SAMs) for two active speech sound sources generated using UpLAM (4ch), LAM (32ch) and DeepWave (32ch) [ 2 ] . We evaluate LAM on datasets for DoAE, demonstrating its ability to outperform or match existing supervised methods while being robust across varied acoustic conditions 1 1 1 https://github.com/adrianSRoman/LAM . Our key contributions include: • LAM: A self-supervised model for generating high-resolution acoustic maps from microphone array recordings. • A benchmark showcasing LAM’s superior DoAE performance compared to DeepWave and signal processing methods for acoustic mapping. • An analysis of LAM’s adaptability and robustness across low- and high-resolution microphone arrays. Fig. 2: LAM Architecture: LAM encodes and reconstructs microphone covariance matrix via self-supervised learning. The latent SAM is denoised using 4 denoising steps each with 1D convolutions followed by ReLU non-linearities. The optimal (denoised) SAM \mathbf{x}^{(4)} is then decoded, guided by the steering matrix, to estimate the input CSM. Super-resolution upsampling (CDBPN) enables processing of inputs from lower-resolution arrays. 2 Related work 2.1 Signal-processing methods for acoustic mapping The fundamental method for acoustic mapping is delay-and-sum (DAS) beamforming. It linearly combines correlated microphone signals to steer the array’s sensitivity pattern across directions of interest, producing a spatial heatmap of acoustic energy [ 3 ] . While computationally efficient and interpretable, DAS suffers from poor angular resolution due to diffraction limits [ 4 ] . In practical terms, this results in coarse directional estimates, especially at low frequencies or when using compact arrays typical in mobile or embedded applications. The MUltiple SIgnal Classification (MUSIC) algorithm addresses some of these limitations by leveraging the eigenstructure of the spatial covariance matrix to separate signal and noise subspaces, enabling super-resolution localization beyond the diffraction limit [ 4 ] . However, MUSIC relies on assumptions such as the number of sound sources (to draw a separation between signals and noise) and them being uncorrelated. It also becomes less robust in noisy conditions. Compressed sensing approaches have been proposed to address these limitations [ 2 ] . Methods like the deconvolution approach for the mapping of acoustic sources (DAMAS) [ 1 ] and variants of Proximal Gradient Descent (PGD) [ 2 , 11 ] resolve finer angular details by imposing sparsity. However, these depend on iterative solvers with non-trivial convergence times. Thus, many applications such as acoustic cameras still rely on DAS due to its low-latency performance. LAM addresses these limitations by learning spatial energy distributions directly from the microphone covariance matrix, thus bypassing the diffraction-limited beam patterns of DAS and the eigen subspace separation assumptions required by MUSIC. It also eliminates the need for iterative solvers, instead using a feedforward architecture. 2.2 Deep acoustic mapping Data-driven and deep learning approaches have emerged. DeepWave [ 2 ] was a first-of-its-kind system that leveraged supervised learning to approximate high-resolution SAMs traditionally obtained through iterative solvers [ 12 ] . By building on these methods, DeepWave achieved high resolution acoustic imaging while maintaining computational efficiency inherited from feedforward networks. Previous work has also shown that the SAMs generated by DeepWave can serve as robust features for DoAE tasks [ 8 ] . However, its supervised nature presents generalization challenges as its learning can be bounded by pre-computed labels that are in turn generated from iterative solvers. In contrast, LAM uses a self-supervised learning approach, enabling learning from raw multichannel audio

Read the complete text