Uncertainty Quantification and Risk Control for Multi-Speaker Sound Source Localization
Vadim Rozenfeld, Bracha Laufer Goldshtein · 2026
Read Uncertainty Quantification and Risk Control for Multi-Speaker Sound Source Localization by Vadim Rozenfeld, Bracha Laufer Goldshtein (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-17377.txt.
Introduction
Rozenfeld and Laufer Goldshtein add uncertainty bounds to sound source localization. Most methods give only a point guess, with no sense of trust. Their conformal approach builds regions that should hold the true source spots. One variant knows how many sources are active, and the other counts them first. Tests on simulations and real recordings kept the promised coverage, they report, across echo levels and setups.
Catalog record
| CREATOR | Vadim Rozenfeld, Bracha Laufer Goldshtein |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72937 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.17377
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Uncertainty Quantification and Risk Control for Multi-Speaker Sound Source Localization Vadim Rozenfeld, Bracha Laufer Goldshtein Abstract Reliable SSL ( SSL ) plays an essential role in many downstream tasks, where informed decision making depends not only on accurate localization but also on the confidence in each estimate. This need for reliability becomes even more pronounced in challenging conditions, such as reverberant environments and multi-source scenarios. However, existing SSL methods typically provide only point estimates, offering limited or no UQ ( UQ ). We leverage the CP ( CP ) framework and its extensions for controlling general risk functions to develop two complementary UQ approaches for SSL . The first assumes that the number of active sources is known and constructs prediction regions that cover the true source locations. The second addresses the more challenging setting where the source count is unknown, first reliably estimating the number of active sources and then forming corresponding prediction regions. We evaluate the proposed methods on extensive simulations and real-world recordings across varying reverberation levels and source configurations. Results demonstrate reliable finite-sample guarantees and consistent performance for both known and unknown source-count scenarios, highlighting the practical utility of the proposed frameworks for uncertainty-aware SSL. I Introduction Accurate SSL ( SSL ) is a fundamental component in a wide range of acoustic and audio signal processing systems, including robot audition [ 33 ] , camera steering [ 7 ] , and speech enhancement and separation [ 26 ] . In these applications, determining the DOA ( DOA ) or positions of one or more active sources enables downstream modules such as beamforming, source separation, diarization, or navigation, to operate reliably. The demand for robust SSL has only intensified as systems encounter increasingly complex acoustic environments with reverberation, noise, and multiple sources. A large body of work has focused on developing algorithms capable of estimating SSL under challenging acoustic conditions. Several classical approaches generate likelihood maps over a predefined spatial grid. These include SRP-PHAT ( SRP-PHAT ) [ 12 ] and EM ( EM )-based methods [ 37 ] , which exploit TDOA between microphone pairs, as well as subspace-based techniques such as MUSIC ( MUSIC ) [ 36 ] and ESPRIT ( ESPRIT ) [ 34 ] . More recently, DNN ( DNN )-based models have been proposed and often demonstrate improved performance by learning complex patterns that are difficult to capture with traditional signal processing techniques [ 19 ] . Many of these approaches produce spatial likelihood maps by imitating classical localization methods [ 41 , 45 , 18 ] , or by formulating the SSL problem as a classification task over a set of classes obtained by discretizing the region of interest [ 38 , 9 , 30 ] . Despite notable progress, most SSL systems operate in a strictly point estimation manner, meaning they output a single estimated location for each detected source, without quantifying the reliability of these estimates. However, errors are unavoidable since noise, reverberation, and interfering signals fundamentally distort the spatial cues on which SSL methods rely. Without a principled measure of UQ , downstream components must either trust the SSL output blindly or rely on heuristic thresholds that provide no statistical guarantees. Few recent approaches have proposed extracting reliability measures for SSL estimates to detect low-confidence estimates and out-of-distribution samples [ 38 , 30 ] . In [ 38 ] , Gaussian label smoothing is used during training, and the predicted peak value is treated as a proxy for reliability, while [ 30 ] models output uncertainty via a Dirichlet distribution. Both approaches provide useful reliability indicators, albeit without formal statistical guarantees. A widely used UQ approach that provides distribution-free finite-sample guarantees is CP [ 17 , 42 , 2 ] , which constructs PI that contain the true value with a user-specified probability. Few recent attempts were made to apply CP for SSL . For the single-source case, [ 20 ] applied CP using several uncertainty surrogates, including Monte-Carlo dropout, model ensembles, and quantile regression. Our prior work combined manifold-based SSL based on Gaussian process regression [ 23 ] with CP to efficiently obtain statistically valid PI [ 35 ] . This kernel-based localization approach was replaced by a graph neural network in [ 27 ] , while constructing valid PI using an alternative Jackknife+ formulation [ 5 ] . In the multi-source setting, [ 21 ] assumes a known number of sources and models the conditional multi-source DOA distribution using a Gaussian mixture model parameterized by a NN ( NN ), and CP is then applied to obtain PI from its outputs. These previous works [ 20 , 35 , 27 , 21 ] heavily rely on classical CP , which is tailored exclusively to the binarized MC ( MC ) loss, namely, the probability that the true value lies outside the PI . Yet, multi-source setups introduce additional and potentially competing losses beyond MC . For instance, errors may arise from failing to detect an existing speaker at all, or from declaring a speaker that does not exist. Moreover, classical CP is suited to calibrating only a single hyperparameter, such as a detection threshold, whereas practical systems involve multiple hyperparameters that must be tuned jointly. In addition, prior UQ frameworks are typically optimized for specific localization methods and do not generalize readily to alternative approaches. This work addresses these gaps by leveraging recent advances in the CP literature, enabling principled UQ for complex, multi-objective settings that classical CP cannot accommodate. We propose a general UQ framework applicable to any multi-source localization method that produces a likelihood map over a grid of candidate positions. We consider both scenarios in which the number of sources is known or unknown. The key idea is to associate each position estimate with an interpretable confidence information, expressed as prediction region, on a 2D spatial likelihood map that contains the true source location with high probability. When the number of sources is unknown, the framework further enables controlled detection of the correct number of sources. Extensive experimental studies demonstrate the effectiveness of the proposed framework across a wide range of conditions. Our main contributions are summarized as follows: • Our proposed frameworks operate on spatial likelihood maps from any classical or DNN -based localization method, yielding finite-sample, statistically valid prediction regions containing the true source location with high probability. • We introduce a method for constructing contiguous prediction regions around each SSL estimate that adapt to the local likelihood landscape, without imposing any geometric or distributional assumptions on the region shape. The size of this region directly quantifies uncertainty, with larger regions indicating lower confidence and vice versa. Such information can naturally inform downstream decision-making. • For the unknown-source case, beyond classical MC risk control, we additionally provide principled simultaneous control over the risk of failing to detect an existing speaker, while discouraging spurious detections and minimizing the size of the prediction region. • We evaluate the proposed frameworks on single- and multi-source tasks with both known and unknown number of sources. We consider both classical and DNN -based likelihood maps obtained for simulated environments, and real-world recordings. Our code is publicly available on GitHub. 1 1 1 https://github.com/vadimroz/UQ_in_multi_SSL The remainder of