Stereo Reproduction in the Presence of Sample Rate Offsets

2025

Read Stereo Reproduction in the Presence of Sample Rate Offsets (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-05402.txt.

Introduction

Srikanth Korse, Andreas Walther, and Emanuel Habets fix a timing flaw that smears wireless stereo sound. The catalog creator field is empty, so the head byline governs here. Loudspeakers with independent clocks drift apart by tiny sample rate offsets, and the drift blurs the spatial image that stereo depends on. Network clock protocols exist, but what the offsets do to listeners was unmapped. Their 2025 method works in the audio itself.

Spatial filtering first isolates each speaker's contribution in the room. Comparing those signals with the original playback yields the offset between clocks, which is then compensated before the sound is rendered. Listening tests and objective measures agree: the fix preserves the spatial cues that the drift degrades. The authors offer the scheme for wireless speaker sets that cannot share a wire or a perfect clock.

Catalog record

YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-05402

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Stereo Reproduction in the Presence of Sample Rate Offsets Abstract One of the main challenges in synchronizing wirelessly connected loudspeakers for spatial audio reproduction is clock skew. Clock skew arises from SRO between the loudspeakers, caused by the use of independent device clocks. While network-based protocols like Precision Time Protocol (PTP) and Network Time Protocol (NTP) are explored, the impact of SRO on spatial audio reproduction and its perceptual consequences remains underexplored. We propose an audio-domain SRO compensation method using spatial filtering to isolate loudspeaker contributions. These filtered signals, along with the original playback signal, are used to estimate the SRO , and their influence is compensated for before spatial audio reproduction. We evaluate the effect of the compensation method in a subjective listening test. The results of these tests, as well as objective metrics, demonstrate that the proposed method mitigates the perceptual degradation introduced by SRO by preserving the binaural cues. \NoHyper 1 Introduction Spatial audio capturing and reproduction enable a wide range of applications in entertainment and teleconferencing [ 1 , 2 ] . On the playback side, spatial audio reproduction aims to recreate the captured complex acoustic environments - or construct completely new ones - allowing listeners to perceive localized sounds from dedicated positions in space and to experience a sense of envelopment. A key challenge in spatial audio reproduction over wirelessly connected loudspeakers is the synchronization of the individual playback devices. One important factor in this regard is clock skew caused by SRO between devices with individual clocks. SRO cause time-varying misalignment of playback signals, leading to degradation of binaural cues. Existing clock synchronization methods rely on network-based protocols such as PTP ( PTP ) [ 3 ] and NTP ( NTP ) [ 4 ] , which aim to align device clocks [ 5 , 6 ] . However, to the best of our knowledge, the impact of the presence of SRO on the listener’s perception in spatial audio reproduction has not been systematically studied. While SRO estimation using audio-domain observations has been extensively explored in wireless sensor networks [ 7 , 8 , 9 , 10 , 11 ] and acoustic echo cancellation [ 12 , 13 , 14 , 15 ] , no prior work has investigated this in the context of spatial audio reproduction specifically. In this work, we examine the effects of SRO in a stereo loudspeaker scenario. Further, we propose an audio-domain SRO compensation method that applies spatial filtering [ 16 ] to isolate loudspeaker contributions. The isolated loudspeaker signals are then used along with the original playback signals to estimate the SRO using the DWACD ( DWACD ) algorithm [ 11 ] . We then compensate for the effect of SRO before the spatial rendering step, thus eliminating the need for explicit clock synchronization. Evaluation using objective metrics and subjective listening tests demonstrates that the proposed method preserves binaural cues and mitigates perceptual degradation. 2 Stereo Reproduction amid SRO Fig. 1: Stereo reproduction using two devices, each consisting only of a loudspeaker ( q\in{1,2} ), wirelessly connected to a primary device that consists only of a microphone array (q=0). Consider a room with three devices and a listener, as shown in Fig. 1 . Without loss of generality, we define the first device as the primary device ( q=0 ), which transmits playback signals at a sampling rate f_{s} to auxiliary devices ( q\in{1,2} ), each containing a single loudspeaker. We assume that the primary device contains only a microphone array. Under the above assumptions, the binaural signal at the ears of the listener b_{i} , where i\in\{L,R\} can be described as b_{i}\left[n\right]=\sum_{q=1}^{2}h_{i,q}\left[n\right]*x_{q}\left[n\right], (1) where n is the sample index, q is the index of the auxiliary device, x_{q}\left[n\right] is the playback signal, h_{i,q}[n] are the AIR between the loudspeakers of the q\text{-th} auxiliary device and the ears of the listener. Assuming that the playback signals are synchronized, i.e., the auxiliary devices play at the same sampling rate f_{s} , ( 1 ) can be described in the time-frequency domain as B_{i}\left[k,l\right]=\sum_{q=1}^{2}H_{i,q}\left[k,l\right]\,X_{q}\left[k,l\right], (2) where B_{i}\left[k,l\right] , X_{q}\left[k,l\right] and H_{i,q}\left[k,l\right] with frequency index k and frame index l represent the time-frequency domain counterparts of b_{i}[n] , x_{q}\left[n\right] and h_{i,q}\left[n\right] , respectively. However, when the sampling rates of the auxiliary devices differ due to the presence of SRO , the playback signals are not synchronized. In such a scenario, the binaural signal at the ears of the listener in the frequency domain with sufficiently large window size N_{\text{w}} and hop size N_{\text{h}} can be written as [ 7 ] B_{i}\left[k,l\right]=\sum_{q=1}^{2}H_{i,q}\left[k,l\right]\,\Lambda_{q}\left[k,l\right]\,X_{q}\left[k,l\right], (3) where \Lambda_{q}\left[k,l\right]=\text{exp}\left(\frac{-j2\pi k}{N_{\text{w}}}\left(\frac{l\,N_{\text{h}}\,{\epsilon}_{q}}{f_{s}}\right)\right) , {\epsilon}_{q} is the SRO defined in ppm ( ppm ). Note that ( 3 ) holds only if \frac{l\,N_{\text{h}}\,{\epsilon}_{q}}{f_{s}}\ll N_{\text{w}} [ 8 ] . The SRO term explains the difference between the sampling rate of the playback signals f_{s} and the playback sampling rate f_{q} and is given by f_{q}=(1+\epsilon_{q})\,f_{s}. (4) In the following, we assume \epsilon_{q} is constant and ignore the effect of delay, coding, and frame errors that commonly occur during the transmission of playback signals from the primary device to the auxiliary devices. In this study, we evaluate the effect of \Lambda_{q}\left[k,l\right] on spatial perception from the listener’s perspective. In addition, we propose a solution to nullify the effect of \Lambda_{q}\left[k,l\right] . This involves first estimating the SRO {\epsilon}_{q} and resampling the playback signal X_{q}\left[k,l\right] to \bar{X}_{q}\left[k,l\right] where \bar{X}_{q}\left[k,l\right]=X_{q}\left[k,l\right]\,\bar{\Lambda}_{q}\left[k,l\right] such that \bar{\Lambda}_{q}\left[k,l\right]\,\Lambda_{q}\left[k,l\right]=1 and \bar{\Lambda}_{q}\left[k,l\right]=\text{exp}\left(\frac{j2\pi k}{N_{\text{w}}}\left(\frac{l\,N_{\text{h}}\,{\epsilon}_{q}}{f_{s}}\right)\right) . 3 SRO -Compensated Stereo Reproduction Our proposed SRO -compensated spatial reproduction system is as shown in Fig. 2 . In this setup, the primary device, which includes a microphone array, is responsible for estimating the SRO and resampling the playback signal before transmitting it to the auxiliary devices. The primary device uses a spatial filter [ 16 , 17 ] to extract each individual contribution of the loudspeaker signals. The spatial filter output and the playback signal are then used to estimate the SRO . The playback signal is subsequently resampled to compensate for the effect of SRO before being transmitted to the auxiliary devices. Fig. 2: SRO -Compensated Stereo Reproduction. 3.1 Signal Model The microphone signals of the primary device can be defined as y_{0,m}\left[n\,T_{0}\right]=\sum_{q=1}^{2}h_{0,q,m}[n\,T_{0}]*x_{q}\left[n\,T_{0}\right]+v_{0,m}\left[n\,T_{0}\right], (5) where n is the sample index, T_{0}=\frac{1}{f_{0}} is the sampling period of the primary device, m\in\{1,2,\ldots,M\} is the microphone index, q is the index of the auxiliary device, x_{q}\left[n\,T_{0}\right] denotes the playback signal sent to the q\text{-th} loudspeaker, v_{0,m}\left[n\,T_{0}\right] is the contribution of sensor noise, h_{0,q,m}[n\,T_{0}] is the AIR between the loudspeaker of the q\text{-th} auxiliary device and the m\text{-th} microphone of the primary device. Since the loudspeaker of the q\text{-th} auxiliary device converts the digital signal x_{q}\left[n\,T_{s}\right] that is transmitted from the primary device into its analog counterpart at a sampling rate of f_{q} and the microphone of the primary device converts the analog signal back to a digital signal at a sampling rate of f_{0} , we can define the relation between f_{s} and f_{0} in terms of SRO between the devices \epsilon_{q} and \epsilon_{0} as f_{0}=(1+\epsilon_{q})\,(1+\epsilon_{0})\,f_{s}, (6) where |\epsilon_{q}|\ll 1 and |\epsilon_{0}|\ll 1 are usually expressed in ppm . Since the terms \epsilon_{q} and \epsilon_{0} are very small, the term \epsilon_{q}*\epsilon_{0} can be ignored. This further simplifies

Read the complete text