DDSC: Dynamic Dual-Signal Curriculum for Data-Efficient Acoustic Scene Classification under Domain Shift

Peihong Zhang, Yuxuan Liu, Rui Sang, Zhixin Li, Yiqiang Cai, Yizhou Tan, Shengchen Li · 2025

Read DDSC: Dynamic Dual-Signal Curriculum for Data-Efficient Acoustic Scene Classification under Domain Shift by Peihong Zhang, Yuxuan Liu, Rui Sang, Zhixin Li, Yiqiang Cai, Yizhou Tan, Shengchen Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-17345.txt.

Introduction

A sound scene classifier trained on one recorder often stumbles when a different device captures the sound. Peihong Zhang, joined by six co-authors, targets that device shift problem, which grows worse when labelled examples are few. Earlier fixes ordered training examples from easy to hard, but they fixed that order before training began and never updated it.

Zhang and her co-authors propose a dynamic schedule that recalculates two signals after each training round: how device independent an example looks, and how much the model is still learning from it. Early rounds favour steady examples, and later rounds give more weight to device specific ones. Under a standard contest protocol, the schedule lifted cross-device scores across several base models.

Catalog record

CREATORPeihong Zhang, Yuxuan Liu, Rui Sang, Zhixin Li, Yiqiang Cai, Yizhou Tan, Shengchen Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-17345

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DDSC: Dynamic Dual-Signal Curriculum for Data-Efficient Acoustic Scene Classification under Domain Shift Peihong Zhang, Yuxuan Liu, Rui Sang, Zhixin Li, Yiqiang Cai, Yizhou Tan, Shengchen Li Abstract Acoustic scene classification (ASC) suffers from device-induced domain shift, especially when labels are limited. Prior work focuses on curriculum-based training schedules that structure data presentation by ordering or reweighting training examples from easy-to-hard to facilitate learning; however, existing curricula are static, fixing the ordering or the weights before training and ignoring that example difficulty and marginal utility evolve with the learned representation. To overcome this limitation, we propose the Dynamic Dual-Signal Curriculum (DDSC), a training schedule that adapts the curriculum online by combining two signals computed each epoch: a domain-invariance signal and a learning-progress signal. A time-varying scheduler fuses these signals into per-example weights that prioritize domain-invariant examples in early epochs and progressively emphasize device-specific cases. DDSC is lightweight, architecture-agnostic, and introduces no additional inference overhead. Under the official DCASE 2024 Task 1 protocol, DDSC consistently improves cross-device performance across diverse ASC baselines and label budgets, with the largest gains on unseen-device splits. † † address: School of Advanced Technology, Xi’an Jiaotong-Liverpool University, Suzhou, China 1 Introduction Acoustic scene classification (ASC) aims to recognize the scene from an audio segment and is a fundamental task in machine hearing [ 1 ] . A central challenge in ASC is domain shift [ 2 ] caused by recording-device variation, which may degrade generalization to unseen devices [ 3 ] , shown in Fig. 1 . The issue is exacerbated when limited labeled data are available [ 4 ] . The DCASE 2024 Challenge Task 1 [ 5 ] explicitly targets this scenario by requiring systems to be trained on small fractions (as low as 5%) of labeled audio from a limited set of devices and evaluated on recordings from unseen devices, while specifying strict limits on model size and computation. To mitigate domain shift with limited annotations, prior work [ 4 , 6 , 7 , 8 ] explores Curriculum Learning (CL) to encourage domain-invariant representations. CL mimics the human progression from easy to hard and structures the presentation of training data [ 9 ] , facilitating the acquisition of domain-invariant, generalizable representations [ 10 ] .Following this paradigm, these methods predefine an easy-to-hard curriculum that reorders or reweights training examples, encouraging the model to first focus on domain-invariant samples and later incorporate device-specific ones. However, existing curricula exhibit a critical limitation: they are static—the ordering or weights are fixed prior to training and remain unchanged thereafter [ 4 , 6 , 7 ] . This design neglects that both per-example difficulty and the marginal utility of each example for learning device-invariant structure change as the learned representation and the decision boundary evolve during training [ 8 ] . The result is a skewed exposure pattern: samples judged as high-invariance at early stages are overemphasized, whereas difficult cross-device cases—those informative for refining domain boundaries later—receive insufficient attention [ 11 ] . We contend that sample difficulty is nonstationary: as relevant knowledge is acquired, previously difficult examples can become easier, whereas initially easy examples saturate and contribute diminishing signal. These considerations motivate a dynamic curriculum that updates per-example weights online during training. Figure 1: Device-induced domain shift in ASC. For the same scene, recordings captured with different devices exhibit distinct spectrograms due to device characteristics. Consequently, a model trained on devices A and B may misclassify inputs from an unseen device C, highlighting the challenge of unseen-device generalization. Accordingly, a central design question arises: how should one design online, model-coupled signals to assess per-example difficulty as training evolves? Such signals should jointly encode (i) domain invariance—robustness across devices—and (ii) learning contribution—measuring the marginal benefit of revisiting a sample. To this end, we propose the Dynamic Dual-Signal Curriculum (DDSC) 1 1 1 Code will be released upon acceptance. , a dynamic curriculum that adaptively adjusts sample weights. At each epoch, DDSC computes two complementary signals: (i) a domain-invariance score obtained from prototype–posterior entropy over device prototypes, and (ii) a learning-progress score derived from the smoothed change of the per-example loss across epochs. A time-varying scheduler fuses these signals into a continuous curriculum score that determines per-example weights. The resulting schedule realizes an easy-to-hard presentation—prioritizing domain-invariant examples in early epochs and progressively emphasizing device-specific, difficult cases—thereby improving generalization to unseen devices without architectural changes or inference overhead. To assess the effectiveness of DDSC, we evaluate it on the DCASE 2024 Task 1 dataset [ 12 ] using the official splits across multiple ASC systems with diverse architectures and training setups [ 13 , 14 , 15 , 16 ] . Experimental results show that DDSC consistently improves cross-device performance under low-label budgets and outperforms existing curriculum baselines [ 4 , 8 , 6 , 7 ] , particularly on unseen-device splits. By design, DDSC is lightweight, architecture-agnostic, and easily integrable—it requires no modifications to the model architecture and introduces no additional inference overhead. As a training-schedule method, DDSC complements data augmentation [ 17 , 18 ] and feature-alignment approaches [ 19 ] for device-induced domain shift, providing a practical tool for domain generalization in data-efficient ASC. 2 Dynamic Dual-Signal Curriculum Figure 2: Overview of the DDSC. For each epoch, the backbone produces normalized features; the domain-invariance and learning-progress signals are computed and fused by a time-varying scheduler to produce per-example weights used in the weighted objective. 2.1 Notation and Objective Let \mathcal{D}_{\mathrm{train}}=\{(x_{i},y_{i},m_{i})\}_{i=1}^{N} , where x_{i} is an audio clip, y_{i} its scene label, and m_{i}\in\{1,\ldots,M\} indexes the recording device among M devices. A backbone f_{\theta} maps inputs to features z_{i}=f_{\theta}(x_{i})\in\mathbb{R}^{F} . Let L(x_{i},y_{i};\theta) denote the baseline per-sample loss; we do not assume any specific form. At training epoch e , DDSC computes two signals for each example: a domain-invariance signal derived from prototype entropy (Section 2.2 ) and a learning-progress signal based on a smoothed change of the per-sample loss (Section 2.3 ). A scheduler (Section 2.4 ) fuses these signals into a curriculum score s_{i}^{(e)} and maps scores to nonnegative per-example weights \pi_{i}^{(e)} with \sum_{i=1}^{N}\pi_{i}^{(e)}=1 . DDSC leaves the baseline loss function unchanged and replaces uniform averaging with dynamically computed per-example weights, yielding the epoch-wise weighted objective; pseudocode is shown in Algorithm 1 , and Fig. 2 illustrates the method. 2.2 Domain-Invariance Signal: Prototype Entropy Prior work trains a separate device classifier offline and uses its predictive entropy as this indicator—high entropy means the device is hard to identify, thus the sample is more domain-invariant [ 4 ] . Because that classifier is independent of the ASC model, it does not update with the backbone during training; its outputs are one-shot labels, so the curriculum remains static. To obtain a dynamic curriculum, we use prototype entropy [ 20 ] : with unit-normalized embeddings and device prototypes updated online from detached features, we form a temperature-scaled posterior over devices via cosine similarity and take its entropy as the indicator. This signal co-evolves with the backbone and adds no extra trainable parameters. Device prototypes and posterior. For each device m\in\{1,\ldots,M\} we maintain a unit prototype \mu_{m}\in\mathbb{R}^{F} estimated online from detached embeddings. Given a unit feature \tilde{z}=z/\lVert z\rVert_{2} , we compute cosine scores and a temperature-scaled posterior s_{m}(\tilde{z})=\tilde{z}^{\top}\mu_{m},\qquad p(m\mid\tilde{z})=\frac{\exp\!\big(s_{m}(\tilde{z})/\tau\big)}{\sum_{m^{\prime}=1}^{M}\exp\!\big(s_{m^{\prime}}(\tilde{z})/\tau\big)}. (1)

Read the complete text