Improving Active Learning for Melody Estimation by Disentangling Uncertainties
Aayush Jaiswal, Parampreet Singh, Vipul Arora · 2025
Read Improving Active Learning for Melody Estimation by Disentangling Uncertainties by Aayush Jaiswal, Parampreet Singh, Vipul Arora (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-17375.txt.
Introduction
Aayush Jaiswal, Parampreet Singh, and Vipul Arora study how to pick training samples for melody estimation. Their 2025 arXiv paper works in music information retrieval, where the task is to track the main tune's pitch through a recording. Labels are costly, so active learning asks the model to name the samples it most needs.
The frame splits uncertainty into two kinds: noise in the data itself, and the model's own lack of knowledge. A model trained on one data set must then adapt to a new domain with just a few labeled samples. Experiments show the model's own knowledge gap is the more reliable guide for that adaptation. It reaches good accuracy with less labeling work than the data-noise signal needs. The finding gives music technologists a sharper rule for spending a small labeling budget.
Catalog record
| CREATOR | Aayush Jaiswal, Parampreet Singh, Vipul Arora |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-17375
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Improving Active Learning for Melody Estimation by Disentangling Uncertainties Aayush Jaiswal, Parampreet Singh, Vipul Arora Abstract Estimating the fundamental frequency, or melody, is a core task in Music Information Retrieval (MIR). Various studies have explored signal processing, machine learning, and deep-learning-based approaches, with a very recent focus on utilizing uncertainty in active learning settings for melody estimation. However, these approaches do not investigate the relative effectiveness of different uncertainties. In this work, we follow a framework that disentangles aleatoric and epistemic uncertainties to guide active learning for melody estimation. Trained on a source dataset, our model adapts to new domains using only a small number of labeled samples. Experimental results demonstrate that epistemic uncertainty is more reliable for domain adaptation with reduced labeling effort as compared to aleatoric uncertainty. † † address: Indian Institute of Technology, Kanpur 1 Introduction Estimating the fundamental frequency, or melody, is a central problem in Music Information Retrieval (MIR). It underpins several downstream applications, including music search, transcription, generation, and recommendation [ 1 , 2 ] . Early methods for melody estimation relied on signal-processing heuristics [ 1 , 3 ] , followed by deep learning approaches framing it as a classification task over discretized pitch bins [ 2 , 4 , 5 , 6 , 7 ] , or as a regression task [ 8 , 9 ] . Recent studies [ 10 , 8 ] have explored uncertainty estimation for melody estimation in an active learning setting. However, they rely on aggregate uncertainty, without disentangling it into various factors. Model uncertainties can be factorized into two factors [ 11 ] : aleatoric uncertainty , which arises from inherent data ambiguity and cannot be reduced, and epistemic uncertainty , which reflects model uncertainty and can be reduced by collecting additional informative data samples. Numerous works have explored uncertainty estimation in deep models [ 12 , 13 , 14 , 15 , 11 , 16 , 17 , 18 , 19 , 20 ] . Monte Carlo dropout [ 12 ] estimates epistemic uncertainty through multiple stochastic forward passes, with dropout layer inducing different model realizations on each pass. [ 19 ] extends this framework to also capture aleatoric uncertainty. Deep ensembles [ 13 ] model epistemic uncertainty through disagreement among independently trained networks, with each network additionally predicting aleatoric variance. Bayesian neural networks provide joint estimates of both types of uncertainty [ 11 , 20 ] , but at the cost of significant computational overhead. In contrast, evidential deep learning [ 16 , 17 ] learns a higher-order evidential distribution that allows both aleatoric and epistemic uncertainties to be obtained in a single forward pass. It is computationally efficient and avoids the need for ensembles or out-of-distribution data. In this work, we investigate if disentangling uncertainty can help improve melody estimation in an active learning setting. We train a higher-order distribution that estimates aleatoric and epistemic uncertainties for melody estimation under both regression and classification settings. Further, we use these uncertainties for active learning. Experiments demonstrate that epistemic uncertainty is more effective for active data selection than aleatoric uncertainty, which makes it very useful for low-resource melody estimation. Our code is available at: https://github.com/AayushJaiswal01/melody-extraction-evidential 2 Preliminaries Consider an input-label pair (x,y) , where y denotes the frame-wise melody label for the input audio x . A model is trained to predict both the melody as well as aleatoric and epistemic uncertainties separately. This is done by placing a higher-order prior over the likelihood parameters that computes the mean and uncertainty components in a single forward pass [ 17 , 16 ] . In the classification setting, the label y\in\{1,...,K\} is categorical in nature. We assume class labels are drawn from a Categorical distribution, y\sim\textit{Categorical}(\mathbf{p}) , whose probabilities \mathbf{p} are modeled with a Dirichlet prior, \mathbf{p}\sim\text{Dir}(\mathbf{p}|\boldsymbol{\alpha}) [ 17 ] . The model outputs the evidence vector \boldsymbol{\alpha} , with total evidence given by S=\sum_{k}\alpha_{k} . The estimated melody corresponds to the class with the highest mean probability, \hat{p}_{k}=\alpha_{k}/S . Aleatoric uncertainty ( u_{a} ) and epistemic uncertainty ( u_{e} ) are obtained from the entropy decomposition of the Dirichlet distribution: u_{a}=\sum_{k=1}^{K}\frac{\alpha_{k}}{S}\big(\psi(S+1)-\psi(\alpha_{k}+1)\big), u_{e}=-\sum_{k=1}^{K}\frac{\alpha_{k}}{S}\log\left(\frac{\alpha_{k}}{S}\right)-u_{a} where \psi(\cdot) is the digamma function. In case of regression, the target y\in\mathbb{R} is assumed to follow a Gaussian likelihood [ 16 ] . The model assumes: y\sim\mathcal{N}(\mu,\sigma^{2}),\quad(\mu,\sigma^{2})\sim\text{NIG}(\gamma,\nu,\alpha,\beta), where \gamma\in\mathbb{R} , \nu>0 , \alpha>1 , \beta>0 , and NIG represents the Normal-Inverse Gamma distribution. The parameter \gamma represents the estimated melody, and aleatoric uncertainty ( \sigma_{a}^{2} ) and epistemic uncertainty ( \sigma_{e}^{2} ) are given by [ 16 ] : \sigma_{a}^{2}=\frac{\beta}{\alpha-1},\quad\sigma_{e}^{2}=\frac{\beta}{\nu(\alpha-1)}. In this work, we adopt similar training settings for both classification and regression tasks and evaluate them alongside established baselines for active learning. 3 Method 3.1 Problem Formulation Given a mel-spectrogram \mathbf{X}\in\mathbb{R}^{T\times F} , we formulate joint voicing detection and fundamental frequency estimation f_{0}(t) . The pitch range [51.91, 830.61] Hz is discretized into K=384 logarithmic bins with 12.5 cents resolution following the approach in [ 8 ] . A binary cross-entropy head performs voiced/unvoiced classification for all frames. For unvoiced frames, training relies solely on the voicing classification loss. For voiced frames, the model employs a dual formulation where the same bin centers serve different purposes. In the classification approach, these bin centers constitute K categorical target classes for Dirichlet parameterization through evidence scores \boldsymbol{\alpha} , while in the regression approach, they serve as continuous targets for training NIG parameters. 3.2 Model Architecture A ResNet model with four convolutional blocks with filter sizes (32, 64, 128, 256) using bottleneck layers, batch normalization, LeakyReLU, residual connections, and max-pooling. Dropout (0.3) and L2 regularization ( 10^{-5} ) are applied for regularization. The same model is used for all methods, with output heads varying based on the problem setting. Table 1 : Cross-dataset performance comparison. Values show RPA/RCA/OA (%). FT indicates fine-tuning with samples selected based on epistemic uncertainty (for M1 and M2) and TCP confidence scores for TCP (FT). Method MIR-1K HAR ADC2004 MIREX-05 RPA RCA OA RPA RCA OA RPA RCA OA RPA RCA OA \beta -NLL (Base) 71.8 72.4 53.3 66.1 66.4 58.2 42.6 45.0 36.3 74.7 75.5 60.6 TCP (Base) 81.1 82.3 84.6 71.0 71.9 73.1 43.1 46.2 46.9 77.4 78.4 82.0 TCP (FT) 81.2 82.6 84.4 81.1 84.8 83.0 55.3 59.8 55.2 79.9 80.4 83.9 M1 (Base) 75.8 78.5 81.7 69.7 72.4 72.8 43.7 47.2 47.9 71.8 74.0 78.9 M1 (FT) 76.1 78.5 80.7 85.7 88.1 86.9 59.0 68.8 52.5 78.9 81.1 81.5 M2 (Base) 80.9 81.3 84.6 66.8 67.7 69.2 44.0 46.0 47.1 78.3 79.2 82.5 M2 (FT) 81.9 82.6 85.3 96.2 96.3 96.0 68.8 70.0 64.4 85.0 85.4 87.1 • All base models were trained on MIR-1K and tested as it is on other datasets. Fine Tuning (FT) uses N=1000 samples for MIR-1K/HAR and N=100 samples for ADC2004/MIREX-05. 3.3 Classification Objective (M1) For classification, the loss L_{\text{M1}} follows the Type-II Maximum Likelihood objective [ 17 ] : L_{\text{M1}}=\frac{1}{\sum_{i}v_{i}}\sum_{i}v_{i}\cdot\left(L_{\text{NLL}}(\boldsymbol{\alpha}_{i},\mathbf{y}_{i})+\lambda_{t}\,L_{\text{KL}}(\boldsymbol{\alpha}_{i},\mathbf{y}_{i})\right) Here, L_{\text{NLL}}=\sum_{k}y_{ik}(\psi(S_{i})-\psi(\alpha_{ik})) is the negative log-likelihood, which maximizes evidence \boldsymbol{\alpha}_{i} for the correct class \mathbf{y}_{i} and v_{i}\in\{0,1\} indicates whether frame i is voiced (1 if voiced, 0 if unvoiced). Where S_{i}=\sum_{k}\alpha_{ik} and \psi(\cdot) is the digamma function. The term L_{\text{KL}} is a regularizer defined by the KL-divergence between the