DNSMOS-C: Improving End-to-end Speech Quality Models via Contrastive Learning
Xinyu, Fredrik, Victor, Chandan K. A, Christian, Saikat · 2026
Read DNSMOS-C: Improving End-to-end Speech Quality Models via Contrastive Learning by Xinyu, Fredrik, Victor, Chandan K. A, Christian, Saikat (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-26903.txt.
Introduction
Xinyu Liang and five colleagues present DNSMOS-C, a compact model that grades speech quality end to end. Quality scores guide the building of speech systems, but human grading is slow. Their model extends a leaner predecessor, DNSMOS Pro, which predicts mean opinion scores directly from audio. Big pretrained encoders and multi-stage training are avoided.
A contrastive loss is the new ingredient. Triplets of clips are arranged so the latent space orders itself by perceived quality. Training learns speech features and quality regression together in one framework. Across several data sets, correlation with human scores improved over the predecessor. Gains held on hard out-of-domain test sets. Analysis of the latent space showed an emergent low-dimensional ordering by quality. That ordering aids interpretation and stabilises training, with no extra computing cost.
Catalog record
| CREATOR | Xinyu, Fredrik, Victor, Chandan K. A, Christian, Saikat |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.26903
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DNSMOS-C: Improving End-to-end Speech Quality Models via Contrastive Learning Xinyu, Fredrik, Victor, Chandan K. A, Christian, Saikat Abstract We introduce DNSMOS-C, a compact end-to-end speech quality assessment model that extends the DNSMOS Pro framework by integrating a MOS-guided triplet-based contrastive loss. Applied directly to the intermediate embeddings, this contrastive supervision encourages the latent space to be better organized with respect to perceptual quality while preserving the simplicity and efficiency of DNSMOS Pro. Unlike prior methods that depend on large pre-trained self-supervised learning (SSL) encoders and multi-stage training, DNSMOS-C jointly learns speech representations and MOS regression within a single, unified framework. Experiments on multiple datasets show that DNSMOS-C consistently improves correlation metrics over DNSMOS Pro and achieves better generalization on challenging out-of-domain test sets. Furthermore, latent space analyses indicate that our approach learns representations that exhibit an emergent low-dimensional quality ordering, which enhances interpretability and improves training stability. These findings demonstrate that MOS-guided contrastive learning enables more robust and accurate quality predictions without incurring additional computational overhead. Liang Cumlin Ungureanu Reddy Schüldt Chatterjee keywords speech quality assessment, contrastive learning, deep neural network, representation learning † † address: 1 KTH Royal Institute of Technology, Stockholm, Sweden 2 Google LLC † † email: [email protected], [email protected], [email protected], [email protected], [email protected], [email protected] 1 Introduction Accurate and automatic speech quality assessment (SQA) plays a critical role in developing and monitoring modern audio technologies, ranging from streaming services to generative speech models. Traditionally, subjective evaluations such as mean opinion scores (MOS) provide the gold standard for quality assessment, but they are time-consuming, expensive, and not scalable. Consequently, recent research has focused on developing objective non-intrusive SQA models that predict MOS directly from degraded speech without requiring clean reference signals. Large-scale models leveraging self-supervised learning (SSL) representations [ 2 , 21 , 13 , 6 ] or multimodal large language models (LLMs) [ 23 ] have achieved state-of-the-art SQA performance. However, these approaches come with significant computational and memory overheads, making them less suitable for real-time deployment or resource-constrained environments. To address efficiency concerns, compact end-to-end SQA models based on convolutional architectures have become the standard [ 15 , 12 , 16 , 10 ] . Among these, DNSMOS [ 20 ] and its successor, DNSMOS Pro [ 4 ] , demonstrate superior performance and efficiency. This is largely achieved by replacing the recurrent network module with a global pooling layer, making them highly suitable for real-time applications such as VoIP deployment. However, a significant limitation of these models is their still limited ability to generalize to unseen distortions or recording conditions [ 3 ] . Recent advances in contrastive learning have demonstrated strong potential for learning well-structured and semantically meaningful embeddings [ 8 , 1 , 24 ] . In speech quality assessment, SCOREQ [ 19 ] introduced a triplet-based contrastive regression loss that organizes embeddings along a continuous “quality manifold,” improving generalization on unseen datasets. However, SCOREQ relies on heavily parameterized SSL models for feature extraction, limiting its applicability to real-time processing environments. In this work, we bridge this gap by introducing DNSMOS-C, a novel end-to-end model that integrates a MOS-guided contrastive loss into the DNSMOS Pro framework. By applying the triplet-based SCOREQ loss on intermediate embeddings, DNSMOS-C encourages its deep latent space to better align with perceptual speech quality in a single-step optimization, maintaining the simplicity and efficiency of the framework. The contributions in this paper can be summarized as follows. First, we present DNSMOS-C, a novel lightweight MOS prediction model that extends the DNSMOS Pro framework by integrating MOS-guided contrastive supervision directly on its intermediate latent representations. Second, we show that DNSMOS-C consistently achieves better correlation-based performance and exhibits improved robustness under domain shifts across multiple datasets. Finally, through extensive latent space analysis using PCA and clustering, we show that our model learns representations that are better organized with respect to MOS, suggesting an emergent low-dimensional quality ordering. Collectively, our experiments demonstrate that integrating MOS-guided contrastive learning enhances the performance, stability, and generalization capabilities of compact end-to-end SQA models. 2 Method 2.1 Problem formulation A MOS-labeled speech quality dataset consists of pairwise samples (\mathbf{x},y) , where \mathbf{x} denotes a speech clip and y its corresponding MOS. We denote the dataset as \mathcal{D}=\{(\mathbf{x}_{n}\,y_{n})\}_{n=1}^{N} , where N is the total number of speech clips in the dataset. The goal of an SQA model is to design a regression function f_{\boldsymbol{\theta}}(\mathbf{x}) with parameters \boldsymbol{\theta} that predicts y . Previous works [ 4 , 12 , 14 ] have shown that explicitly modeling a posterior distribution p_{\boldsymbol{\psi}}(y|\mathbf{x}) , where \boldsymbol{\psi} are the parameters of the posterior distribution, often improves predictive performance. Using a deep neural network (DNN), we can train the regression function to predict the parameters of the posterior distribution, i.e. \displaystyle\boldsymbol{\psi}(\mathbf{x})=\mathbf{f}_{\boldsymbol{\theta}}(\mathbf{x}). (1) The model parameters \boldsymbol{\theta} can be learnt in a maximum-likelihood manner using the dataset \mathcal{D} , formulated as \displaystyle\arg\max_{\boldsymbol{\theta}}\log\prod_{n=1}^{N}p_{\boldsymbol{\psi}}(y_{n}|\mathbf{x}). (2) 2.2 DNSMOS-C architecture Figure 1 : Architecture for DNSMOS-C Basing our architecture on DNSMOS Pro [ 4 ] , we assume a Gaussian posterior, i.e., \displaystyle p_{\boldsymbol{\psi}}(y|\mathbf{x})=\mathcal{N}(y;\mu(\mathbf{x}),\sigma^{2}(\mathbf{x})), (3) where the network predicts both the mean \mu(\mathbf{x}) and variance \sigma^{2}(\mathbf{x}) for each input speech clip \mathbf{x} . The training loss is then defined as the Gaussian negative log-likelihood (GNLL): \displaystyle L_{gnll} \displaystyle= \displaystyle\sum_{n=1}^{N}\frac{1}{2}\left[\log(\sigma^{2}(\mathbf{x}_{n}))+\frac{(y_{n}-\mu(\mathbf{x}_{n}))^{2}}{\sigma^{2}(\mathbf{x}_{n})}\right]. (4) The overall model architecture is illustrated in Figure 1 , which we name DNSMOS-C . The model consists of an encoder module f_{\text{enc}} and a head module f_{\text{head}} . The encoder has four convolutional layers followed by a global max-pooling layer, which maps each audio clip to a 64-dimensional embedding vector. The head module, composed of three fully-connected layers and a linear transformation, maps the embedding to the estimated MOS mean and variance. Here, we introduce the SCOREQ loss [ 19 ] , a triplet-based contrastive regression loss, into the DNSMOS Pro framework. The original SCOREQ formulation is a multi-stage process: first, an encoder and a projection head are trained to learn a quality-aware embedding space via the contrastive loss; then, a separate regression head is fit to predict MOS scores from these embeddings. In contrast, our DNSMOS-C framework adopts an end-to-end approach. Rather than depending on pre-trained SSL features or multi-stage optimization, our approach jointly guides the intermediate latent representations to be quality-aware while learning the MOS prediction task. To make SCOREQ compatible with our end-to-end setup, we directly apply the contrastive triplet loss on the embeddings produced by the encoder f_{\text{enc}} , and denote the embedding as e_{i} for the i -th sample. This encourages the model to structure the latent space according to perceptual speech quality while predicting the MOS mean and variance. The adapted SCOREQ loss is illustrated in Figure 2 , and formulated as L_{\text{scoreq}}=\sum_{\text{triplets}}\max\left(0,\;d(e_{i},e_{j})-d(e_{i},e_{k})+\delta\right), (5) where d(\cdot,\cdot) denotes the Euclidean distance in the embedding space e , and \delta\geq 0 is a margin enforcing separation between positive and negative pairs, in this experiment we set \delta=0 . 2.3 DNSMOS-C training and Inference Combining the GNLL loss and the adapted SCOREQ loss, the final training objective is defined as: \displaystyle L=L_{gnll}+\lambda\,L_{scoreq}, (6) where \lambda is a weighting factor that balances the contribution of the two learning objectives. During training, the model simultaneously minimizes L_{gnll} to predict the mean \mu(\mathbf{x}) and variance \sigma^{2}(\mathbf{x}) of the MOS distribution for