QAMO: QUALITY-AWARE MULTI-CENTROID ONE-CLASS LEARNING FOR SPEECH DEEPFAKE DETECTION
Duc-Tuan Truong, Tianchi Liu, Ruijie Tao, Junjie Li, Kong Aik Lee, Eng Siong Chng · 2025
Read QAMO: QUALITY-AWARE MULTI-CENTROID ONE-CLASS LEARNING FOR SPEECH DEEPFAKE DETECTION by Duc-Tuan Truong, Tianchi Liu, Ruijie Tao, Junjie Li, Kong Aik Lee, Eng Siong Chng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-20679.txt.
Introduction
Fake speech is hard to spot when an attack type has never been seen before. Duc-Tuan Truong and five co-authors address that problem in a 2025 research paper on speech deepfake detection. Their method is called QAMO, short for quality-aware multi-centroid one-class learning. It was accepted for the INTERSPEECH 2026 conference.
Older one-class methods model real speech around a single center point. QAMO instead uses several centers, each tied to a level of speech quality, such as how natural the voice sounds. Quality scores come from existing assessment models. Tests reported by the authors show the multi-center design models real speech better and improves detection of unseen fake attacks.
Catalog record
| CREATOR | Duc-Tuan Truong, Tianchi Liu, Ruijie Tao, Junjie Li, Kong Aik Lee, Eng Siong Chng |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-20679
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
QAMO: QUALITY-AWARE MULTI-CENTROID ONE-CLASS LEARNING FOR SPEECH DEEPFAKE DETECTION Duc-Tuan Truong, Tianchi Liu, Ruijie Tao, Junjie Li, Kong Aik Lee, Eng Siong Chng Abstract Recent work shows that one-class learning can detect unseen deepfake attacks by modeling a compact distribution of bona fide speech around a single centroid. However, the single-centroid assumption can oversimplify the bona fide speech representation and overlook useful cues, such as speech quality, which reflects the naturalness of the speech. Speech quality can be easily obtained using existing speech quality assessment models that estimate it through Mean Opinion Score. In this paper, we propose QAMO: Quality-Aware Multi-Centroid One-Class Learning for speech deepfake detection. QAMO extends conventional one-class learning by introducing multiple quality-aware centroids. In QAMO, each centroid is optimized to represent a distinct speech quality subspaces, enabling better modeling of intra-class variability in bona fide speech. In addition, QAMO supports a multi-centroid ensemble scoring strategy, which improves decision thresholding and reduces the need for quality labels during inference. With two centroids to represent high- and low-quality speech, our proposed QAMO achieves an equal error rate of 5.09% in In-the-Wild dataset, outperforming previous one-class and quality-aware systems 1 1 1 Code and models are available at github.com/ductuantruong/QAMO . † † address: 1 Nanyang Technological University, Singapore 2 National University of Singapore, Singapore 3 The Hong Kong Polytechnic University, Hong Kong 1 Introduction Traditional approaches frame speech deepfake detection (SDD) as a binary classification task, where models are trained to distinguish between real and fake speech [ 1 , 2 , 3 ] . However, these methods tend to overfit the known spoof attacks and reduce their ability to detect unseen ones [ 4 , 5 , 6 ] . To overcome this, one-class learning [ 4 ] has been proposed as an alternative training scheme. Instead of learning distinct representations for bona fide and spoofed speech, one-class learning focuses on modeling a compact space of real speech around a single centroid, and considers deviations from this centroid as potential spoofed speech. By focusing on the unique patterns of genuine speech, this approach generalizes better to unknown deepfake attacks. Despite its advantages, conventional one-class learning constrains bona fide speech to a single compact subspace, which can oversimplify the diverse nature of genuine speech. Evidence from SAMO [ 6 ] shows that multi-centroid modeling effectively represents intra-class speaker-related characteristics, leading to improved performance over single-centroid one-class learning baselines. Beyond speaker information, another important speech factor is speech quality, which can influence the separation between bona fide and spoofed speech. Specifically, [ 7 ] reported that there are quality gaps, measured by Mean Opinion Score (MOS), between real and synthetic speech in existing speech deepfake detection datasets. Notably, [ 8 , 9 ] show that leveraging MOS in training samples selection improves the performance of SDD. Motivated by these findings, we propose QAMO, a quality-aware multi-centroid one-class learning framework for speech deepfake detection. Unlike the conventional one-class learning that assumes a single centroid can represent the bona fide subspace, QAMO introduces multiple centroids, each associated with a distinct speech quality level. These centroids are optimized through a quality-level classification objective, where quality level labels are obtained by grouping the given MOS into discrete levels. Hence, QAMO explicitly encodes quality information into the bona fide representation, preserving intra-class variability while maintaining discriminability. Furthermore, QAMO does not require quality labels during inference since it computes the prediction score by ensembling distances across all quality-aware centroids. Extensive experiments show that QAMO significantly improves performance over baselines in diverse SDD benchmarks. 2 Methodology Figure 1 : Illustration of the single-centroid OC-Softmax and our proposed QAMO for one-class learning This section introduces the proposed Quality-Aware Multi-Centroid One-Class Learning (QAMO) framework for speech deepfake detection. Figure 1 provides an overview of QAMO in comparison with the single-centroid one-class model, OC-Softmax [ 4 ] . In OC-Softmax, bona fide embeddings are pulled toward a single centroid and separates spoof embeddings with margin boundaries. In contrast, QAMO uses multiple centroids, each corresponding to a distinct bona fide quality level, to capture intra-class variation in the bona fide speech representation. Unlike the earlier multi-centroid one-class model SAMO [ 6 ] , which organizes embeddings by speaker identity, QAMO structures them by speech quality levels. Quality labels can be easily obtained from a speech assessment model, whereas speaker identity is often unavailable or restricted due to privacy concerns. QAMO learns discriminative quality-aware centroids through a classification objective. In contrast, SAMO constructs centroids by averaging embeddings from the same speaker, which risks the centroids collapse into a single point since they lack explicit classification supervision. 2.1 Quality-Aware Multi-Centroid modeling To capture the quality level of input utterances, QAMO first assigns a discrete quality level to each training bona fide example based on the speech quality represented by the MOS value. The MOS for each utterance, can be obtained from an MOS predictor [ 10 ] . The MOS values are then thresholded to form Q discrete quality classes. In this study, we partition the MOS range into Q=\{0,1\} levels, denotes low (low MOS) and high (high MOS) quality, respectively as: q_{i}=\begin{cases}0,&\text{if}\ \mathrm{MOS}(x_{i})<\tau\\ 1,&\text{if}\ \mathrm{MOS}(x_{i})\geq\tau\end{cases} (1) where \tau is a predetermined threshold and q_{i} denotes the quality level label for utterance x_{i} . In QAMO, each bona fide centroid of the multi-centroid is a learnable embedding \mathbf{w}_{q}\in\mathbb{R}^{D} associated with a quality level q\in Q . These centroids are trained exclusively on bona fide embeddings with the corresponding quality level. To ensure that the multi-centroid embeddings are discriminative and aligned with its corresponding quality level, we employ the AM-Softmax loss [ 11 ] for quality classification: \mathcal{L}_{\text{quality}}=-\frac{1}{\mathcal{B}}\sum_{i=1}^{\mathcal{B}}\log\frac{e^{s\cdot\left(\mathbf{w}_{q_{i}}^{\top}\hat{\mathbf{x}}_{i}-m\right)}}{e^{s\cdot\left(\mathbf{w}_{q_{i}}^{T}\hat{\mathbf{x}}_{i}-m\right)}+\sum_{j\neq q_{i}}e^{s\mathbf{w}_{j}^{T}\hat{\mathbf{x}}_{i}}} (2) where \mathcal{B} indexes bona fide samples, q_{i} is the quality level for the i -th sample, \hat{\mathbf{x}}_{i} denotes the normalized embedding of utterance i , m is the additive margin, and s is a scale factor. 2.2 Quality-Aware Multi-Centroid One-Class learning QAMO extends the single-centroid OC-Softmax loss [ 4 ] to multiple centroids that accounts for different speech quality levels. For a bona fide input, the cosine similarity distance is computed with respect to the centroid q of their quality level. For a spoof input, the maximum cosine similarity across all centroids is penalized to ensure separation from the bona fide. Let y_{i} denote the detection class ( 1 for spoof, 0 for bona fide), the similarity distance is defined as: d_{i}=\begin{cases}\mathbf{w}_{q_{i}}^{\top}\hat{\mathbf{x}}_{i},&\text{if}\ y_{i}=0\\ \max\limits_{q}\left(\mathbf{w}_{q}^{\top}\hat{\mathbf{x}}_{i}\right),&\text{if}\ y_{i}=1\end{cases} (3) The QAMO loss is then formulated as: \mathcal{L}_{\text{QAMO}}=\frac{1}{N}\sum_{i=1}^{N}\log(1+e^{\alpha(m_{y_{i}}-d_{i})(-1)^{y_{i}}}) (4) where \alpha is a scaling factor, m_{0} and m_{1} are the margins for bona fide and spoof classes, and N is the mini-batch size. The final training objective combines the proposed quality-aware multi-centroid one-class loss (Eq. 4 ) with the quality classification (Eq. 2 ) : \mathcal{L}=\mathcal{L}_{\text{QAMO}}+\lambda\mathcal{L}_{\text{quality}} (5) where \lambda is a weight hyperparameter. 2.3 Inference with QAMO At inference, QAMO produces a countermeasure (CM) score by computing the similarity distance d_{i} between the input utterances x_{i} and the learned centroids \mathbf{w}_{q} . If the quality label q is available, the score is simply the similarity to its corresponding centroid, providing a direct quality-aware decision. However, this requires an automatic MOS predictor to estimate quality, which raises computational cost in real-life deployment. To avoid this, QAMO can operate without