CTC-DID: CTC-Based Arabic dialect identification for streaming applications
Muhammad Umar Farooq, Oscar Saz · 2026
Read CTC-DID: CTC-Based Arabic dialect identification for streaming applications by Muhammad Umar Farooq, Oscar Saz (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-12199.txt.
Introduction
Muhammad Umar Farooq and Oscar Saz identify Arabic dialects in streaming speech with a method drawn from speech recognition. Their tool, CTC-DID, treats dialect tags as a label sequence for each utterance. That is the same trick CTC loss uses for words in ASR.
Dialect calls in a stream must be fast and firm as speech runs. A limited label set keeps the task lean. Good dialect tags help route speech to the right ASR and language tools. The work tests this CTC frame for that job. A stream tool must keep pace with live speech input.
Catalog record
| CREATOR | Muhammad Umar Farooq, Oscar Saz |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-12199
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CTC-DID: CTC-Based Arabic dialect identification for streaming applications Muhammad Umar Farooq, Oscar Saz Abstract This paper proposes a Dialect Identification (DID) approach inspired by the Connectionist Temporal Classification (CTC) loss function as used in Automatic Speech Recognition (ASR). CTC-DID frames the dialect identification task as a limited-vocabulary ASR system, where dialect tags are treated as a sequence of labels for a given utterance. For training, the repetition of dialect tags in transcriptions is estimated either using a proposed Language-Agnostic Heuristic (LAH) approach or a pre-trained ASR model. The method is evaluated on the low-resource Arabic Dialect Identification (ADI) task, with experimental results demonstrating that an SSL-based CTC-DID model, trained on a limited dataset, outperforms both fine-tuned Whisper and ECAPA-TDNN models. Notably, CTC-DID also surpasses these models in zero-shot evaluation on the Casablanca dataset. The proposed approach is found to be more robust to shorter utterances and is shown to be easily adaptable for streaming, real-time applications, with minimal performance degradation. † † address: Emotech Ltd., UK 1 Introduction Dialect IDentification (DID) is a related task to Language IDentification (LID) [ 8 ] , where the goal is to identify different dialects of the same language with nuanced phonological, lexical and grammatical differences [ 16 ] . For languages with multiple dialectal variants, this poses a significant challenge for tasks such as Automatic Speech Recognition (ASR), Machine Translation (MT) or Spoken Dialogue Systems (SDS). Dialect, language, and speaker identification are often formulated as analogous modelling problems within the speech processing domain. Prior studies [ 7 , 9 ] have predominantly employed x-vectors [ 13 ] and ECAPA-TDNN [ 2 ] models to address these tasks. The x-vector framework extracts fixed-dimensional utterance-level embeddings by aggregating variable-length frame-level acoustic features through TDNN blocks. ECAPA-TDNN extends this approach by incorporating channel-dependent attention mechanisms and residual connections, thereby generating more robust and discriminative utterance-level representations. More recently, the large-scale end-to-end Whisper model [ 11 ] has incorporated language identification as an explicit training objective. In contrast to x-vectors and ECAPA-TDNN, Whisper employs a transformer-based sequence-to-sequence architecture trained on massively multilingual speech corpora. As a result, its LID performance emerges from joint optimisation across speech recognition, translation, and language identification, enabling it to leverage both acoustic and linguistic information rather than relying solely on aggregated speaker embeddings. In previous work Whisper models have successfully been fine-tuned for the DID task [ 3 ] . However, the larger versions of Whisper are computationally very expensive to fine-tune and run, making it less suitable for low-resource scenarios, while smaller Whisper models show performance degradation. Previous studies have investigated the application of self-supervised learning (SSL) models for language and speaker identification tasks [ 10 , 4 ] . However, these approaches typically utilise SSL models either as feature extractors for downstream LID models [ 1 ] or use pooled representations from SSL encoders to obtain utterance-level information prior to label prediction [ 4 ] . Given the limitations of prior approaches, we propose an ASR-inspired training paradigm using the Connectionist Temporal Classification (CTC) function. While the framework can be extended to both speaker, language or dialect identification, we focus on the Arabic Dialect Identification (ADI) task for empirical validation. ADI has recently attracted significant attention, as Arabic is a widely spoken language across the Middle East and North Africa, characterised by substantial dialectal variation. Considerable efforts have been devoted to developing resources in this domain, including annotated datasets and benchmark systems for dialect identification. In contrast to conventional models that produce an utterance-level prediction, we propose an SSL-based ADI system trained to produce labels as the utterance progresses. Specifically, repeated dialect tags are employed as transcriptions for speech utterances, where the number of repetitions is determined either automatically via ASR or heuristically. With this approach, we propose the following improvements over existing approaches: • Fully suitable for streaming applications, as it is not reliant on full utterances to make a prediction. • Able to handle multi-speaker or code-switching scenarios, as it produces multiple labels within a single utterance. • Improved performance in shorter utterances, as it is less reliant on longer contexts to produce label predictions. The empirical results presented in Section 4 demonstrate that CTC-DID models outperform both Whisper-medium and ECAPA-TDNN models on the ADI-17 evaluation test set, despite being trained with very limited data. Additionally, CTC-DID models achieve superior performance compared to Whisper-medium in a zero-shot evaluation on the Casablanca test set. Specifically, an mHuBERT-based CTC-DID model (119M parameters) outperforms the Whisper-medium model (769M parameters) by an absolute F1-score margin of 4.66%. Furthermore, the results indicate that CTC-DID models exhibit greater robustness to shorter utterances. A causal streaming implementation is also presented, which demonstrates that CTC-DID models can be effectively deployed in real-time streaming scenarios, providing enhanced performance for streaming applications. 2 CTC-based dialect identification system In this work, we propose a self-supervised learning (SSL) based approach for dialect identification (DID), drawing inspiration from automatic speech recognition (ASR) model training paradigms. Unlike traditional DID methods that treat dialect prediction as a single-label classification task per utterance, our method predicts dialect tokens continuously across the temporal dimension of the speech signal. This aligns more closely with the token-level prediction strategy used in ASR. To train such a model, we emulate the ASR training setup where, instead of transcribing spoken words, we repeat the dialect label for each word in the utterance. The model is trained using the Connectionist Temporal Classification (CTC) loss [ 6 ] function. Formally, given an input feature sequence \mathbf{X}=(\mathbf{x}_{1},\dots,\mathbf{x}_{T}) , and a target sequence \mathbf{Y}=(y_{1},\dots,y_{L}) , where each y_{i} corresponds to the dialect tag, the CTC loss enables the model to learn an alignment between the repeated dialect tags and the input sequence. The flow diagram of the proposed approach is presented in Figure 1 . During inference, the input utterance is decoded using the same procedure as in automatic speech recognition (ASR) models. Following the decoding step, a simple post-processing stage is applied, wherein the most frequently occurring dialect token in the decoded sequence is selected as the final dialect prediction for the utterance. A key challenge in this formulation is determining the appropriate number of repetitions of the dialect tag, i.e., the length L of the target sequence for a given utterance. A naive yet effective approach is to estimate the number of spoken words in the utterance, and repeat the dialect token accordingly. This can be done using an off-the-shelf ASR system to count the number of words. While the accuracy of this ASR is not critical, reliance on it constrains the applicability of the method to languages supported by that ASR. Figure 1 : Flow of the proposed dialect identification approach. The components within the shaded grey box represent modules that can either be frozen or fine-tuned during training. The green box highlights the inference pipeline. To address this limitation, we propose a lightweight and language-agnostic heuristic (LAH) for estimating the number of words. Specifically, we pass the input audio through the Silero Voice Activity Detection (VAD) [ 15 ] model to obtain the total speech duration d (in seconds). Empirical results show that assuming an average speech rate of 5 words per second ( w=5d ) yields strong performance.