The Arabic Generality Score: Another Dimension of Modeling Arabic Dialectness

Sanad Shaban, Nizar Habash · 2025

Read The Arabic Generality Score: Another Dimension of Modeling Arabic Dialectness by Sanad Shaban, Nizar Habash (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-17347.txt.

Introduction

Shaban and Habash proposed a new score for Arabic dialects in twenty twenty-five. Arabic varies widely by region, yet computer models often treat each dialect as a fixed box. A recent measure grades how dialectal a text is, but it squeezes rich variation into one number.

Their Arabic Generality Score instead grades how widely a word is used across dialects. They built a pipeline that aligns words across texts, measures spelling distance with respect for word origins, and smooths the results. A model then learns to predict the score for words in context. It beat strong existing systems on a multi-dialect test set. The authors offer the score as a grounded way to enrich how models represent Arabic.

Catalog record

CREATORSanad Shaban, Nizar Habash
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-17347

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Arabic Generality Score: Another Dimension of Modeling Arabic Dialectness Sanad Shaban, Nizar Habash Abstract Arabic dialects form a diverse continuum, yet NLP models often treat them as discrete categories. Recent work addresses this issue by modeling dialectness as a continuous variable, notably through the Arabic Level of Dialectness (ALDi). However, ALDi reduces complex variation to a single dimension. We propose a complementary measure: the Arabic Generality Score (AGS), which quantifies how widely a word is used across dialects. We introduce a pipeline that combines word alignment, etymology-aware edit distance, and smoothing to annotate a parallel corpus with word-level AGS. A regression model is then trained to predict AGS in context. Our approach outperforms strong baselines, including state-of-the-art dialect ID systems, on a multi-dialect benchmark. AGS offers a scalable, linguistically grounded way to model lexical generality, enriching representations of Arabic dialectness. \setcode utf8 \vocalize 1 Introduction Arabic exhibits a well-known case of diglossia: Modern Standard Arabic (MSA) functions as the high variety in formal settings, while a range of Dialectal Arabic (DA) varieties are used in everyday communication Ferguson 1959 . These dialects differ significantly from MSA, and from each other, in vocabulary, phonology, morphology, and syntax, often resulting in limited mutual intelligibility. And rather than forming discrete categories, they exist on a continuum. Token-level dissimilarity between MSA and dialects ranges from 37% to 67% Salameh et al. 2018 , and speakers frequently blend MSA and DA depending on context and background Badawi 1973 ; Badawi and Hinds 1986 ; Iriarte Diez et al. 2023 . Dialects themselves also share features and borrow from other languages, such as French and English Hamed et al. 2020 . Figure 1: Different MSA and DA words and their CAPHI phonology representation, with varying generality and dialectness levels; all mean ‘(a) little (bit).’ Most computational models still frame dialect identification (DID) as a fixed-label classification task Zaidan and Callison-Burch 2014 ; Salameh et al. 2018 ; Abdul-Mageed et al. 2020 ; Abdul-Mageed et al. 2021 ; Abdul-Mageed et al. 2022 ; Abdul-Mageed et al. 2023 , overlooking intra-dialect variation and cross-dialectal overlap. More recent approaches, like ALDi Keleg et al. 2023 , model dialectness as a continuous scalar, but reduce diverse signals to a single dimension. We propose the Arabic Generality Score (AGS), a complementary dimension to ALDi that captures how broadly a word is used across dialects. Figure 1 illustrates how AGS enables distinctions between widely shared and highly localized dialectal items, even when both diverge from MSA. Together, ALDi and AGS define a two-dimensional space for modeling Arabic dialectness. We introduce a novel pipeline to annotate a parallel dialect corpus with word-level AGS, combining alignment, etymology- and phonology-aware edit distance, and smoothing. We then fine-tune a BERT-based regression model to predict AGS in context. Evaluation on multi-dialect data shows that our model outperforms strong baselines and captures lexical generality more effectively. 2 Related Work 2.1 Arabic Dialect Identification Arabic dialect identification (DID) has traditionally been treated as a single-label classification task, assigning each text a discrete dialect label such as Egyptian, Levantine, or Gulf Arabic, or Modern Standard Arabic (MSA) Zaidan and Callison-Burch 2014 . Later work introduced finer-grained setups, including city-level classification with the MADAR-26 corpus Bouamor et al. 2018 ; Salameh et al. 2018 . However, such approaches assume dialectal boundaries are clean, despite evidence of overlap and mutual influence among varieties. Recent work highlights the limitations of discrete labeling. Texts often exhibit features from multiple dialects and MSA, especially in social media. Error analyses show that many supposed misclassifications are linguistically plausible alternatives Keleg and Magdy 2023 ; Olsen et al. 2023 , motivating multi-label and continuous approaches. The Arabic Level of Dialectness (ALDi) framework Keleg et al. 2023 , for instance, models dialectness on a continuous scale rather than as a hard class boundary. This shift is also evident in shared tasks. The NADI series evolved from strict classification in 2020 to multi-label and continuous subtasks by 2024 Abdul-Mageed et al. 2020 ; Abdul-Mageed et al. 2021 ; Abdul-Mageed et al. 2024 , including tasks for ALDi estimation. These developments reflect a growing consensus: effective DID must account for the fluid, gradient nature of Arabic dialects, paving the way for multidimensional frameworks such as ours. 2.2 Dialectness Dialectness refers to how much a text diverges from Modern Standard Arabic (MSA) and exhibits features of Dialectal Arabic (DA). Sociolinguistically, Badawi’s five-level model Badawi 1973 captures this as a continuum from Classical Arabic to purely colloquial speech. It reflects how speakers shift registers based on context and education. Computationally, early approaches measured dialectness using word frequency ratios in DA versus MSA corpora Zaidan and Callison-Burch 2014 ; Sajjad et al. 2020 . Later work introduced more detailed annotation schemes labeling tokens and segments by their deviation from MSA, incorporating orthographic, morphological, and lexical cues Habash et al. 2008 . While accurate, these methods are labor-intensive and require expert annotators. Crowdsourced alternatives, such as the Arabic Online Commentary (AOC) corpus Zaidan and Callison-Burch 2011 , used coarser labels (e.g., “Little” or “Mostly Dialectal”) but lacked consistent guidelines. Building on these efforts, the Arabic Level of Dialectness (ALDi) framework Keleg et al. 2023 introduced continuous sentence-level scores based on averaged crowd annotations. A regression model (Sentence-ALDi) fine-tuned on MarBERT predicts these scores on a 0 to 1 scale. ALDi captures a fine-grained, replicable measure of dialectal divergence. However, it remains a single-axis metric and may conflate different types of variation, such as geographically localized versus widely used forms. To address this limitation, we introduce the Arabic Generality Score (AGS), a complementary axis that captures how widely a word is used across dialects, independent of its divergence from MSA. AGS allows us to distinguish between regionally specific and broadly shared dialectal forms, information that ALDi alone cannot provide. Together, AGS and ALDi define a two-dimensional space of variation, offering a richer and more interpretable model of the Arabic dialect continuum. 3 Linguistic Background 3.1 Rich Morphology and Noisy Orthography Arabic presents significant NLP challenges due to its rich morphology and highly inconsistent orthography, especially in dialects. Root-and-pattern morphology, combined with affixes and clitics, leads to high sparsity, while the lack of diacritics increases ambiguity. Dialects further complicate processing with informal spelling: a single word may appear in over 25+ forms Eskander et al. 2013 ; Alhafni et al. 2024 ; Habash et al. 2018b . In the absence of standardized conventions, spelling choices vary based on pronunciation and etymology. Writers may opt for phonetic spellings that reflect local speech or etymological ones that preserve MSA roots; sometimes these align, but often they diverge. For instance, consider the word for ‘heart’, \< قلب> qlb 1 1 1 HSB Arabic transliteration Habash et al. 2007 . /qalb/ in MSA. It is pronounced /2alb/ in Beirut, replacing the /q/ with a glottal stop /2/. A person from Beirut may choose to spell it phonetically as \< ألب> Âlb , or etymologically, as \< قلب> qlb . 3.2 CODA and CAPHI We adopt a normalization framework designed to reduce surface variation and enhance cross-dialect comparability Habash et al. 2018b . The Conventional Orthography for Dialectal Arabic ( CODA ) defines a consistent spelling system for dialects using

Read the complete text