Curriculum Learning and Pseudo-Labeling Improve the Generalization of Multi-Label Arabic Dialect Identification Models

Ali Mekky, Mohamed El Zeftawy, Lara Hassan, Amr Keleg, Preslav Nakov · 2026

Read Curriculum Learning and Pseudo-Labeling Improve the Generalization of Multi-Label Arabic Dialect Identification Models by Ali Mekky, Mohamed El Zeftawy, Lara Hassan, Amr Keleg, Preslav Nakov (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-12937.txt.

Description

Arabic dialect identification has long been treated as choosing one label per sentence, but many sentences fit several dialects at once. Ali Mekky and four co-authors argue for multi-label framing and tackle the lack of multi-label training data. Analysing single-label models, they find the core problem is negative sampling: sentences marked negative for one dialect may be perfectly acceptable in others.

The team builds a multi-label dataset with automatic annotations from GPT-4o and binary acceptability classifiers, aggregated using the Arabic Level of Dialectness. A BERT-based classifier trained with curriculum learning keyed to dialectal complexity and label count then reaches 0.69 macro F1 on the multi-label leaderboard, up from 0.55 for the previous best system. Code and data are public, giving the field a realistic multi-label benchmark.

Catalog record

CREATORAli Mekky, Mohamed El Zeftawy, Lara Hassan, Amr Keleg, Preslav Nakov
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-12937

Browse the full library · About the Tower of Babel