A Survey of Code-switched Arabic NLP: Progress, Challenges, and Future Directions
Injy Hamed, Caroline Sabty, Slim Abdennadher, Ngoc Thang Vu, Thamar Solorio, Nizar Habash · 2025
Read A Survey of Code-switched Arabic NLP: Progress, Challenges, and Future Directions by Injy Hamed, Caroline Sabty, Slim Abdennadher, Ngoc Thang Vu, Thamar Solorio, Nizar Habash (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-13419.txt.
Introduction
Injy Hamed, Caroline Sabty, Slim Abdennadher, Ngoc Thang Vu, Thamar Solorio, and Nizar Habash survey natural language processing for code-switched Arabic. The Arab world mixes Modern Standard Arabic, many dialects, and European languages in daily speech and writing. That mix makes code-switching common, both inside Arabic and between Arabic and foreign tongues. Language tools must handle this reality to serve the region well.
The survey reviews the current literature on code-switched Arabic NLP in broad form. It maps ongoing efforts, open challenges, and research gaps across the field. The authors close with recommendations for future research directions.
Catalog record
| CREATOR | Injy Hamed, Caroline Sabty, Slim Abdennadher, Ngoc Thang Vu, Thamar Solorio, Nizar Habash |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-13419
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Survey of Code-switched Arabic NLP: Progress, Challenges, and Future Directions Injy Hamed, Caroline Sabty, Slim Abdennadher, Ngoc Thang Vu, Thamar Solorio, Nizar Habash Abstract Language in the Arab world presents a complex diglossic and multilingual setting, involving the use of Modern Standard Arabic, various dialects and sub-dialects, as well as multiple European languages. This diverse linguistic landscape has given rise to code-switching, both within Arabic varieties and between Arabic and foreign languages. The widespread occurrence of code-switching across the region makes it vital to address these linguistic needs when developing language technologies. In this paper, we provide a review of the current literature in the field of code-switched Arabic NLP, offering a broad perspective on ongoing efforts, challenges, research gaps, and recommendations for future research directions. 1 Introduction Code-switching (CSW), the act of alternating between multiple languages in the same discourse, is a common linguistic phenomenon in multilingual societies, including Arab countries. With CSW’s global prevalence, it has become essential to equip language technologies to effectively handle it to build inclusive and user-friendly tools that cater to the needs of multilingual communities. While there exist several survey papers on CSW Çetinoğlu et al. (2016) ; Sitaram et al. (2019) ; Doğruöz et al. (2021) ; Winata et al. (2023) , this paper narrows the focus to the Arabic language, offering more in-depth knowledge and insights for this specific language setup. We provide this review, discussing current literature, challenges, and research gaps, with the aim of guiding future research and accelerating progress in this area. The paper is organized as follows: § 2 provides an overview on the linguistic landscape in the Arab world and historical factors giving rise to CSW; § 3 discusses the types of CSW; § 4 describes the paper categorization process; § 5 presents overall statistics on the current literature in CSW Arabic NLP; § 6 and § 7 give further insights into the efforts on data collection, modeling, and guidelines and annotation tools that are useful in the context of CSW; and § 8 suggests future research directions. CSW Type Example Inter-sentential I need to prepare for it. \set@arabfont .بيرق ناحتمإ يدنع انأ \arab@strut I have an exam coming up. I need to prepare for it. Extra-sentential \set@arabfont . \arab@strut \set@arabfont اركب عورشملا ىلع لغتشاه \arab@strut Okay Okay I’ll work on the project tomorrow. Intra-sentential is in the field of computer vision \set@arabfont يعاتب عورشملا \arab@strut My project is in the field of computer vision. Morphological CSW before the deadline \set@arabfont هدراهنلا \arab@strut models+ \set@arabfont لا \arab@strut evaluate+ \set@arabfont ن مزال \arab@strut We have to evaluate the models today before the deadline. Table 1 : Examples of different CSW types followed by their English translation. The originally Arabic phrases are italicized in the English translation. 2 Language in the Arab World Historical events have long influenced the patterns of CSW between Arabic and other languages. During the 7th and 8th centuries, the Islamic conquests brought Arabic into extensive contact with several languages, including Persian Khan et al. (2011) and Spanish Thomas and Sayahi (2019) , leading to profound linguistic exchanges. Later, from the 16th until the early 20th century, Turkish and Arabic intermingled during the Ottoman Empire, leaving lasting imprints on both languages. Afterwards, during the 19th and 20th centuries, several Arab countries were impacted by the spread of European colonialism across the region. According to Duranti (2008) and Cotterell et al. (2014) , colonization played a main role in shaping the language in the region, where the local languages were overlain by European languages. These events and cultural interactions led to linguistic exchanges, giving rise to CSW between Arabic and numerous languages. In contemporary times, globalization and international businesses and education have further intensified this phenomenon, with Arabic speakers increasingly using English and other languages in social and professional settings. Besides code-switching to foreign languages, with Arabic being a diglossic language ( Ferguson, 1959 ) , Arabs also switch between formal Arabic and dialects. The formal Arabic variant, Modern Standard Arabic (MSA), serves as a lingua franca across Arab countries and is typically used in formal contexts. Dialects (and sub-dialects), belonging to each country, are used in everyday conversations and informal writings. This gives rise to two main types of CSW in the region: (1) CSW between MSA and dialects, and (2) CSW between Arabic and foreign languages. Following Adouane et al. (2018a) , we refer to the former type as diglossic code-switching and the latter as bilingual code-switching. Bilingual CSW is seen across the region, including Arabic-English in Egypt ( Abu-Melhim, 1991 ) , Jordan ( Mustafa and Al-Khatib, 1994 ) , Palestine Mkahal (2016) , Saudi Arabia ( Omar and Ilyas, 2018 ) , and UAE ( Khuwaileh, 2003 ) . A high level of multilingualism, with the mixing of Arabic, English, and French, is found in Morocco ( Samih and Maier, 2016a ) , Algeria ( Baya Essayahi and Kerras, 2016 ) , Lebanon ( Bacha and Bahous, 2011 ) , and Tunisia ( Baoueb, 2009 ) . While Arabic CSW occurs with a wide range of languages, we restrict the scope of this paper to those so far addressed within the field of computational linguistics. We also restrict our scope to CSW language alternation, excluding studies looking into the origin of words in languages influenced by others, such as the investigation presented in Micallef et al. (2024) for Maltese. 3 Types of Code-switching According to Poplack (1980) , there are three main types of CSW: inter-sentential, extra-sentential, and intra-sentential. In the case of morphologically rich languages, morphological code-switching ( Stefanich et al., 2019 ) also occurs. We elaborate on each type below, providing examples in Table 1 : • Inter-sentential CSW involves switching of languages on the sentence-level. • Extra-sentential CSW (or tag-switching ) involves using tag elements from another language such as fillers, interjections, tags, and idiomatic expressions. • Intra-sentential CSW involves word-level switching, where CSW segments must conform to the syntactic rules of both languages. • Morphological CSW (or intra-word CSW ) involves switching on the morpheme-level. Given that Arabic is a morphologically rich language, Arabic-speakers attach Arabic clitics and affixes to foreign words. Another type of language alternation is referred to as borrowing , where loanwords are embedded into sentences without the need for grammatical considerations. According to Poplack (1980) , borrowing is not considered as a type of CSW. Myers-Scotton (1997) , however, considers any embedded segment from the secondary language as a case of CSW. Given that automatically identifying whether an embedded word is a case of borrowing or CSW is a challenging task, the majority of the surveyed efforts in this paper consider any presence of foreign tokens as CSW. Within the scope of the paper, CSW is used to refer to all the mentioned types of language alternation, including borrowing. Category Options Language Pairs MSA-DA, MSA-Foreign, DA-Foreign, Arabic-Foreign, MSA-DA-Foreign Venues Conference, Workshop, Symposium, Book, Journal, ArXiv, Thesis Methods Rule/Linguistic Constraint, Statistical Model, Neural Network, Pre-trained Model NLP Tasks Text: Word-level Language Identification, Sentence-level Language Identification, CSW Point Prediction, Dialectness Level Estimation, Dependency Parsing, Fake News Detection, Humor Detection, Humor Generation, Emotion Detection, Language Modeling, Lemmatization, Machine Translation, Micro-Dialect Identification, Named Entity Recognition, Natural