AfriNLLB: Efficient Translation Models for African Languages Equal contribution

Yasmin Moslem, Aman Kassahun Wassie, Amanuel Gizachew Abebe · 2026

Read AfriNLLB: Efficient Translation Models for African Languages Equal contribution by Yasmin Moslem, Aman Kassahun Wassie, Amanuel Gizachew Abebe (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-09373.txt.

Introduction

Translation tools still serve African languages poorly, and heavy models fit badly on the modest devices many users own. Yasmin Moslem and two co-authors present AfriNLLB, a 2026 family of lightweight translation models for African languages in both directions. The suite covers fifteen language pairs, thirty directions in all, from Swahili and Hausa to Zulu, Lingala, Wolof, and Egyptian Arabic, plus wider official languages.

Training spans English paired with thirteen languages and French paired with two more. The models start from a six-hundred-million-parameter base, then shrink through iterative layer pruning and quantization, with fine-tuning on curated parallel texts and distillation from a larger teacher. Performance matches the baseline while running far faster. Two versions are released, one for further fine-tuning and one for fast inference, along with the training data.

Catalog record

CREATORYasmin Moslem, Aman Kassahun Wassie, Amanuel Gizachew Abebe
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-09373

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AfriNLLB: Efficient Translation Models for African Languages Equal contribution Yasmin Moslem, Aman Kassahun Wassie, Amanuel Gizachew Abebe Abstract In this work, we present AfriNLLB, a series of lightweight models for efficient translation from and into African languages. AfriNLLB supports 15 language pairs (30 translation directions), including Swahili, Hausa, Yoruba, Amharic, Somali, Zulu, Lingala, Afrikaans, Wolof, and Egyptian Arabic, as well as other African Union official languages such as Arabic (MSA), French, Portuguese, and Spanish. Our training data covers bidirectional translation between English and 13 languages, and between French and two languages (Lingala and Wolof). AfriNLLB models are based on NLLB-200 600M, which we compress using iterative layer pruning and quantization. We fine-tune the pruned models on parallel corpora we curated for African languages, employing knowledge distillation from a larger teacher model. Our work aims at enabling efficient deployment of translation models for African languages in resource-constrained settings. Our evaluation results demonstrate that AfriNLLB models achieve performance comparable to the baseline while being significantly faster. We release two versions of the AfriNLLB models, a Transformers version that allows further fine-tuning and a CTranslate2 version for efficient inference. Moreover, we release all the training data that we used for fine-tuning the baseline and pruned models to facilitate further research. Family Subfamily Name Code Regions Afro-Asiatic Chadic Hausa hau_Latn West Africa (Nigeria, Niger) Cushitic Somali som_Latn Horn of Africa (Somalia, Ethiopia, Djibouti, Kenya) Semitic Amharic amh_Ethi Horn of Africa (Ethiopia) Semitic Egyptian Arabic arz_Arab North Africa (Egypt) Indo-European Germanic Afrikaans afr_Latn Southern Africa (South Africa, Namibia) Niger-Congo Atlantic Wolof wol_Latn West Africa (Senegal, Gambia, Mauritania) Bantu Lingala lin_Latn Central Africa (Congo) Bantu Swahili swh_Latn East Africa (Tanzania, Kenya) Bantu Zulu zul_Latn Southern Africa (South Africa) Volta-Niger Yoruba yor_Latn West Africa (Nigeria, Benin) Table 1: African Languages in AfriNLLB Family Subfamily Name Code Regions Afro-Asiatic Semitic Arabic, Modern Standard arb_Arab North Africa (formal use) Indo-European Germanic English eng_Latn Southern Africa (South Africa) Romance French fra_Latn Africa-wide (mostly L2) Romance Portuguese por_Latn Southern Africa (Angola, Mozambique) Romance Spanish spa_Latn Central Africa (Equatorial Guinea) Table 2: Non-Native Languages in AfriNLLB 1 AfriNLLB: Background & Motivation Africa is a linguistically rich continent, with over 2,000 native languages 23 ; 24 . Although African languages have millions of native speakers, most of them are low-resource languages 10 ; 48 ; 5 ; 19 ; 34 . This results in a scarcity of African datasets and models for diverse natural language processing tasks, including machine translation (MT). Since MT resources for African languages are scattered across multiple sources, gathering these resources for fine-tuning open-source models is costly and time-consuming. Moreover, providing translation support for speakers of these low-resource languages in governmental and health sectors remains a significant challenge 9 ; 47 . AfriNLLB seeks to bridge this gap by delivering efficient translation models and curated training data. 1 1 1 https://github.com/AfriNLP/AfriNLLB , 2 2 2 https://hf.co/collections/AfriNLP/afrinllb Language selection for AfriNLLB considered several factors, including the number of native speakers in Africa and dataset availability. The AfriNLLB models are based on NLLB-200 14 , and support 15 language pairs (30 translation directions), including 10 native African languages: Swahili, Hausa, Yoruba, Amharic, Somali, Zulu, Lingala, Afrikaans, Wolof, and Egyptian Arabic (cf. Table 1 ). Additionally, we include 5 of the official languages of the African Union, namely Arabic (MSA), English, French, Portuguese, and Spanish. Since several African languages share some lexicon with these languages due to historical contact, multilingual models can leverage this linguistic overlap through transfer learning from high-resource languages to enhance the performance of low-resource languages 31 ; 18 . AfriNLLB is a series of efficient multilingual open-source models for African languages, motivated by multiple goals: • Gathering and curating bilingual training datasets for African languages • Building lightweight MT models specialized in translating African languages, utilizing compression approaches such as pruning and quantization • Open-sourcing the code, training data, and models we have created • Sharing our approaches and lessons learned to facilitate future work in this area 2 Data We employ multi-stage fine-tuning before and after model pruning. First, we fine-tune the baseline NLLB-200 600M to improve the performance for African languages. Afterwards, we fine-tune the pruned models again to restore the translation performance. For this purpose, we collect datasets primarily in African languages (Swahili, Hausa, Yoruba, Amharic, Somali, Zulu, Lingala, Afrikaans, Wolof, and Egyptian Arabic) and a few relevant high-resource languages (Arabic (MSA), French, Spanish, Portuguese). 2.1 Data Sources We mainly collect the datasets from OPUS 44 and Hugging Face 30 , with additional data from GitHub and other publicly available online sources. This results in a total of 1.2M samples for 11 African language pairs (9 from/into English, and 2 from/into French). For high-resource languages (Arabic, French, Spanish, Portuguese), we focus on collecting only 1.5M for processing, filter the data, and then sample 200k from each language pair for training. Table 3 summarizes data before and after filtering, while Table 6 elaborates on data sources. 2.2 Data Processing To ensure the quality of data, we process the datasets in a four-stage pipeline: (i) rule-based filtering, (ii) language detection, (iii) semantic filtering, and (iv) quality estimation. While rule-based filtering uses predefined rules, the other pipeline stages employ a model to generate scores and filter the data based on a threshold. We experimented with different threshold values and found 0.6 to be a reasonable choice. Rule-based filtering involves deduplication, dropping empty segments, and removing HTML tags. We also filter out sentence pairs with lengths less than 3 or greater than 200 characters. Moreover, to avoid misaligned segments, we remove translation pairs exceeding the 2x source-target length ratio. Language detection discards segments that are unlikely to be in the expected language. We use two language detector models, AfroLID 2 for the African languages and fastText 26 for the rest of the languages. Semantic filtering evaluates the translation pairs with cosine similarity scores derived from sentence embedding models, using the Sentence-Transformers library 40 . To handle all the languages, we employ different embedding models based on language support. We use DistilUSE 41 ; 50 for all high-resource language pairs and LaBSE 21 for African languages. We apply semantic filtering for all languages except Lingala as we could not find an embedding model that supports it. Quality estimation is the final stage of the filtering pipeline, in which we apply reference-free evaluation of the translation and exclude segments that are lower than the threshold. We use COMET 39 for high-resource language pairs, and Masakhane’s model AfriCOMET-QE-STL 46 for African languages. After thoroughly processing the dataset, we merge the datasets and deduplicate the combined dataset to avoid repetition from different sources. We ended up with a total of 6.4M. However, to mitigate data imbalance, we downsampled the high-resource languages to only 200k per language pair. This results in a total of 1.6M samples (3.2M bidirectional samples, after reversing the dataset), which we use for training. The dataset size for each language direction is presented in Table 3 , and elaborated in Table 6 . 2.3 Validation and Test Data We use Flores200 3 3 3 https://hf.co/datasets/facebook/flores 14 for validation and test, as it covers all the languages in our experiments. We use the dev split (997 segments) of Flores200 for validation

Read the complete text