Ibom NLP: A Step Toward Inclusive Natural Language Processing for Nigeria’s Minority Languages

Oluwadara Kalejaiye, Luel Hagos Beyene, David Ifeoluwa Adelani, Mmekut-Mfon Gabriel Edet, Aniefon Daniel Akpan, Eno-Abasi Urua, Anietie Andy · 2025

Read Ibom NLP: A Step Toward Inclusive Natural Language Processing for Nigeria’s Minority Languages by Oluwadara Kalejaiye, Luel Hagos Beyene, David Ifeoluwa Adelani, Mmekut-Mfon Gabriel Edet, Aniefon Daniel Akpan, Eno-Abasi Urua, Anietie Andy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-06531.txt.

Introduction

Oluwadara Kalejaiye and co-authors bring four coastal Nigerian languages into language technology for the first time. Nigeria speaks more than five hundred languages, yet research concentrates on just four major ones, largely because text data for the rest barely exists. Anaang, Efik, Ibibio, and Oro appear in no major translation system or benchmark.

The ibom dataset extends a standard translation benchmark to those four languages and aligns the texts with topic labels from a classification benchmark. Tests show current large models translate these languages poorly with no examples and with only a few. Extra examples did steadily improve topic classification, charting a first path toward inclusive tools for Nigeria's minority languages.

Catalog record

CREATOROluwadara Kalejaiye, Luel Hagos Beyene, David Ifeoluwa Adelani, Mmekut-Mfon Gabriel Edet, Aniefon Daniel Akpan, Eno-Abasi Urua, Anietie Andy
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-06531

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Ibom NLP: A Step Toward Inclusive Natural Language Processing for Nigeria’s Minority Languages Oluwadara Kalejaiye, Luel Hagos Beyene, David Ifeoluwa Adelani, Mmekut-Mfon Gabriel Edet, Aniefon Daniel Akpan, Eno-Abasi Urua, Anietie Andy Abstract Nigeria is the most populous country in Africa with a population of more than 200 million people. More than 500 languages are spoken in Nigeria and it is one of the most linguistically diverse countries in the world. Despite this, natural language processing (NLP) research has mostly focused on the following four languages: Hausa, Igbo, Nigerian-Pidgin, and Yorùbá (i.e < < 1% of the languages spoken in Nigeria). This is in part due to the unavailability of textual data in these languages to train and apply NLP algorithms. In this work, we introduce Ibom —a dataset for machine translation and topic classification in four Coastal Nigerian languages from the Akwa Ibom State region: Anaang, Efik, Ibibio, and Oro. These languages are not represented in Google Translate or in major benchmarks such as Flores-200 or SIB-200. We focus on extending Flores-200 benchmark to these languages, and further align the translated texts with topic labels based on SIB-200 classification dataset. Our evaluation shows that current LLMs perform poorly on machine translation for these languages in both zero-and-few shot settings. However, we find the few-shot samples to steadily improve topic classification with more shots. 1 Introduction Significant progress has been made towards developing and applying Natural Language Processing (NLP) and Machine Learning (ML) algorithms for translating textual data for low resource African languages 24 ; 29 ; 6 ; 2 . However, so far, these NLP and ML algorithms have been applied to only a few low-resource African languages. This is in part due to the unavailability of textual data in some of these languages ( 3 ) . Some African languages are not written; instead, they are orally passed down from one generation to the next, and they are not part of the educational system in their respective countries. The languages that receive attention are typically the most widely spoken, official or national languages ( 9 ) , which largely coincide with the top 50 African languages included in massively multilingual datasets 28 ; 15 ; 5 . Colonialism is in part responsible for the exclusion of these languages from the educational system. 1 1 1 hhttps://www.goethe.de/prj/zei/en/art/22902448.html In the colonial times, only a few languages were encouraged in the educational system in the colonized countries; thereby ensuring that these languages were considered prestigious in comparison to other languages. Even when the colonized countries became independent, this practice was maintained in the respective countries. This has led to the endangerment and near extinction of some of these languages. Nigeria is the most populous African country, with a population of more than 200 million people 2 2 2 https://datacommons.org/place/country/NGA . There are more than 500 languages spoken in Nigeria 3 3 3 www.ethnologue.com , making Nigeria one of the most linguistically diverse countries in the world 4 4 4 https://www.weforum.org/stories/2023/04/worlds-most-multilingual-countries/ . Despite the large number of languages spoken in Nigeria, very few of these languages have received sufficient attention as it relates to documentation and description. Nigerian languages are classified as either (a) "major" / "majority" or (b) "minor" / "minority". The "majority" languages are Hausa, Yoruba, and Igbo. These majority languages have been taught in schools for decades and have significantly been documented; however, in comparison, the "minority" languages have received scant attention, and little has been documented in these languages. Figure 1: Map showing the regions where the IBOM languages are spoken in Nigeria including Anaang, Efik, Ibibo, and Oro. The languages are native to the South-South region of Nigeria, primarily spoken in the Akwa-Ibom state painted in Green. This work introduces Ibom —a new dataset consisting of two major NLP tasks (machine translation and topic classification) for four “ minority ” languages (Anaang, Efik, Ibibio, and Oro) in Nigeria by extending the massively multilingual Flores-200 28 and SIB-200 5 datasets. Our evaluation shows that current LLMs perform poorly on machine translation for these languages in both zero-and-few shot settings. We find that leveraging cross-lingual transfer from M2M-100 18 on religious parallel texts and a related language (Efik) improves performance for the other languages. On topic classification, we find that few-shot prompting steadily improve topic classification performance, and even exceed performance of supervised fine-tuning baseline with AfroXLMR 11 . Specifically, this work makes the following contributions: (A) We develop Ibom -MT, a collection of translated sentences from English Flores-200 dataset to four low resource Nigerian languages (i.e. Ibibio, Efik, Anaang, and Oro) that are not represented on Google translate. To our knowledge, this is the first parallel language resource created for Anaang and Oro languages, respectively. (B) We develop Ibom -TC, a topic classification dataset created by aligning Ibom -MT and SIB-200 topic labels. (C) We apply several fine-tuned baselines and LLM prompting for machine translation and topic classification on these introduced benchmarks. (D) We release the datasets from this work and make it available to the research community. 5 5 5 https://huggingface.co/collections/howard-nlp/ibom-nlp 2 Related Works African machine translation data Flores evaluation datasets 20 ; 28 have emerged as critical resources in several low-resource languages. Beyond the large scale evaluation datasets, there have been several community-driven data collection for Nigerian languages including: MENYO-20k for Yorùbá 8 , Igbo-English MT 17 , MAFAND-MT 2 for Hausa and Nigerian-Pidgin, NollySenti 36 —a translated benchmark for movie sentiment, and IrokoBench 7 —a translated benchmark for knowledge QA, natural language inference and math reasoning. The last two benchmarks only cover Hausa, Igbo, Yorùbá and Nigerian-Pidgin. Initiatives like the WMT Shared Task have also played an important role in boosting the evaluation of MT on African languages 4 . Available Ibom languages data In the under-studied languages, only Efik has some available bilingual and monolingual data. JW300 ( 10 ) —a multilingual parallel corpus based on Jehovah Witness publications contains over 331K parallel sentences with English. Other parallel resources includes SMOL ( 12 ) , and Gatitos dictionary ( 22 ) . Aside bitexts, some monolingual data exists in large filtered Common Crawl data such as GlotCC ( 23 ) and FineWeb-2 ( 33 ) but they often smaller in size. 3 Ibom languages characteristics 3.1 Geographical information The Ibibio, Efik, Anaang, and Oro languages are predominantly spoken in Akwa Ibom State in the South-South geopolitical region of Nigeria. Figure 1 shows the map of the regions in Akwa Ibom State, Nigeria, where these four languages are spoken. This map indicates the indigenous languages of each Local Government Area in Akwa Ibom State. Ibibio, Anaang, and Oro are shown to be the major languages in Akwa Ibom State as observed by the number of Local Government Areas where the languages are indicated as indigenous languages. In addition, Efik is mainly spoken in the Local Government Areas of Akwa Ibom State which border the Cross River State. The following is information about each of these languages. Ibibio The Ibibio language is primarily spoken in Akwa Ibom State and in some Local Government Areas in Cross River State, in Nigeria. Ibibio serves as the lingua franca of Akwa Ibom State and is spoken as a first language

Read the complete text