YoNER: A New Yorùbá Multi-domain Named Entity Recognition Dataset
2026
Read YoNER: A New Yorùbá Multi-domain Named Entity Recognition Dataset (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-05624.txt.
Introduction
Falola and five colleagues build YoNER, a multi-domain Yorùbá named-entity dataset of about 5,000 sentences and 100,000 tokens across Bible, blogs, movies, radio, and Wikipedia. Three native speakers annotated persons, organizations, and locations with agreement above 0.70. African-centered models beat general multilingual ones, but cross-domain scores fall sharply, and the team releases YoNER plus a new OyoBERT model.
Catalog record
| YEAR | 2026 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36280 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.05624
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
YoNER: A New Yorùbá Multi-domain Named Entity Recognition Dataset Abstract Named Entity Recognition (NER) is a foundational NLP task, yet research in Yorùbá has been constrained by limited and domain-specific resources. Existing resources, such as MasakhaNER (a manually annotated news-domain corpus) and WikiAnn (automatically created from Wikipedia), are valuable but restricted in domain coverage. To address this gap, we present YoNER, a new multidomain Yorùbá NER dataset that extends entity coverage beyond news and Wikipedia. The dataset comprises about 5,000 sentences and 100,000 tokens collected from five domains including Bible, Blogs, Movies, Radio broadcast and Wikipedia, and annotated with three entity types: Person (PER), Organization (ORG) and Location (LOC), following CoNLL-style guidelines. Annotation was conducted manually by three native Yorùbá speakers, with an inter-annotator agreement of over 0.70, ensuring high quality and consistency. We benchmark several transformer encoder models using cross-domain experiments with MasakhaNER 2.0, and we also assess the effect of few-shot in-domain data using YoNER and cross-lingual setups with English datasets. Our results show that African-centric models outperform general multilingual models for Yorùbá, but cross-domain performance drops substantially, particularly for blogs and movie domains. Furthermore, we observed that closely related formal domains, such as news and Wikipedia, transfer more effectively. In addition, we introduce a new Yorùbá-specific language model (OyoBERT) that outperforms multilingual models in in-domain evaluation. We publicly release the YoNER dataset and pretrained OyoBERT models to support future research on Yorùbá natural language processing. Keywords: Named Entity Recognition, Low-resource Language, African NLP, Multidomain NER, Yorùbá YoNER: A New Yorùbá Multi-domain Named Entity Recognition Dataset Peace Busola Falola 1 , Jesujoba O. Alabi 2 , Solomon O. Akinola 1 , Folashade T. Ogunajo 3 , Emmanuel Oluwadunsin Alabi 1 , David Ifeoluwa Adelani 5 1 University of Ibadan, Nigeria, 2 Saarland University, Germany, 3 Atiba University, Nigeria, 5 Mila - Quebec AI Institute, McGill University, and Canada CIFAR AI Chair [email protected], [email protected] Abstract content 1. Introduction Named Entity Recognition (NER) is a foundational NLP task that identifies and classifies named entities (e.g. personal name, organizations, locations) in text with several applications in information extraction, question answering, and speech recognition ( Tjong Kim Sang and De Meulder 2003 ; Yamada et al. 2020 ; Caubrière et al. 2020 ) . To enable broad applicability, NER models are developed for diverse domains ( Weischedel et al. 2011 ) , and techniques to facilitate faster adaptation across multiple domains remain an active area of research ( Yang and Katiyar 2020 ; Das et al. 2022b ; Ashok and Lipton 2023 ; Xue et al. 2024 ; Huang et al. 2025 ) . While there are several multi-domain datasets available for high-resource languages such as English, they are often lacking for low-resource languages, where existing datasets are typically limited to Wikipedia or news domains ( Palen-Michel et al. 2024 ) . For low-resource languages such as Yorùbá, spoken by over 50 million people in Nigeria and neighboring African countries, NER is crucial for information extraction and also play an important function of recognizing African names and cultural concepts which are often unrecognized by current AI systems ( Olatunji et al. 2023 ) . Recently, there have been some efforts to create human-annotated NER datasets for Yorùbá but they are mostly in the “ news ” domain ( Alabi et al. 2020 ; Adelani et al. 2021 ; Adelani et al. 2022 ) . Outside news , the other available data is WikiANN based on Wikipedia, however, the annotations are automatically created and only 100 test samples and few entities. In this paper, we develop the first multi-domain Yorùbá NER dataset known as YoNER . YoNER covers five distinct domains including: Bible , Blogs , Movies , Radio broadcast, and Wikipedia . Each domain has between 800 and 1400 sentences collected from various sources by a Yorùbá native speaker. We then recruited three native speakers for the annotation and quality control. Leveraging YoNER , we attempt to answer the following research questions: (1) How well does News NER data transfer to diverse domains? (2) How well can small in-domain data e.g. 200 sentences improve domain transfer? (3) Does monolingual BERT models enhance multi-domain transfer compared to multilingual BERT models in low-resource setting? To answer the third question, we pre-trained a new Yorùbá BERT model ( Oyo-BERT ) and compare the performance to African-centric BERT models such as AfroXLMR Alabi et al. 2022 . Finally, we extend this evaluation to English language to see if the same result holds true, by comparing English RoBERTa-Large with XLM-Roberta-Large. Our evaluation shows adapting NER model to other domains is quite challenging especially for the Blog and Movie domain, often with fewer entities. The best adaptation was from News to Wikipedia . Moreover, adapting from Yorùbá News domain achieved better performance than English CoNLL NER data with almost twice of its training data, this shows that both source language and closeness of source domains to target are equally important. We obtained a better adaptation by combining the small in-domain data from all sources and the News domain to achieve the most impressive results. While the newly developed OyoBERT seem to achieve better performance than AfroXLMR, it does not seem to achieve better cross-domain transfer results. 1 1 1 We release YoNER publicly on Hugging Face . 2 2 2 We release OyoBERT models publicly: YoBERT-base , OyoBERT-base , OyoBERT-large . Domain Yorùbá Sentence Bible Àwọn ọmọkùnrin Simeoni , Jemueli , Jamini , Ohadi , Jakini , Sohari , Saulu , tí ìyá rẹ jẹ́ ọmọbìnrin ará Kenaani . Blog Ipò obinrin kò pin si idi àdìrò àti inú ilé yòkù gẹ́gẹ́ bi Olórí Òṣèlú Nigeria , Muhammadu Buhari ti sọ. Movie Wòó Àṣàké , jẹ́ ká nasẹ̀ lọ, ká lọ gba’tẹ́gùn díẹ̀. Radio Ìràwọ̀ agbábọọ̀lù tìnú ẹgbẹ́ ìkọ Liverpool Salah nló tí ńlérí wí pé ẹgbẹ́ agbábọọ̀lù náà yóò gba ìfẹ ẹ̀yẹ ní sáà tó ńbọ̀. Wikipedia Òun ló gba àmì ẹ̀yẹ PEN Pinter Prize ní ọdún 2018 Iléẹ̀kọ́ sẹ́kọ́ndìrì Yunifásítì ti Naijiria , Nsukka ni Adichie ti parí ẹ̀kọ́ sẹ́kọ́ndìrì rẹ̀ níbi tí ó ti ọ̀pọ̀lọpọ̀ àmì ẹ̀yẹ ajemọ́ akadá. Table 1 : Examples of named entities across sentences from different Yorùbá domains in YoNER. ( PER , ORG , LOC ). 2. Related Work NER for low-resource languages has recently gained growing attention as the development of multilingual models such as mBERT ( Devlin et al. 2019 ) and XLM-R ( Conneau et al. 2020 ) has enabled effective transfer learning across languages. Traditional NER systems relied heavily on large annotated datasets, which are scarce for most low-resource languages. Multilingual pre-trained language models have helped bridge this gap by transferring knowledge from high-resource languages to creating competitive models in zero and few-shot setting ( Zhao et al. 2021 ; Adelani et al. 2021 ; Schmidt et al. 2022 ) . This progress has opened new opportunities for languages that were previously under-served in NLP research. In the African context with several low-resource languages, significant progress has been achieved through community-driven initiatives aimed at building foundational datasets and benchmarks. The first effort was by Alabi et al. 2020 that developed Yorùbá NER data based on Global Voices news articles, with 26K tokens. The MasakhaNER project (MasakhaNER