ANCHOLIK-NER: A Benchmark Dataset for Bangla Regional Named Entity Recognition
Bidyarthi Paul, Faika Fairuj Preotee, Shuvashis Sarker, Shamim Rahim Refat, Shifat Islam, Tashreef Muhammad, Mohammad Ashraful Hoque, Shahriar Manzoor · 2025
Read ANCHOLIK-NER: A Benchmark Dataset for Bangla Regional Named Entity Recognition by Bidyarthi Paul, Faika Fairuj Preotee, Shuvashis Sarker, Shamim Rahim Refat, Shifat Islam, Tashreef Muhammad, Mohammad Ashraful Hoque, Shahriar Manzoor (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-11198.txt.
Introduction
Paul and colleagues wrote in twenty twenty-five about a new benchmark data set for recognizing names in Bangla dialects. Named entity recognition finds people, places, and organizations in text. Standard Bangla tools exist, but regional dialects were ignored until now. Dialects like Barishal, Chittagong, and Sylhet differ enough to break standard models. Their ANCHOLIK-NER set holds over seventeen thousand sentences across five regions. Public sources plus manual translation built the aligned data.
Three transformer models were tested on the new benchmark. A multilingual BERT model performed best overall across regions. One region, Mymensingh, reached the highest recognition score. Chittagong proved hardest, with lower precision and recall. No prior system targeted Bangla dialects, so this is a foundation step. The authors plan to widen dialect coverage and lift weak-region scores.
Catalog record
| CREATOR | Bidyarthi Paul, Faika Fairuj Preotee, Shuvashis Sarker, Shamim Rahim Refat, Shifat Islam, Tashreef Muhammad, Mohammad Ashraful Hoque, Shahriar Manzoor |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-11198
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ANCHOLIK-NER: A Benchmark Dataset for Bangla Regional Named Entity Recognition Bidyarthi Paul, Faika Fairuj Preotee, Shuvashis Sarker, Shamim Rahim Refat, Shifat Islam, Tashreef Muhammad, Mohammad Ashraful Hoque, Shahriar Manzoor Abstract Named Entity Recognition (NER) in regional dialects is a critical yet underexplored area in Natural Language Processing (NLP), especially for low-resource languages like Bangla. While NER systems for Standard Bangla have made progress, no existing resources or models specifically address the challenge of regional dialects such as Barishal, Chittagong, Mymensingh, Noakhali, and Sylhet, which exhibit unique linguistic features that existing models fail to handle effectively. To fill this gap, we introduce ANCHOLIK-NER, the first benchmark dataset for NER in Bangla regional dialects, comprising 17,405 sentences distributed across five regions. The dataset was sourced from publicly available resources and supplemented with manual translations, ensuring alignment of named entities across dialects. We evaluate three transformer-based models—Bangla BERT, Bangla BERT Base, and BERT Base Multilingual Cased—on this dataset. Our findings demonstrate that BERT Base Multilingual Cased performs best in recognizing named entities across regions, with significant performance observed in Mymensingh with an F1-score of 82.611%. Despite strong overall performance, challenges remain in region like Chittagong, where the models show lower precision and recall. Since no previous NER systems for Bangla regional dialects exist, our work represents a foundational step in addressing this gap. Future work will focus on improving model performance in underperforming regions and expanding the dataset to include more dialects, enhancing the development of dialect-aware NER systems. August 24, 2026 K eywords Named Entity Recognition \cdot Low Resource Language \cdot Bangla Language \cdot Regional Dialects \cdot Natural Language Processing 1 Introduction Named Entity Recognition (NER) is a part of Information Extraction (IE) that focuses on identifying and classifying named entities in unstructured text – names of persons, organizations, locations, dates, numbers and other specific terms. By extracting entities, Named Entity Recognition (NER) transforms raw text into structured data, enabling tasks like information retrieval, question answering, and knowledge graph construction. NER was first introduced in the Sixth Message Understanding Conference (MUC-6) which emphasized extracting structured information from free-form natural language [ 1 ] . Standard entity types like Person, Organization and Location were defined in MUC-6 and later refined in MUC-7 with clearer annotation guidelines and evaluation metrics [ 2 ] . Multilingual adaptation efforts like The Conventions d’annotations en Entités Nommées-ESTER project addressed language specific annotation conventions [ 3 ] . Today NER is a foundation step in NLP pipelines supporting applications like machine translation, automatic summarization, topic detection and recommendation systems [ 4 ] . So NER is essential for systems that want to extract semantic meaning and support decision making in both academic and industrial NLP tasks. Figure 1: Regional NER examples along with Standard Bangla and English Initial approaches to the NER task were rule-based, relying on manually crafted lexicons, grammars and pattern-matching heuristics to extract entities from domain-specific corpora [ 5 , 6 , 7 ] . These systems were limited in scalability, language coverage and generalizability as they were dependent on domain knowledge and rigid linguistic rules. As the limitations of handcrafted systems became apparent—especially in adapting to different languages and sentence structures—researchers moved towards data-driven approaches. This led to the adoption of statistical and machine learning models that required annotated datasets but offered much better adaptability and inference capabilities. Among the earliest machine learning models used for NER were Hidden Markov Models (HMMs), which modelled sequences of labels with probabilistic transitions and emissions [ 8 , 9 ] . These were soon followed by more powerful models like Conditional Random Fields (CRFs) [ 10 , 11 ] which could capture both contextual features and label dependencies across sequences. In parallel, Maximum Entropy (ME) [ 12 ] and Maximum Entropy Markov Models (MEMMs) [ 13 ] were explored for their flexibility in incorporating different features. Support Vector Machines (SVMs) [ 14 , 15 ] were introduced as robust classifiers for NER, especially when combined with rich feature representations and kernel methods. To further improve performance, Ensemble Modeling techniques [ 16 , 17 ] were proposed, combining multiple learners to mitigate overfitting and improve generalization. With the increasing availability of annotated NER datasets across multiple languages, multilingual and cross-lingual models started to emerge [ 18 ] allowing knowledge transfer between related language families. The evolution of NER reached a new milestone with the rise of deep learning, especially recurrent neural networks (RNNs) and their variants like Long Short-Term Memory (LSTM) networks. These models could capture long-range dependencies in text and when combined with CRFs produced state-of-the-art results in sequence labelling tasks [ 19 ] . The introduction of Bi-directional LSTM-CRF architectures further improved entity recognition by leveraging both past and future context [ 20 ] . The most significant breakthrough came with the development of pre-trained transformer-based models like BERT and multilingual BERT (mBERT) [ 21 ] which enabled deep contextualized word embeddings and fine-tuning for downstream tasks including NER. Variants like RoBERTa [ 22 ] , and XLM-R [ 23 ] for low-resource and performance across languages. In recent years, NER esearch has continued to evolve rapidly. GLiNER [ 24 ] , a lightweight generative NER framework, outperformed ChatGPT in zero-shot evals and used way less memory. ToNER [ 25 ] , introduced type-oriented generation and showed great results in prompt-based NER. KoGNER [ 26 ] added knowledge graph distillation to transformer-based models and improved entity classification in biomedical NER. FewTopNER [ 27 ] proposed a few-shot, topic-aware method and improved cross-lingual generalization for low-resource NER. For noisy and informal data like social media, SEMFF-NER [ 28 ] used multi-scale feature fusion and syntactic information to handle irregular sentence structures better. Large Language Model Cooperative Communication (LLMCC) [ 29 ] tried cooperative learning between large language models for NER and got better extraction consistency through model coordination. Named Entity Recognition for All (NER4All) [ 30 ] addressed challenges in historical and multilingual corpora and introduced methods for adaptive entity recognition across genre and domain shifts. Multimodal NER [ 31 ] also made progress with Adaptive Mixup methods that fused image-text representations for better recognition in visually grounded contexts. These recent developments show NER is still going strong through interdisciplinarity and scalability. In recent years, a lot of progress has been made in Bangla Named Entity Recognition (NER) systems which is one of the most spoken yet under-resourced language in the world. Initial works used statistical models like Conditional Random Fields (CRFs) and Support Vector Machines (SVMs) with handcrafted features on small scale annotated corpora [ 32 ] . Later Bi-LSTM and Bi-LSTM-CRF were introduced which offered better contextual modeling and yielded better results [ 33 ] . With the rise of pre-trained language models, transformer based approaches like multilingual BERT (mBERT) and BanglaBERT were used for Bangla NER and further improved the results by fine-tuning on domain specific tasks [ 34 ] . Along with modeling techniques, several tools and resources were developed including BNLP toolkit [ 35 ] , BnNER and BNERCorpus [ 36 ] . Recently B-NER released one of the largest Bangla NER dataset to date along with benchmark evaluations [ 36 ] . Gazetteer-Enhanced improved the recognition performance by using K-Means infused