NCTB-QA: A Large-Scale Bangla Educational Question Answering Dataset and Benchmarking Performance
Abrar Eyasir, Tahsin AhmedMuhammad Ibrahim Department of Computer Science and EngineeringUniversity of Dhaka {eyasir2047, tahsin030602}@gmail.com, [email protected] · 2026
Read NCTB-QA: A Large-Scale Bangla Educational Question Answering Dataset and Benchmarking Performance by Abrar Eyasir, Tahsin AhmedMuhammad Ibrahim Department of Computer Science and EngineeringUniversity of Dhaka {eyasir2047, tahsin030602}@gmail.com, [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-05462.txt.
Introduction
Eyasir and colleagues build NCTB-QA from 50 school textbooks issued by Bangladesh's National Curriculum and Textbook Board, yielding 87,805 Bangla question-answer pairs. Reading comprehension systems for low-resource languages often answer unreliably when the correct answer is absent from context. The dataset keeps a balanced mix of answerable and unanswerable questions, plus adversarial items with plausible distractors, and fine-tuning lifts BERT by 313% in relative F1 score.
Catalog record
| CREATOR | Abrar Eyasir, Tahsin AhmedMuhammad Ibrahim Department of Computer Science and EngineeringUniversity of Dhaka {eyasir2047, tahsin030602}@gmail.com, [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33130 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.05462
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
NCTB-QA: A Large-Scale Bangla Educational Question Answering Dataset and Benchmarking Performance Abrar Eyasir, Tahsin AhmedMuhammad Ibrahim Department of Computer Science and EngineeringUniversity of Dhaka {eyasir2047, tahsin030602}@gmail.com, [email protected] Abstract Reading comprehension systems for low-resource languages face significant challenges in handling unanswerable questions. These systems tend to produce unreliable responses when correct answers are absent from context. To solve this problem, we introduce NCTB-QA, a large-scale Bangla question answering dataset comprising 87,805 question-answer pairs extracted from 50 textbooks published by Bangladesh’s National Curriculum and Textbook Board. Unlike existing Bangla datasets, NCTB-QA maintains a balanced distribution of answerable (57.25%) and unanswerable (42.75%) questions. NCTB-QA also includes adversarially designed instances containing plausible distractors. We benchmark three transformer-based models (BERT, RoBERTa, ELECTRA) and demonstrate substantial improvements through fine-tuning. BERT achieves 313% relative improvement in F1 score (0.150 to 0.620). Semantic answer quality measured by BERTScore also increases significantly across all models. Our results establish NCTB-QA as a challenging benchmark for Bangla educational question answering. This study demonstrates that domain-specific fine-tuning is critical for robust performance in low-resource settings. 1 Introduction Question answering (QA) systems have made strong progress in high-resource languages, largely due to the availability of large datasets such as SQuAD ( 9 ) , SQuAD 2.0 ( 8 ) , HotpotQA ( 13 ) , and Natural Questions ( 5 ) . In contrast, low-resource languages remain underexplored, even though they are spoken by a large share of the world’s population. Bangla, the seventh most spoken language with over 230 million speakers, is a clear example. Existing Bangla QA datasets are limited in size and coverage. These datasets show little emphasis on educational content or unanswerable questions. For real-world use, QA systems must also know when a question cannot be answered from the given context. 8 demonstrates that models trained only on answerable questions often respond with high confidence even when the required information is missing. This hallucination behaviour of models results in producing fluent but incorrect answers. This issue is quite serious in educational settings. Incorrect responses can confuse learners and reduce trust in automated systems. Most existing Bangla QA datasets are small in scale. They typically contain between 3,000 ( 4 ) and 14,889 ( 3 ) question–answer pairs, which is not sufficient for training robust transformer-based models. Second, although TigerLLM ( 7 ) is considerably larger, containing nearly 10 million tokens collected from 163 textbooks for grades 6–12, it does not include unanswerable questions. This limits its usefulness for evaluating a model’s ability to abstain from hallucinated responses. Third, BanglaRQA ( 3 ) includes only a small number of factoid-style unanswerable questions and lacks adversarially constructed cases. More broadly, many existing Bangla QA datasets focus predominantly on factoid questions. These questions restrict linguistic diversity and limit deeper reasoning-based evaluation. To address these limitations, we introduce NCTB-QA, a large-scale Bangla question answering dataset designed specifically for educational use. The dataset contains 87,805 question–answer pairs collected from 50 textbooks published by Bangladesh’s National Curriculum and Textbook Board (NCTB), covering grades 1 through 10. NCTB-QA maintains a balanced distribution of answerable and unanswerable questions. NCTB-QA also introduces unanswerable instances adversarially designed to include plausible distractors. The adversarial questions force the model to understand genuine contextual reasoning. By sourcing all content directly from official NCTB materials, the dataset remains closely aligned with real educational curricula. 2 Related Work 2.1 English Question Answering The Stanford Question Answering Dataset (SQuAD) introduces more than 100,000 crowd-written questions based on Wikipedia articles ( 9 ) and establishes extractive reading comprehension as a central benchmark for NLP research. However, SQuAD contains only answerable questions, which often lead models to produce plausible but fabricated answers when no correct response is present in the context. To address this limitation, 8 introduces unanswerable questions in the SQuAD 2.0 dataset. These additions force models to learn when to refrain from answering. The dataset comprises 130,319 examples, including 43,498 unanswerable questions. This results in a more balanced evaluation setting. 2.2 Bangla Question Answering Bangla QA research has improved gradually; however, available datasets remain small and limited in scope. An early work, Multiple BERT Models for Bangla Questions in NCTB Textbooks, introduces approximately 3,000 human-annotated question–answer pairs ( 4 ) . However, it includes only answerable questions and remains limited in size. BanglaRQA represents a significant step forward for Bangla question answering. It contains 3,000 passages and 14,889 QA pairs, including both answerable and unanswerable questions ( 3 ) . Among these, 11,258 are answerable and 3,631 are unanswerable. Transformer-based models such as mBERT, BanglaBERT, mT5, and BanglaT5 are evaluated, achieving a best performance of 62.42% Exact Match and 78.11% F1. However, the imbalance between answerable and unanswerable questions (approximately 3:1) limits the dataset’s effectiveness for robust answerability detection. TigerLLM focuses on language modeling using 10 million tokens from NCTB textbooks but does not include unanswerable questions ( 7 ) . More recently, the BEnQA benchmark introduces approximately 5,161 Bangla–English exam questions from school science subjects ( 10 ) . It includes both factual and reasoning questions. This study finds that models perform worse in Bangla than in English. Overall, existing Bangla QA datasets lack sufficient scale, domain focus, and balanced answerable and unanswerable examples, highlighting a clear gap in Bangla QA resources. Table 1 compares NCTB-QA with previous datasets. Dataset QA Pairs Contexts Answerable Unanswerable Domain NCTB-QA (Ours) 87,805 10,070 50,270 (57.25%) 37,535 (42.75%) Educational TigerLLM ( 7 ) 10M tokens 163 textbooks 100% 0% Educational BanglaRQA ( 3 ) 14,889 3,000 11,258 (75.6%) 3,631 (24.4%) General BEnQA ( 10 ) 5,161 – 100% 0% Educational NCTB( 4 ) 3,000 – 3,000 (100%) 0% Educational BanglaQA ( 11 ) 178,012 15,997 articles 142,181 (79.87%) 35,831 (20.13%) News Table 1: Comparison of NCTB-QA with existing Bangla question–answering datasets. NCTB-QA uniquely combines large-scale, educational domain specificity, and a relatively balanced distribution of answerable and unanswerable questions. 3 NCTB-QA 3.1 Dataset Construction Textbooks for grades 1--10 were collected from the official website of the National Curriculum and Textbook Board (NCTB) 1 1 1 https://nctb.gov.bd/site/page/934d6561-1fb4-466c-a0e9-330b748098e6 . To ensure reproducibility and consistency, the collection process was fully automated using a web-scraping pipeline rather than manual downloading. We iterated through class-wise textbook listings and extracted subject-specific book entries. Downloaded files were stored in a hierarchical directory structure organized by class. We enforced short delays between requests to avoid server overload. Duplicate textbooks were automatically detected and removed. This ensures that each textbook appeared exactly once in the corpus. The final dataset consists of 50 unique textbooks. These textbooks cover a wide range of academic subjects, including language arts, science, and social studies. They serve as the primary source material for downstream content extraction and QA generation. 3.2 Content Extraction All textbooks were processed in their text-based Markdown format. Before QA generation, we applied a multi-stage content extraction and cleaning pipeline to transform raw Markdown files into high-quality contextual segments suitable for language model inference, as illustrated in Figure 1 . Figure 1: Overview of the content extraction and QA generation pipeline. Markdown textbooks are cleaned, segmented, and thematically grouped into coherent contexts, which are then processed by Gemini to generate structured QA pairs in JSON format. First, raw Markdown files were cleaned to remove non-instructional artifacts such as page numbers,