AiMNLP at BHASHA Task 1 IndicGEC: “When Data is Scarce, Prompt Smarter”… Approaches to Grammatical Error Correction in Low-Resource Settings
Somsubhra De, Harsh Kumar, Arun Prakash A · 2025
Read AiMNLP at BHASHA Task 1 IndicGEC: “When Data is Scarce, Prompt Smarter”… Approaches to Grammatical Error Correction in Low-Resource Settings by Somsubhra De, Harsh Kumar, Arun Prakash A (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-20120.txt.
Introduction
De, Kumar, and Prakash fix grammar in Indic languages by prompting smartly. Their 2025 paper reports the AiMNLP entry to BHASHA Task 1. Grammatical error correction thrives for English with big datasets. Indic languages lack annotated correction corpora at scale. Their morphology and scripts complicate the task further.
The team prompted large models instead of training new ones. Leading GPT, Gemini, and LLaMA models were tested with few-shot examples. Even zero-shot prompting beat fine-tuned Indic models. Sarvam-22B, a specialist model, was outperformed clearly. The shared task covered five Indic languages. Their entry ranked first in Tamil and Hindi. GLEU scores topped ninety-one for Tamil corrections. Hindi scored nearly eighty-six on the same metric. Telugu placed second overall in the rankings. Bangla and Malayalam placed fourth and fifth respectively. A LoRA-tuned Sarvam model handled Hindi in parallel. Prompting bridged the resource gap impressively.
Catalog record
| CREATOR | Somsubhra De, Harsh Kumar, Arun Prakash A |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-20120
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AiMNLP at BHASHA Task 1 IndicGEC: “When Data is Scarce, Prompt Smarter”… Approaches to Grammatical Error Correction in Low-Resource Settings Somsubhra De, Harsh Kumar, Arun Prakash A Abstract Grammatical error correction (GEC) is an important task in Natural Language Processing that aims to automatically detect and correct grammatical mistakes in text. While recent advances in transformer-based models and large annotated datasets have greatly improved GEC performance for high-resource languages such as English, the progress has not extended equally. For most Indic languages, GEC remains a challenging task due to limited resources, linguistic diversity and complex morphology. In this work, we explore prompting-based approaches using state-of-the-art large language models (LLMs), such as GPT-4.1, Gemini-2.5 and LLaMA-4, combined with few-shot strategy to adapt them to low-resource settings. We observe that even basic prompting strategies, such as zero-shot and few-shot approaches, enable these LLMs to substantially outperform fine-tuned Indic-language models like Sarvam-22B, thereby illustrating the exceptional multilingual generalization capabilities of contemporary LLMs for GEC. Our experiments show that carefully designed prompts and lightweight adaptation significantly enhance correction quality across multiple Indic languages. We achieved leading results in the shared task–ranking 1st in Tamil (GLEU: 91.57) and Hindi (GLEU: 85.69), 2nd in Telugu (GLEU: 85.22), 4th in Bangla (GLEU: 92.86), and 5th in Malayalam (GLEU: 92.97) . These findings highlight the effectiveness of prompt-driven NLP techniques and underscore the potential of large-scale LLMs to bridge resource gaps in multilingual GEC. 1 Introduction Grammar forms the foundation of any language– it plays a fundamental role in ensuring clarity, fluency and precision in written communication. In Natural Language Processing (NLP), improving the grammatical quality of written text has become an important research focus, leading to the development of Grammatical Error Correction (GEC) systems. At the sentence level, a GEC system takes a potentially erroneous sentence as input and aims to generate a corrected version that is fluent, accurate and semantically faithful to the original. In practice, this involves detecting and correcting different kinds of errors such as spelling mistakes, punctuation issues, grammatical inconsistencies, issues related to verb usage (correct conjugation, tense, aspect, agreement with the subject), gender and pronoun agreement errors, as well as inappropriate word choices. The scope of GEC extends beyond simple grammar checking - it encompasses the broader goal of making a sentence more natural and comprehensible while preserving its intended meaning. Despite its apparent simplicity, defining what constitutes ‘grammatical correctness’ is not straightforward! Grammaticality can be subjective and context-dependent, especially in languages with diverse dialects, flexible word order or rich morphology. For Indic languages such as Tamil, Malayalam, Hindi, Bangla, and Telugu, that we work on, this complexity is even more pronounced. These languages exhibit significant variation in syntax, inflection and script, which makes the task of automatic correction far more challenging than in English or other high-resource languages. Furthermore, the scarcity of large annotated corpora, standardized benchmarks and robust evaluation metrics adds to the difficulty of developing effective GEC systems for Indic languages. In recent years, transformer-based models and large language models (LLMs) have shown impressive results for sentence-level GEC in English and other major languages 15 ; 13 . However, extending these advances to Indic languages requires adapting such models to low-resource settings and accounting for linguistic diversity. We explore prompting-based approaches, designing carefully crafted instructions to guide LLMs (GPT-4 and Gemini) towards effective correction. This work explores how prompt-driven and lightweight fine-tuning techniques can enhance sentence-level GEC for multiple Indic languages. We aim to show that, with thoughtful design and adaptation, modern LLMs can effectively handle the unique challenges of multilingual error correction and help bridge the resource gap between high and low-resource languages. 1 1 1 Codes and data can be found at https://github.com/somsubhra04/BHASHA2025 2 Related work Early research on Machine Translation (MT) laid much of the groundwork for sentence-level transformation tasks like GEC. Traditional rule-based and statistical MT models focused on translating between languages by learning alignment patterns between source and target sentences. These approaches, though effective in specific domains, were often limited by their reliance on handcrafted rules and parallel corpora. The advent of Neural Machine Translation (NMT) fundamentally changed the landscape of text generation and correction tasks. Sequence-to-sequence architectures with attention mechanisms 3 ; 11 enabled models to learn contextual dependencies more effectively, producing fluent and coherent outputs. Subsequent developments introduced Transformer-based models 16 , which achieved significant performance improvements across both MT and GEC. Pre-trained language models such as BERT 7 , RoBERTa 10 and T5 12 further advanced GEC research by providing strong contextual representations. These models have been fine-tuned for grammatical correction tasks, achieving promising results on benchmarks like CoNLL-2014 and BEA-2019. Parallel to model innovations, researchers also focused on data augmentation and noise generation strategies to address the scarcity of large-scale annotated corpora. Synthetic error generation 2 –by introducing artificial grammatical mistakes into clean corpora-proved effective for pre-training and domain adaptation, particularly in low-resource settings. Such approaches allowed models to generalize better to real-world learner errors while mitigating overfitting to limited gold-standard data. More recently, multilingual and low-resource GEC have gained attention, driven by the growing need to support diverse languages beyond English. Approaches leveraging multilingual transformers such as mBERT and XLM-R 6 have shown promise for languages with limited annotated data. 3 Dataset We utilize the multilingual datasets from the Workshop on Benchmarks, Harmonization, Annotation and Standardization for Human-Centric AI in Indian Languages (BHASHA) . The dataset covers five major Indian languages - Tamil (Tam) , Malayalam (Mal) , Hindi (Hi) , Bengali (Bn) and Telugu (Tel) . Each language dataset consists of parallel sentence pairs designed for the GEC task. Each instance contains two columns: Input sentence : a sentence (erroneous) containing one or more grammatical, spelling or lexical errors and Output sentence : the corresponding grammatically correct version produced by human annotators. (refer to Fig 1 for examples) The datasets were created by asking native speakers of the respective languages to write essays on given topics in an exam-like setting, after which language experts manually corrected the errors to produce the gold-standard outputs. The overall data distribution across languages is presented in Table 1 . Tam Mal Hi Bn Tel Train 91 300 599 598 599 Dev 16 50 107 101 100 Test 65 102 236 330 310 Total 172 452 942 1029 1009 Table 1: Dataset statistics for Indic-GEC tasks. Each sample is a pair of erroneous and corrected sentences. Figure 1: Examples from the GEC task dataset. Input sentence ✗ (with errors in red ) - ground truth ✓ (with corrections in blue ) pairs. Error types have been mentioned, based on our understanding. 4 Methodology The Indic-GEC task is formulated as a sequence-to-sequence transformation problem, where a potentially erroneous sentence x=(x_{1},x_{2},\ldots,x_{n}) in an Indic language is mapped to its grammatically corrected version y=(y_{1},y_{2},\ldots,y_{m}) . The objective of the model is to estimate the conditional probability distribution P_{\theta}(y|x) , parameterized by \theta , that maximizes the likelihood of the correct output sequence: \hat{y}=\arg\max_{y}P_{\theta}(y|x) (1) 4.1 Problem Formulation Given a parallel corpus D=\{(x^{(i)},y^{(i)})\}_{i=1}^{N} , where x^{(i)} is a noisy input sentence and y^{(i)} is its grammatically corrected counterpart, the model is trained to minimize the negative log-likelihood (NLL) of the target sequence conditioned on the input: \mathcal{L}_{\text{GEC}}(\theta)=-\sum_{i=1}^{N}\sum_{t=1}^{|y^{(i)}|}\log