Comparative Study of Zero-Shot Cross-Lingual Transfer for Bodo POS and NER Tagging Using Gemini 2.0 Flash Thinking Experimental Model
Sanjib Narzary, Bihung Brahma, Haradip Kumar Mahilary, Mahananda Brahma, Bidisha Som, Sukumar Nandi · 2025
Read Comparative Study of Zero-Shot Cross-Lingual Transfer for Bodo POS and NER Tagging Using Gemini 2.0 Flash Thinking Experimental Model by Sanjib Narzary, Bihung Brahma, Haradip Kumar Mahilary, Mahananda Brahma, Bidisha Som, Sukumar Nandi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-04405.txt.
Introduction
Sanjib Narzary and five co-authors test whether a big AI model can tag Bodo text without any Bodo training, in a 2025 arXiv paper. Bodo is a low-resource language of India, short on the labeled data that word tagging needs. Tagging names and word classes is basic plumbing for language tools. The team used Google's Gemini model to carry English tags across to Bodo in two ways.
One way translates a sentence, then moves the tags. The other prompts the model with paired English and Bodo lines and asks for the tags in place. The prompt way won, above all for name tagging. Translation slips and grammar gaps hurt both. The authors urge mixed plans, light fine-tuning, and building true Bodo resources next.
Catalog record
| CREATOR | Sanjib Narzary, Bihung Brahma, Haradip Kumar Mahilary, Mahananda Brahma, Bidisha Som, Sukumar Nandi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-04405
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Comparative Study of Zero-Shot Cross-Lingual Transfer for Bodo POS and NER Tagging Using Gemini 2.0 Flash Thinking Experimental Model Sanjib Narzary, Bihung Brahma, Haradip Kumar Mahilary, Mahananda Brahma, Bidisha Som, Sukumar Nandi Abstract Named Entity Recognition (NER) and Part-of-Speech (POS) tagging are critical tasks for Natural Language Processing (NLP), yet their availability for low-resource languages (LRLs) like Bodo remains limited. This article presents a comparative empirical study investigating the effectiveness of Google’s Gemini 2.0 Flash Thinking Experiment model for zero-shot cross-lingual transfer of POS and NER tagging to Bodo. We explore two distinct methodologies: (1) direct translation of English sentences to Bodo followed by tag transfer, and (2) prompt-based tag transfer on parallel English-Bodo sentence pairs. Both methods leverage the machine translation and cross-lingual understanding capabilities of Gemini 2.0 Flash Thinking Experiment to project English POS and NER annotations onto Bodo text in CONLL-2003 format. Our findings reveal the capabilities and limitations of each approach, demonstrating that while both methods show promise for bootstrapping Bodo NLP, prompt-based transfer exhibits superior performance, particularly for NER. We provide a detailed analysis of the results, highlighting the impact of translation quality, grammatical divergences, and the inherent challenges of zero-shot cross-lingual transfer. The article concludes by discussing future research directions, emphasizing the need for hybrid approaches, few-shot fine-tuning, and the development of dedicated Bodo NLP resources to achieve high-accuracy POS and NER tagging for this low-resource language. keywords Transfer Learning, Parts of Speech, Name Entity Recognition, Natural Language Processing, Low Resource Language, Bodo Language, Large Language Model Gemini † † equal-contributors: These authors contributed equally to this work. † † equal-contributors: These authors contributed equally to this work. † † equal-contributors: These authors contributed equally to this work. 1 Introduction and Motivation 1.1 The Significance of POS and NER Tagging in NLP Part-of-Speech (POS) tagging and Named Entity Recognition (NER) are fundamental tasks within the field of Natural Language Processing (NLP), serving as essential prerequisites for a multitude of downstream applications. POS tagging, the process of assigning grammatical categories to individual words within a sentence (e.g., noun, verb, adjective, adverb), provides crucial syntactic information that underpins higher-level language understanding. NER, on the contrary, focuses on identifying and classifying named entities – real-world objects that are designated with a proper name – into predefined semantic categories such as persons, organizations, locations, dates, times, and quantities ( Nadeau and Sekine, 2007 ; Wang et al., 2022 ) . The synergy of POS and NER tagging empowers a wide spectrum of NLP applications. In information extraction, NER helps to pinpoint key entities, while POS tags help to understand the relationships between these entities and other words in the text, facilitating the extraction of structured information from unstructured text ( Lample et al., 2016 ) . Machine translation systems benefit from POS tagging to improve syntactic analysis and word order prediction, and NER to ensure accurate translation of named entities in languages ( Vaswani et al., 2017 ) . Question-answer systems rely on both NER and POS to understand the question’s intent, identify relevant entities and relationships in the knowledge base, and formulate accurate answers. Text summarization algorithms leverage NER to identify salient entities and POS tags to preserve grammatical coherence and readability in summaries. The precision and robustness of these core NLP tasks directly impact the effectiveness of these downstream applications. 1.2 NLP Challenges for Low-Resource Languages: The Case of Bodo Despite the remarkable advances in NLP, there is a significant disparity between high-resource languages (HRLs) and low-resource languages (LRLs). Although HRLs, such as English, Spanish, French, and Mandarin, benefit from a wealth of annotated data, sophisticated NLP tools, and substantial research investment, LRLs lag considerably behind ( Joshi et al., 2020 ; Mager et al., 2018 ) . LRLs are characterized by a scarcity of digital resources, including annotated corpora, lexicons, grammars, and readily available NLP tools. This resource scarcity poses a significant bottleneck for developing NLP technologies for these languages, hindering their integration into the increasingly digital world. Bodo, a vibrant Tibeto-Burman language spoken by approximately 1.5 million people mainly in the Bodoland Territorial Region of Northeast India, serves as a representative example of an LRL facing NLP resource limitations ( Narzary et al., 2024 ) . Although Bodo has a rich linguistic tradition and growing online presence, it lacks the extensive NLP infrastructure available for more widely spoken languages. Although preliminary efforts have explored deep learning approaches for part-of-speech tagging ( Pathak et al., 2025 ) and named entity recognition ( Narzary et al., 2024 ) , their reliance on manually annotated datasets presents a potential bottleneck. Specifically, robust and freely accessible POS and NER taggers for Bodo are not readily available. Developing such taggers from scratch using traditional supervised learning methods would require the creation of large manually annotated datasets, a resource-intensive and time-consuming undertaking, particularly for languages with limited linguistic documentation and expert annotators ( Palmer et al., 2010 ; Bhat and Varma, 2023 ) . The absence of effective Bodo NER and POS taggers impedes progress in more advanced NLP applications for the Bodo language community, limiting access to the benefits of NLP technology. 1.3 Harnessing Gemini 2.0 Flash Thinking Experiment model for Zero-Shot Cross-Lingual Transfer The emergence of Large Language Models (LLMs) 1 1 1 Large Language Model https://paperswithcode.com/task/large-language-model has ushered in a paradigm shift in NLP, offering new possibilities to address the challenges of low-resource scenarios ( Zhang et al., 2024 ) . LLMs, pre-trained on massive datasets encompassing multiple languages, exhibit remarkable cross-lingual transfer capabilities, enabling them to generalize knowledge learned from resource-rich languages to resource-scarce ones ( Conneau et al., 2020 ; Pires et al., 2019 ) . Google’s Gemini 2.0 Flash Thinking Experimental model 2 2 2 Google Gemini 2.0 Flash Thinking https://deepmind.google/technologies/gemini/flash-thinking/ represents a leading example of such advanced LLMs, designed for efficient inference and adaptable performance across diverse tasks and languages. It is hypothesized that the Gemini 2.0 Flash Thinking Experiment possesses a deep, cross-lingual understanding of language structures and semantics, making it a promising candidate for zero-shot cross-lingual transfer. This article presents an empirical study evaluating the application of Google’s Gemini 2.0 Flash Thinking Experiment model for zero-shot cross-lingual transfer of POS and NER tagging to Bodo. We explore two distinct methodologies to leverage Gemini 2.0 Flash Thinking Experiment’s model capabilities: 1. Method 1: Translation-Based Tag Transfer: This approach utilizes Gemini 2.0 Flash Thinking Experiment’s machine translation module to translate English sentences into Bodo. Subsequently, we investigate the direct transfer of POS and NER tags from the English source sentence to its Bodo translation. This method assesses the feasibility of using MT-induced word alignments and cross-lingual representations for tag projection. 2. Method 2: Prompt-Based Tag Transfer: This methodology directly prompts Gemini 2.0 Flash Thinking Experiment to perform both machine translation and tag transfer simultaneously. By providing parallel English-Bodo sentence pairs as input, we aim to guide the model not only translate but also to explicitly project and generate POS and NER tags for the Bodo sentence in a zero-shot manner. This approach explores the potential of LLMs for more direct and context-aware cross-lingual tag transfer. By comparatively evaluating these two methods, we seek to gain insights into the effectiveness of Gemini 2.0 Flash