Scripts Through Time: A Survey of the Evolving Role of Transliteration in NLP
Thanmay Jayakumar, Deepon Halder, Raj Dabre · 2026
Read Scripts Through Time: A Survey of the Evolving Role of Transliteration in NLP by Thanmay Jayakumar, Deepon Halder, Raj Dabre (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18722.txt.
Introduction
Jayakumar, Halder, and Dabre survey how transliteration, converting text from one writing system to another, is used in cross-lingual natural language processing. They present a taxonomy of motivations, review ways of feeding transliterated text into models, and track how methods have evolved and where they work best. Benefits appear in code-mixed text, in related language families, and in inference efficiency. The survey closes with practical guidance for choosing a strategy by language, task, and resource limits.
Catalog record
| CREATOR | Thanmay Jayakumar, Deepon Halder, Raj Dabre |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32524 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.18722
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Scripts Through Time: A Survey of the Evolving Role of Transliteration in NLP Thanmay Jayakumar, Deepon Halder, Raj Dabre Abstract Cross-lingual transfer in NLP is often hindered by the “script barrier” where differences in writing systems inhibit transfer learning between languages. Transliteration, the process of converting the script, has emerged as a powerful technique to bridge this gap by increasing lexical overlap. This paper provides a comprehensive survey of the application of transliteration in cross-lingual NLP. We present a taxonomy of key motivations to utilize transliterations in language models, and provide an overview of different approaches of incorporating transliterations as input. We analyze the evolution and effectiveness of these methods, discussing the critical trade-offs involved, and contextualize their need in modern LLMs. The review explores various settings that show how transliteration is beneficial, including handling code-mixed text, leveraging language family relatedness, and pragmatic gains in inference efficiency. Based on this analysis, we provide concrete recommendations for researchers on selecting and implementing the most appropriate transliteration strategy based on their specific language, task, and resource constraints. 1 Introduction Cross-lingual transfer, a major driving factor in multilingual Natural Language Processing (NLP), has enabled significant advancements for numerous languages, especially low-resource languages, by leveraging related high-resource language capabilities, predominantly English 25 ; 73 ; 9 . However, the efficacy of this transfer is often impeded by the script barrier: When a low-resource target language is written in a different script from the high-resource source language, transfer performance is hindered, even if the languages are related. Lexical overlap, a key factor for successful cross-lingual transfer, is minimal between different scripts 51 ; 3 ; 46 . Token representations from different scripts can be almost perfectly linearly separated, indicating that models struggle to learn a common representation space 68 . Figure 1: Illustration of common transliteration ambiguities. The first and second examples show how transliteration can cause information loss in the same, and different language respectively. The third example shows how one word may be represented in different ways after transliteration, making reversibility difficult. Figure 2: A taxonomy of the key motivations as to why transliterated data may be useful. Transliteration, the process of converting one writing system to another, thus has emerged as a practical solution for mitigating cross-script incompatibility in NLP. By converting text into a common script, transliteration increases the lexical overlap between languages, thereby facilitating knowledge transfer 51 ; 2 . It is a fast, accurate, and data-efficient method, and does not require parallel corpora 40 . Apart from the direct application of increasing lexical overlap, transliterations improve cross-lingual transfer through several deeper mechanisms that have been explored in the literature. The foundational concept lies in the idea of anchor points, which are identical strings that appear in multiple languages and directly tie meaning across different languages. Transliteration can be seen as a method to artificially create a much larger set of these shared tokens or subwords that serve a similar anchoring function, especially for related languages whose similarities are obscured by different scripts 10 . However, transliteration is not a universal solution and can degrade performance. This is particularly evident with logographic languages like Chinese, where transliterating into a phonetic script like Latin removes crucial semantic and contextual nuances, leading to ambiguity. A summary of information loss that arises due to transliteration is presented in Figure 1 . This survey paper examines the multifaceted role of transliteration in language models and NLP. We explore the evolution of methods that leverage transliteration, analyze the conditions when it is beneficial and when it is not, and review its impact on various downstream tasks and models. Our contributions are summarized as follows: • We provide a taxonomy of the key motivations for using transliteration, from overcoming poor vocabulary coverage for unseen scripts to leveraging linguistic relatedness between languages. • We present a comprehensive overview of different approaches for incorporating transliteration, including its use as a data preprocessing step, as a parallel auxiliary input, or in advanced multi-script architectures that aim to combine its strengths with other methods. • We offer concrete recommendations for NLP researchers, guiding the choice between these strategies based on factors like language relatedness, resource availability, and the specific downstream NLP task. • We discuss the growing role of romanization in particular as opposed to other scripts. Beyond in-context learning, we situate transliteration in current LLM paradigms, and address whether they are still necessary. 2 Taxonomy of Transliteration-based Strategies to Improve NLP Tasks The literature for this survey was gathered through an iterative search process 1 1 1 We thank Jaavid Aktar Husain for providing the initial collection of papers for this study. , beginning with the keywords “transliteration” and “romanization” across academic databases like the ACL Anthology, Semantic Scholar, and arXiv.org. This initial set of papers was then expanded by following their citation graphs. To maintain a focused review, we emphasize on works whose novelty lie in applying transliterations to improve language models rather than those which propose methods to improve transliteration itself. It is worth highlighting the role of code-mixing as the phenomenon frequently co-occurs with transliteration, however, the two remain fundamentally orthogonal phenomena. For a comprehensive overview of code-mixing, we refer the reader to dedicated surveys in the field ( 69 ; 61 ) , as we omit intra-script code-mixing (e.g., between two Latin-script languages) from this paper and maintain a strict focus on cross-script conversion. Table 1 summarizes the papers covered in this survey. 2.1 Motivations to Integrate Transliterations We identify five broad, chronologically-evolving motivations for utilizing transliteration in NLP as summarized in Figure 2 . Figure 3: A taxonomy of the key approaches as to how transliterated data may be integrated. Integration Approach Motivation Script Architecture Task Transliterated Corpora Transliteration Augmented Corpora Vocabulary Augmentation Embedding Concat/Fusion Prompting Strategies Multi-ensemble Self-ensemble Multi-encoder Adapters Additional Objective Named-entity and OOV Code-mixed and Leetspeak Cross-script Similarity Transfer from English-centric Unifying Preprocessing Multi-script Awareness Inference Efficiency Latin Non-Latin Enc-only Dec-only (LLM) Enc-Dec NLU NLG 27 ✓ ✓ ✓ ✓ ✓ 49 ✓ ✓ ✓ ✓ ✓ 5 ✓ ✓ ✓ ✓ ✓ 60 ✓ ✓ ✓ ✓ 31 ✓ ✓ ✓ ✓ ✓ 18 ✓ ✓ ✓ ✓ ✓ ✓ 17 ✓ ✓ ✓ ✓ ✓ ✓ ✓ 56 ✓ ✓ ✓ ✓ ✓ ✓ 36 ✓ ✓ ✓ ✓ ✓ ✓ ✓ 66 ✓ ✓ ✓ ✓ ✓ 16 ✓ ✓ ✓ ✓ ✓ ✓ 22 ✓ ✓ ✓ ✓ ✓ 21 ✓ ✓ ✓ ✓ ✓ ✓ 44 ✓ ✓ ✓ ✓ ✓ 11 ✓ ✓ ✓ ✓ ✓ ✓ 4 ✓ ✓ ✓ ✓ ✓ 45 ✓ ✓ ✓ ✓ ✓ 19 ✓ ✓ ✓ ✓ ✓ 24 ✓ ✓ ✓ ✓ ✓ ✓ 54 ✓ ✓ ✓ ✓ 6 ✓ ✓ ✓ ✓ ✓ ✓ ✓ 67 ✓ ✓ ✓ ✓ ✓ ✓ 37 ✓ ✓ ✓ ✓ ✓ ✓ 28 ✓ ✓ ✓ ✓ ✓ ✓ 2 ✓ ✓ ✓ ✓ ✓ ✓ 62 ✓ ✓ ✓ ✓ ✓ 47 ✓ ✓ ✓ ✓ ✓ ✓ ✓ 20 ✓ ✓ ✓ ✓ ✓ ✓ 57 ✓ ✓ ✓ ✓ ✓ 32 ✓ ✓ ✓ ✓ ✓ ✓ 30 ✓ ✓ ✓ ✓ ✓ 14 ✓