Misspellings in Natural Language Processing: A Survey

Gianluca Sperduti, Alejandro Moreo · 2025

Read Misspellings in Natural Language Processing: A Survey by Gianluca Sperduti, Alejandro Moreo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-16836.txt.

Introduction

Gianluca Sperduti and Alejandro Moreo survey misspellings in language technology in a 2025 paper. Typos are now a daily fact of online text, from social posts to forums. People read through them with ease, but AI language tools stumble, and their scores drop on core tasks such as sorting text or translating it.

The survey traces how the field came to treat typos as a research problem. It sorts the main fixes: growing the training data, two step reads, order blind encodings, and tuple based forms. Set contests that push the field are charted too. The authors also flag dark uses, such as typos that slip hate past filters, and what the mind's own typo handling may teach tool builders.

Catalog record

CREATORGianluca Sperduti, Alejandro Moreo
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE110 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-16836

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Misspellings in Natural Language Processing: A Survey Gianluca Sperduti, Alejandro Moreo Abstract This survey provides an overview of the challenges of misspellings in natural language processing (NLP). While often unintentional, misspellings have become ubiquitous in digital communication, especially with the proliferation of Web 2.0, user-generated content, and informal text mediums such as social media, blogs, and forums. Even if humans can generally interpret misspelled text, NLP models frequently strug- gle to handle it: this causes a decline in performance in common tasks like text classification and machine translation. In this paper, we reconstruct a history of misspellings as a scientific problem. We then discuss the latest advancements to address the challenge of misspellings in NLP. Main strategies to mitigate the effect of misspellings include data augmentation, double step, character-order agnostic, and tuple-based methods, among others. This survey also examines dedicated data challenges and competitions to spur progress in the field. Critical safety and ethical concerns are also examined, for example, the voluntary use of misspellings to inject malicious messages and hate speech on social networks. Furthermore, the survey explores psycholinguistic perspectives on how humans process misspellings, potentially informing inno- vative computational techniques for text normalization and representation. Finally, the misspelling-related challenges and opportunities associated with modern large language models are also analyzed, including benchmarks, datasets, and performances of the most prominent language models against misspellings. This survey aims to be an exhaustive resource for researchers seeking to mitigate the impact of misspellings in the rapidly evolving landscape of NLP. K eywords Misspellings \cdot typos \cdot natural language processing. 1 Introduction Human language is constantly evolving. The world we live in is governed by information and communication technologies. Our time, sometimes dubbed the digital era , must thus be prepared to face changes in the way we communicate, and implement mechanisms to adapt to it. Changes in communication derive from multiple aspects. The use of non-standard written language might respond to cultural or societal factors, but not only. It may simply happen by mistake , in which case we speak of misspellings . Misspellings have become pervasive in the digital written production since the revolutionary Web 2.0 led people interact freely through social medial, blogs, forums, etc. Even though misspellings are generally unintentional, in some contexts these may also be intentional . Of course, the presence of misspellings complicate the reading of a text. Notwithstanding this, and somehow surprisingly, humans have the ability to read and comprehend misspelt text without much effort and, sometimes, even without realising their presence ( Andrews,, 1996 ; Healy,, 1976 ; Shook et al.,, 2012 ; McCusker et al.,, 1981 ) . Computers do not have similar capabilities though. Although the NLP community has long downplayed the problem of misspellings (if not for grammatical error correction ( Shishibori et al.,, 2002 ) or text normalisation ( Damerau,, 1964 ) ), it is by now abundant evidence that misspellings represent a serious risk to the performance of NLP systems ( Baldwin et al.,, 2013 ; Heigold et al.,, 2018 ; Moradi and Samwald,, 2021 ; Náplava et al.,, 2021 ; Nguyen and Grieve,, 2020 ; Plank,, 2016 ; Vinciarelli,, 2005 ; Yang and Gao,, 2019 ) . The last survey on the topic of misspellings in NLP dates back to 2009 ( Subramaniam et al.,, 2009 ) . Since then, the problem has come to receive an increased deal of attention, and a number of methods specifically devised to counter misspellings ( Heigold et al.,, 2018 ; Belinkov and Bisk,, 2018 ) , as well as dedicated benchmarks of misspellings on which to test the methods ( Michel and Neubig,, 2018 ) and even dedicated events and data challenges ( Lopresti et al.,, 2009 ; Basili et al.,, 2010 ; Dey et al.,, 2011 ) have made their appearance in the last decade. This paper aims at offering a comprehensive overview of recent advancements in the field. The study of misspellings in NLP is paramount not only as a means for improving the performance of current systems, but also for reasons that are ultimately bound to safety and ethics . Misspellings are, as hinted above, not always an involuntary phenomenon. Misspellings may sometimes be carefully and maliciously designed ( Li et al., 2019a, ) with the purpose of disguising certain words to elude the control of automatic content moderation tools or spam detection filters. The study of misspelling can help in mitigating the proliferation of hate speech or in preventing unwanted content to reach the final audience. Additionally, the fact that certain misspellings act as obfuscations for computers but not for humans suggests that studying this phenomenon from a psycholinguistic perspective might inspire alternative, more efficient methods for text representation and processing. The rest of this survey is organised as follows. In Section 2 we offer an overview of the history of misspellings in the digital era, analysing the main trends before and after the proliferation of user-generated content and the upsurge of neural networks. In Section 3 we describe how the phenomenon is regarded under the lens of linguistics and NLP. In Section 4 we survey previous work on the potential harm of misspellings. Section 5 is devoted to describing methods specifically devised to counter misspellings. The main tasks, evaluation measures, venues, and datasets dedicated to misspellings are discussed in Section 6 . Section 7 is devoted to analysing the phenomenon of misspellings from the point of view of modern large language models (LLMs). Section 8 discusses the main applications in which the presence of misspellings gains special relevance. Section 9 concludes, by also pointing to promising directions of research. 2 A Brief History of Misspellings The treatment of misspellings in NLP has traversed two main phases that hinge upon the proliferation of the so-called Web 2.0 and, with these, the spread of huge quantities of (often carelessly generated) user-generated content. The term Web 2.0 was first coined by Darcy DiNucci in 1999, but it was not until 2004 that the term became popular thanks to the Web 2.0 Conference . 1 1 1 Source https://en.wikipedia.org/wiki/Web_2.0 It took some time for the user-generated content to take on the Internet, something that we identified to indicatively happen around 2010. This section is devoted to briefly surveying the history of misspellings before (Section 2.1 ) and after (Section 2.2 ) this event. 2.1 Before 2010: Fewer Data, Less Misspellings Before the explosion of user-generated data on the Internet, the vast majority of content available on the web (static web pages, journal articles, etc.) was characterised by the fact that the content was moderately well curated. As a result, the amount of data was relatively limited, and the available data contained few misspellings. For this reason, automated text analysis technologies were rarely concerned with the presence of misspellings, if at all. The study of misspellings was confined to the development of automatic correction tools that aid users in producing misspelling-free texts by, e.g., correcting typos, or applying OCR-produced errors. Vinciarelli, (2005) is one of the pioneer studies dealing with NLP systems resilient to misspellings (more precisely, with errors acquired via OCR). Some studies seemed to indicate that the problem of misspellings was not paramount for text classification technologies, at

Read the complete text