OLaPh: Optimal Language Phonemizer
Johannes Wirth · 2025
Read OLaPh: Optimal Language Phonemizer by Johannes Wirth (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-20086.txt.
Introduction
Johannes Wirth wrote this 2025 arXiv paper on speech technology. Its subject is phonemization, the step that turns written words into sounds for text-to-speech systems. Good phonemization matters most for rare words that dictionaries miss. Wirth presents OLaPh, a system built for this task across many languages.
OLaPh mixes large multilingual word lists with language processing tools and a statistical way to split words into parts. On the WikiPron benchmark it beat established baselines in overall accuracy. Strong fallback rules keep it reliable on words outside the dictionary. Wirth also used the system to build training data for a large language model. The model learned sound patterns well but stayed less accurate than the rule-based system overall. Both tools are released as an open resource for grapheme-to-phoneme research.
Catalog record
| CREATOR | Johannes Wirth |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 18 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-20086
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
OLaPh: Optimal Language Phonemizer Johannes Wirth Abstract Phonemization, the conversion of text into phonemes, is a key step in text-to-speech. Traditional approaches use rule-based transformations and lexicon lookups, while more advanced methods apply preprocessing techniques or neural networks for improved accuracy on out-of-domain vocabulary. However, all systems struggle with names, loanwords, abbreviations, and homographs. This work presents OLaPh (Optimal Language Phonemizer), a framework that combines large lexica, multiple NLP techniques, and compound resolution with a probabilistic scoring function. Evaluations in German and English show improved accuracy over previous approaches, including on a challenging dataset. To further address unresolved cases, we train a large language model on OLaPh-generated data, which achieves even stronger generalization and performance. Together, the framework and LLM improve phonemization consistency and provide a freely available resource for future research. † † address: Institute for Information Systems at Hof University of Applied Sciences † † footnotetext: © 2025 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. 1 Introduction Phonemization, the conversion of text (graphemes) into phonemes, is a core component of text-to-speech (TTS) systems, ensuring correct pronunciation, prosody, and intelligibility. Some modern TTS models rely solely on deep neural networks to infer pronunciation from raw text [ 1 , 2 ] , but this sacrifices control and adaptability. Users cannot manually correct rare words, loanwords, or domain-specific terms, and improving performance often requires resource-intensive retraining [ 3 ] , which is impractical in many applications. To retain flexibility and explainability, many TTS systems incorporate phonemization as an intermediate preprocessing step [ 3 , 4 ] . Widely used approaches rely on rule-based transformations and lexicon lookups, which struggle with morphological complexity [ 5 ] , number normalization, named entities, and foreign words [ 6 ] . Even more advanced frameworks that add preprocessing steps such as part-of-speech (POS) tagging and neural models for unseen words still produce systematic errors, preventing flawless results and limiting synthesized speech quality in real-world applications. This work introduces OLaPh (Optimal Language Phonemizer), a framework that enhances previous approaches by leveraging large phonological resources, improving compound word handling with probabilistic scoring, and integrating NLP techniques such as named entity recognition (NER), POS tagging, and language detection. OLaPh provides accurate, transparent phoneme representations, particularly for morphologically rich languages like German, including dialectal variants. Manual evaluation in German and English compares OLaPh with baselines, while a challenge test set highlights its strengths on edge cases. Finally, a large language model (LLM) trained on OLaPh-generated data shows superior generalization compared to both the framework itself and other LLM-based phonemization models. 2 Related work Early work on phonemization showed that simple grapheme-to-phoneme alignment is insufficient due to the many exceptions in pronunciation [ 7 , pp. 105-106] . Two main strategies emerged: dictionary-based methods with rules for unknown words, and rule-based methods with exception lists [ 8 ] . Modern systems such as eSpeakNG [ 9 ] extend these approaches with curated rules and large dictionaries, but still fail on homographs and foreign words. Gruut [ 10 ] instead combines lexica with grapheme-to-phoneme (G2P) models based on conditional random fields, supported by parsers and POS tagging. This allows it to disambiguate homographs (e.g., wound /wund/ as a noun vs. wound /wand/ as a verb), but often reduces consistency overall. More recent G2P approaches employ neural networks, such as the transformer-based T5G2P [ 11 ] for English and Czech or multilingual models based on ByT5 [ 12 , 13 ] . While these achieve strong results, they remain limited by the quality of training data and continue to struggle with context-dependent or low-resource phonemization. LLMs have also been proposed for phonemization [ 3 , 14 ] , though direct comparisons are difficult due to differing datasets and metrics [ 15 ] . These LLM-based approaches highlight a growing shift toward models that integrate broader contextual understanding, but they also raise questions of efficiency and adaptability across languages. 3 Approach 3.1 Components 3.1.1 Lexicon lookup OLaPh builds on Gruut’s lexicon-based approach, using recent Wiktionary dumps to extract IPA transcriptions in four languages. While the system currently supports English and German, lexica for French and Spanish were also extracted due to frequent loanwords. The English lexicon contains \sim 147k entries, and the German lexicon \sim 842k (including inflections). Additional lexica were created for character mapping, abbreviations, and symbols. As Wiktionary updates, the lexica can be easily extended, improving accuracy over time. 3.1.2 Named Entity Recognition (NER) Proper names and organizations often follow non-standard or foreign pronunciation. Detecting entities prior to phonemization allows applying language-specific rules (e.g., “FBI” in German remains English). SpaCy models [ 16 ] are used for NER in each language. Detected entities are phonemized via lexicon lookup using the identified source language when available. 3.1.3 Number normalization Many phonemization systems struggle with numerical expressions, mathematical symbols, and special characters. By normalizing numbers (e.g., dates, times, decimals, ordinals) and symbols into their spoken equivalents before phonemization, inconsistencies in synthesized speech can be reduced. For the English language, the library num2words [ 17 ] is used, which is also utilized in the Gruut framework. For German, a dedicated normalization algorithm was implemented, as its complex case system required a more refined solution. 3.1.4 POS tagging Homographs such as the English word read (present tense /id/ versus past tense /d/), require context for accurate phonemization. The previously created lexica contain POS tags for homographs to help resolve such ambiguities by ensuring that pronunciation aligns with the correct usage. For POS tagging, the same spaCy models are used as for NER. This method also supports dialect phonemization if the lexicon contains corresponding word variants. 3.1.5 Language detection Loanwords and code-switching [ 18 ] present challenges for phonemization, as different languages follow distinct pronunciation rules. By identifying the language of individual words or phrases (including named entities), language-specific lookups and operations can be performed, rather than enforcing a single-language phonemization, which would induce errors in such cases. For this task, the Lingua language detection framework [ 19 ] was utilized as it supports a large number of languages and overall achieved good detection accuracies in experiments. 3.1.6 Morphological compound splitting When a word is not found in the extensive lexica, a probabilistic compound-splitting algorithm is applied. This algorithm segments the word into plausible subword candidates and scores each combination based on their frequency, length, and likelihood in a large reference corpus of over 15 million sentences from a recent Wikipedia dump, adapted to each supported language. In languages like German, where long compounds and interleaved loanwords are common, simple left-to-right or right-to-left lexicon lookups are insufficient. Instead, the algorithm evaluates all possible segmentations and assigns scores according to the following principle: P\left(W\right)=\sum_{s\in W}P\left(s\right)\times\left(\frac{\left|s\right|}{\left|W\right|}\right)^{\alpha}\times L\left(s\right)\times\left|W\right|^{-\beta} Where W denotes a combination of subwords and s a subword inside such a combination; P(W) the probability of a subword combination; P(s) the probability of occurrence of a subword s , estimated from corpus statistics in the respective language;