Neural Machine Translation for Coptic-French: Strategies for Low-Resource Ancient Languages

Nasma Chaoui, Richard Khoury · 2025

Read Neural Machine Translation for Coptic-French: Strategies for Low-Resource Ancient Languages by Nasma Chaoui, Richard Khoury (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-10683.txt.

Introduction

Nasma Chaoui and Richard Khoury build the first systematic study in 2025 of machine translation from Coptic into French. Coptic, the last stage of ancient Egyptian, survives mostly in religious texts, and translation tools starve for data. Bible texts aligned in both languages gave the training ground.

Four questions structured the work. Should translation pivot through a third language or go direct? What does pre-training add, does mixing text styles in tuning help, and how does the model handle noisy input? Tuning on a varied, noise-aware set lifted quality clearly. The recipe should travel to other old, low-data languages, the authors argue, giving scholars machine help where hand translation is slow and rare hands are aging.

Catalog record

CREATORNasma Chaoui, Richard Khoury
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-10683

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Neural Machine Translation for Coptic-French: Strategies for Low-Resource Ancient Languages Nasma Chaoui, Richard Khoury Abstract This paper presents the first systematic study of strategies for translating Coptic into French. Our comprehensive pipeline systematically evaluates: pivot versus direct translation, the impact of pre-training, the benefits of multi-version fine-tuning, and model robustness to noise. Utilizing aligned biblical corpora, we demonstrate that fine-tuning with a stylistically-varied and noise-aware training corpus significantly enhances translation quality. Our findings provide crucial practical insights for developing translation tools for historical languages in general. 1 Introduction Neural Machine Translations (NMT), with its steady growth, has profoundly impacted the field of computational linguistics. Transformer models and large-scale multilingual systems have enabled translation coverage across hundreds of language pairs. However, many historical languages — especially ancient ones with scarce data — have yet to benefit from these advancements. Coptic is one such language. As the last stage of the Egyptian language family, understanding and translating it is crucial for advancing fields such as Egyptology and Early-Christian studies. As a result, the language is studied in universities around the world; according to one listing 1 1 1 Listing assembled by https://www.cmcl.it/~iacs/course.htm . , over 50 universities in 13 countries offer Coptic courses. But despite this international interest, there are currently few NMT tools for Coptic, and only to translate to English or Arabic. This paper aims to fill that gap by investigating a wide range of NMT strategies to translate Coptic into French. In the process, we will focus on four important questions: (1) should we translate directly to our target language or use English as a pivot language; (2) how should we pick a language model to fine-tune for this task; (3) should we provide the model with a diverse set of possible translations for a passage; and (4) how can we make the model robust to noise in the original manuscript. While our focus is solely on Coptic \rightarrow French NMT, these questions are of general interest, and our results will help guide the development of NMT tools between any ancient-modern language pair. The remainder of this paper is organized as follows: Section 2 reviews relevant work on natural language processing Coptic. Section 3 details our methodology we plan to use to explore our four questions. Section 4 presents our experimental setup: our dataset, NMT models and metrics, and Section 5 presents the results we obtain on the experiments about each of the four questions. Finally, Section 6 has some concluding remarks. Our dataset and code are available on our GitHub account 2 2 2 https://github.com/chaouin/coptic-french-nmt , while the best Coptic \rightarrow French NMT models we train are distributed on HuggingFace 3 3 3 https://huggingface.co/chaouin/coptic-french-translation-helsinki 4 4 4 https://huggingface.co/chaouin/coptic-french-translation-hiero . 2 Background Coptic occupies a unique position as the final stage of the Egyptian language family, bridging thousands of years from Old Egyptian through Demotic. It holds critical historical and cultural significance for Egyptology, biblical and early monasticism studies, as many Coptic manuscripts illuminate these fields. In recent years, substantial progress has been made in building digital resources for Coptic. The Coptic SCRIPTORIUM project Schroeder and Zeldes 2016 stands out as a foundational effort, providing annotated corpora with multiple linguistic layers, including part-of-speech tagging, lemmatization, morphological analysis, and syntactic parsing Zeldes and Schroeder 2016 . Similarly, tools such as the BabyLemmatizer have extended lemmatization and POS tagging capabilities across Coptic, Demotic, and Earlier Egyptian, demonstrating the shared linguistic complexities within the Egyptian language family Sahala and Lincke 2025 . Recent work has also explored NMT within the Egyptian language family, particularly focusing on hieroglyphic texts. Notably, Cao et al. 2024 developed a Hieroglyphic Transformer by adapting the multilingual M2M-100 model to translate ancient Egyptian hieroglyphs into both German and English. Their approach involved constructing a carefully curated dataset from the Thesaurus Linguae Aegyptiae , which includes hieroglyphic inscriptions paired with transliterations, POS tags, and translations. They relied on transliteration (romanization) to render hieroglyphic sequences compatible with modern NLP model vocabularies, and demonstrated that transfer learning from existing multilingual architectures could achieve promising results even on low-resource ancient scripts. The authors of Saeed et al. 2024 introduced the largest parallel corpus to date for Coptic, comprising approximately 24,000 Coptic-English sentence pairs and 8,000 Coptic-Arabic pairs, and used it to train the first NMT system from Coptic to Arabic and English. They used both basic Seq2Seq models and fine-tuned multilingual models such as mT5 and M2M-100. Their work emphasized the necessity of romanization due to Coptic characters being absent from standard vocabularies. Similarly, Enis and Megalaa 2024 implemented Coptic \rightarrow English NMT by fine-tuning multilingual models on normalized and romanized texts from the Coptic SCRIPTORIUM. They employed backtranslation and explored multiple data representations, demonstrating the critical impact of morphological normalization and tokenization for handling Coptic’s agglutinative structure. 3 Methodology While implementing our Coptic \rightarrow French NMT model, we seek to study four fundamental design questions that are common to most if not all ancient-modern language translation projects. Thus, our methodology is divided into four stages, each building on the findings of the previous. 3.1 Pertinence of Fine-Tuning To begin, we seek to answer a fundamental question: is it even worthwhile to fine-tune a NMT model for Coptic \rightarrow French translation? After all, while no such model exists, there are alternatives. The first one would be to use a more general multilingual NMT model that can work out of the box without any fine-tuning. Another alternative could use a NMT model that can translate the ancient language into another pivot language, and prompt it to answer in our target modern language. In our case, this will mean using a readily-available Coptic \rightarrow English NMT model and prompting it to answer in French. Finally, since NMT models trained to translate between pairs of modern languages abound today, we could again start from an NMT model that can translate the ancient language into a pivot language, and use a second NMT model to translate that content into our target modern language. In our case, we could daisy-chain a Coptic \rightarrow English and an English \rightarrow French NMT model to accomplish this. Consequently, the first stage of our research consists in comparing the translations produced by a fine-tuned Coptic \rightarrow French NMT model and these three alternatives, to see the differences between these four options. 3.2 Pre-Trained Model Choice While there are not a lot of ancient \rightarrow modern NMT models, there are a handful of them available, and therefore a question arises: how to pick which one to fine-tune? There are technical and linguistic considerations in this decision. From a technical standpoint, the different models available may have different numbers of parameters and be trained using different quantities of data (but given the scarcity of ancient-language data, they will typically not have different data sources). And linguistically, when no model exists for our ancient and modern language pair, three options are available. The first is to take a model trained to translate the ancient language to a different modern language and fine-tune it to our target language, or in our case fine-tune a Coptic-English model to translate to French. The second option is to take a model trained to translate into the modern language

Read the complete text