GRDD+: An Extended Greek Dialectal Dataset with Cross-Architecture Fine-tuning Evaluation
Stergios Chatzikyriakidis, Dimitris Papadakis, Sevasti-Ioanna Papaioannou, Erofili Psaltaki · 2025
Read GRDD+: An Extended Greek Dialectal Dataset with Cross-Architecture Fine-tuning Evaluation by Stergios Chatzikyriakidis, Dimitris Papadakis, Sevasti-Ioanna Papaioannou, Erofili Psaltaki (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-03772.txt.
Introduction
Stergios Chatzikyriakidis and co-authors extend a Greek dialect corpus to ten varieties and more than six million words. GRDD+ grows the earlier set for Cretan, Cypriot, Pontic, and Northern Greek, and adds six more, from Griko in southern Italy to Tsakonian and formal Katharevusa. No Greek dialect resource of this breadth and size existed before.
Fine-tuning trials span three model families, including a Greek-focused model, and compare them with frontier commercial systems. Good dialect data lift smaller models notably on dialect tasks in the reported runs. Dialects carry identity and history that standard-language training erases, so a shared corpus helps both research and preservation. The set also gives a fair test bed for cross-dialect transfer.
Catalog record
| CREATOR | Stergios Chatzikyriakidis, Dimitris Papadakis, Sevasti-Ioanna Papaioannou, Erofili Psaltaki |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-03772
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GRDD+: An Extended Greek Dialectal Dataset with Cross-Architecture Fine-tuning Evaluation Stergios Chatzikyriakidis, Dimitris Papadakis, Sevasti-Ioanna Papaioannou, Erofili Psaltaki Abstract We present an extended Greek Dialectal Dataset (GRDD+) 1 1 1 The full code for fine-tuning and the dataset GRDD+ are available at the following anonymous link: https://drive.google.com/drive/folders/1Xwfz08S8-9ZqMGd6EaNSje33LIaSE2E5?copy . that complements the existing GRDD dataset with more data from Cretan, Cypriot, Pontic and Northern Greek, while we add six new varieties: Greco-Corsican, Griko (Southern Italian Greek), Maniot, Heptanesian, Tsakonian, and Katharevusa Greek. The result is a dataset with total size 6,374,939 words and 10 varieties. This is the first dataset with such variation and size to date. We conduct a number of fine-tuning experiments to see the effect of good quality dialectal data on a number of LLMs. We fine-tune three model architectures (Llama-3-8B, Llama-3.1-8B, Krikri-8B) and compare the results to frontier models (Claude-3.7-Sonnet, Gemini-2.5, ChatGPT-5). 1. Introduction Modern Greek exhibits rich dialectal variation across different geographical regions. Despite this diversity, computational resources for these dialects remain limited, constraining the study and processing of regional linguistic varieties. Meanwhile, in the current rapid advancement of Natural Language Processing (NLP), Large Language Models (LLMs) have emerged at the forefront of research and development. However, LLMs frequently struggle with dialectal variations in lower-resourced languages, e.g. in Parts of Speech (POS) tagging and dialect identification 9 . While their dialect performance can surpass zero-shot transfer, it still falls behind the fine-tuned results 8 . These limitations significantly impact their ability to generate contextually appropriate responses across regional dialects. This paper introduces an extended dataset GRDD+ and fine-tuning experiments across multiple model architectures. Our study aims to evaluate how model adaptation can improve dialectal performance in Greek and provide new benchmarks for dialectal NLP. The remainder of the paper is organized as follows. Section 2 reviews related work. Section 3 describes the dataset and methodology, while Section 4 presents the fine-tuning experiments. Section 5 reports and discusses the results. Section 6 outlines future work, while Sections 7 and 8 discuss the limitations and present the conclusion and closing remarks, respectively. 2. Related Work Against this backdrop, resources for Modern Greek dialects remain scarce. Existing datasets include, among others, a small corpus for Griko 2 , the Cypriot Greek version of the Multi-CAST corpus of annotated spoken texts 10 , and a database comprising 505 hours of recorded dialectal speech with linguistic and meta-linguistic annotations 15 . To our knowledge, the GRDD corpus 6 constitutes a first comprehensive effort to develop large-scale publicly available resources for Modern Greek dialects. In parallel, several studies have emerged in the field of Greek computational dialectology, such as the development of Treebanks and parsers for Eastern Cretan in the framework of Universal Dependencies 32 , the detection of Italian and Turkish loanwords in Greek dialects 27 and computational analyses of the linguistic varieties of Cappadocian, Pharasiot, and Silliot 4 . However, to the best of our knowledge, none of these efforts have attempted fine-tuning Large Language Models (LLMs) on Greek Dialectal Data. 3. GRDD+ Dataset 3.1. Collection Methodology We focused on freely available dialectal data collected from the web. These include texts from blogs, websites, and publicly accessible literary sources such as songs, poems, folktales, dialogues and translations of works into the dialect by native speakers. Additionally, we collected dialectal data for certain varieties (Greco-Corsican, Griko, Heptanesian, Maniot and Pontic) from publicly available books using Optical Character Recognition (OCR) via Google Cloud Vision OCR 2 2 2 https://cloud.google.com/vision , subsequently removing all book metadata and retaining only the clean dialectal text. After data collection, we performed basic preprocessing on the data, including the removal of numbers, URLs, special characters, duplicate lines and extra white spaces. Building upon the GRDD dataset 6 , which consists of four dialects of Modern Greek, specifically Cretan, Pontic, Northern Greek, and Cypriot Greek, the present work seeks to extend and enhance the resource. Specifically, we enrich the existing dialectal corpora and incorporate six additional Greek dialectal varieties, as detailed below. 3.1.1. Greco-Corsican In the 1670s, Greek migrants from Mani settled in Cargèse, Corsica, forming a Greek-speaking community 21 . From the 1670s to the 1960s, a span of nearly three centuries, Greek was spoken in Cargèse, in relative isolation from other Greek-speaking communities. The variety, known as Greco-Corsican, has been the subject of detailed linguistic study 35 ; 3 ; 22 ; 24 . However, linguistic assimilation progressed rapidly, and by the 1930s only about 20 speakers of Greek remained. The language ultimately became extinct with the death of its last native speaker, Justine Voglimacci, in 1976. 3.1.2. Griko (Southern Italian Greek) Griko is a Greek dialect spoken in Grecìa Salentina, southern Italy, and recognized as a minority language. Officially, Grecìa Salentina consists of 12 villages: Calimera, Carpignano Salentino, Castrignano dei Greci, Corigliano d’Otranto, Cutrofiano, Martano, Martignano, Melpignano, Sogliano Cavour, Soleto, Sternatia and Zollino. Griko together with Grecanico of Calabria, form the endangered Italiot Greek group 26 . Written in the Latin alphabet and only partly intelligible with Modern Greek, Griko now has fewer than 20,000 mostly elderly speakers 7 . 3.1.3. Heptanesian Heptanesian is a Modern Greek dialect spoken on the Ionian Islands, including Corfu, Cephalonia, Lefkada, Zante, Ithaca, Kithira, Paxi and smaller islands such as Othoni, Antipaxi, and Antikithira 16 . These islands were under Venetian rule from the late 14th to the late 18th century. Heptanesian exhibits Venetian and Italian influences primarily in its vocabulary, phonology (e.g.intonation), and morphology (e.g., the noun suffix –aδa < Ven –ADA), with syntax largely unaffected 23 . Today, Heptanesian is gradually being abandoned in favor of Standard Modern Greek (SMG). 3.1.4. Tsakonian Tsakonian, a highly divergent modern form of Greek, still spoken in the eastern Peloponnese, is often considered distinct enough to be classified as a separate language from the rest of Modern Greek. As the only Modern Greek dialect that is not descended from the Hellenistic Koine, Tsakonian represents the main exception among Modern Greek varieties, deriving more or less directly from the ancient Doric dialect 14 ; 20 . 12 refers to Tsakonian as a case of extreme dialectal resilience, exempt from the fundamental sound changes that shaped Modern Greek, such as the reversal of /u/ > /i/, while the dialect also exhibits numerous features that are unusual or unique compared to other Modern Greek varieties 17 . 3.1.5. Maniot Maniot refers to the dialect spoken in the region of Laconian Mani. According to the traditional classification proposed by 11 , which divides Modern Greek dialects into northern and southern groups, Maniot is categorized among the southern varieties. 33 notes that Maniot constitutes a dialect distinct from the rest of the Peloponnesian varieties. The same view appears to be supported by 29 , which emphasize the distinctiveness of the Maniot dialect. The linguistic systems that appear to share similarities with Maniot include SMG, Cretan 29 , Megarian, and, of course, several other Peloponnesian dialects 34 . 34 has argued that the similarities observed between SMG and the Peloponnesian dialects result from the influence of SMG on these dialects, and not vice versa, as had previously been claimed by 19 ; 5 ; 33 , among others . 3.1.6. Katharevusa Greek Katharevusa, described as a ‘