A Catalog of Basque Dialectal Resources: Online Collections and Standard-to-Dialectal Adaptations

2026

Read A Catalog of Basque Dialectal Resources: Online Collections and Standard-to-Dialectal Adaptations (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25189.txt.

Introduction

Bengoetxea, Gonzalez-Dios, and Agerri catalog the dialect data now open to Basque language research. Dialect work in NLP starves for data, so a clear map of what exists matters. The catalog splits sources in two. One side holds text born in a dialect: news, radio, tweets, dictionaries, atlases, and videos. The other holds standard text recast into dialects, by hand or by machine. A hand-made gold set renders an inference test in three dialects. Native speakers also graded a machine-made commonsense set to judge silver data.

Catalog record

YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33029
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2603.25189

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Catalog of Basque Dialectal Resources: Online Collections and Standard-to-Dialectal Adaptations Abstract Recent research on dialectal NLP has identified data scarcity as a primary limitation. To address this limitation, this paper presents a catalog of contemporary Basque dialectal data and resources, offering a systematic and comprehensive compilation of the dialectal data currently available in Basque. Two types of data sources have been distinguished: online data originally written in some dialect, and standard-to-dialect adapted data. The former includes all dialectal data that can be found online, such as news and radio sites, informal tweets, as well as online resources such as dictionaries, atlases, grammar rules, or videos. The latter consists of data that has been adapted from the standard variety to dialectal varieties, either manually or automatically. Regarding the manual adaptation, the test split of the XNLI Natural Language Inference dataset was manually adapted into three Basque dialects: Western, Central, and Navarrese-Lapurdian, yielding a high-quality parallel gold standard evaluation dataset. With respect to the automatic dialectal adaptation, the automatically adapted physical commonsense dataset (BasPhyCo west ) underwent additional manual evaluation by native speakers to assess its quality and determine whether it could serve as a viable substitute for full manual adaptation (i.e., silver data creation). Keywords: Basque, dialects, low-resource, data-collection A Catalog of Basque Dialectal Resources: Online Collections and Standard-to-Dialectal Adaptations Jaione Bengoetxea, Itziar Gonzalez-Dios, Rodrigo Agerri HiTZ Center - Ixa, University of the Basque Country EHU {jaione.bengoetxea,itziar.gonzalezd,rodrigo.agerri}@ehu.eus Abstract content 1. Introduction Dialectal variation is a core feature of all natural languages. However, up until now, Natural Language Processing (NLP) research has almost exclusively focused on tailoring data and resources for the standard forms of each language. In recent years, this trend has slowly started to shift, with some studies increasingly focusing on dialects. However, the range of tasks and languages addressed remains fairly limited. Several surveys review recent developments and research directions in dialectal NLP, such as 15 and 22 . Therefore, a major limitation identified by these works is the scarcity of data and resources for non-standard varieties. This presents a significant challenge, since recent advances in state-of-the-art NLP have reinforced the importance of data quantity in developing high-performing language technology tools, especially in low-resource scenarios ( 4 ) . Given the importance of data quantity, the field of dialectal NLP could be regarded as a low-resource research scenario. The lack of modern dialectal data is especially pronounced for Basque NLP technologies. The majority of resources have been developed with a high focus on Standard Basque, such as spell-checkers ( 2 ) , Neural Machine Translators 1 1 1 Elia or Itzuli . or, more recently, text representations 1 , and instruction fine-tuned Large Language Models (LLMs) trained for Basque ( 9 ; 19 ) . In this context, this paper aims to present a thorough compilation of Basque dialectal data and resources in order to facilitate potential future work on Basque dialects. We hope this will be useful not only in the field of NLP, but also in other related areas such as sociolinguistics or variationist linguistics. This work groups Basque dialectal data and resources into two main categories, presented in Section 3 and Section 4 , respectively: Figure 1: The Basque dialectal catalog consists of two different sources: online dialectal data and standard-to-dialect adapted data, either manually or automatically. • Online dialectal data and resources. This category includes online sites such as local news and radio stations, tweets, linguistic atlases, dictionaries, and videos. • Standard-to-dialect adapted data. This includes standard data adapted into dialects, either manually or automatically. For the former, we present Parallel XNLIvar , an expansion of XNLIvar ( 5 ) that includes the manual adaptation of the 5000-instance test set for the task of Natural Language Inference (NLI). The latter describes BasPhyCo , a physical commonsense dataset automatically adapted into dialectal Basque using Large Language Models (LLMS) ( 6 ) . A novel manual evaluation has been conducted by native dialect speakers on the automatically obtained data. These resources and adapted datasets are collected and publicly available 2 2 2 https://anonymous.4open.science/r/Catalog-of-Basque-Dialects-D87A . 2. Related Work Dialectal Data Collection Many recent studies have focused their research on the systematic collection of dialectal data as a strategy to address the problem of data scarcity. For instance, 20 introduced a gamified dialect data collection system, where native speakers could access an interface and either rewrite sentences into their dialect or match dialectal sentences to their geographical location. Their work has been found to efficiently increase user engagement in data collection processes. However, given the growing demand to acquire large volumes of data, manual collection is frequently impractical. Therefore, several works have resorted to silver data creation, such as Multi-VALUE ( 23 ) , a rule-based translation system for 50 different English dialects and 189 linguistic features, which performs as a successful data augmentation method. Although the critical role of dialectal data is widely recognized, no study currently provides a comprehensive dialectal database. There are, however, some benchmark works that do not explicitly focus on data, but provide an invaluable source of dialectal data. For instance, 10 presented an extensive dialectal benchmark, evaluating 10 different tasks in 281 varieties. Additionally, 3 focused their dialectal benchmark on Machine Translation (MT), as they evaluated several varieties from 12 different languages. Both of these benchmarks included Basyque ( 21 ) , a dataset of Northern Basque dialects used to evaluate MT. No other task was evaluated in Basque in these works, as there was no other dialectal dataset for modern Basque dialects at the time of these benchmarks. Basque Dialects The classification of Basque dialects has been up for debate for many years. 7 proposed a classification of eight dialects and 25 subdialects, a distribution that highlights the remarkable degree of variation within Basque, despite its comparatively small geographic area. This classification has been considered canonical until a recent Basque dialectology work by 24 , which established an extensive and comprehensive categorization of five Basque dialects, and provided a broad archive of the most representative features of each variation. This paper will adopt the dialectal classification proposed by 24 , distinguishing the following Basque dialects: Western, Central, Navarrese, Navarrese-Lapurdian and Zuberoan. For the purposes of this work, the Navarrese-Lapurdian and Zuberoan dialects will additionally be referred to as Northern dialects. A map illustrating this classification by 24 is provided in the Appendix. Basque Standardization While extensive dialectal diversity may constitute a source of linguistic richness, it can also increase the risk of language endangerment. This concern led many Basque linguists to push for the necessity of a standard variation ( 13 ) . The process for the creation of a standard variation was a lengthy one. Many meetings were held by contemporary linguists, until Koldo Mitxelena’s proposal in the 60s. He suggested using the Central dialects as the foundation of the Standard, mainly due to its practicality: it was the dialect with the most literary prestige to date, as well as being understandable by all Basque speakers. This proposal was discussed, modified, and accepted in the Congress of Arantzazu in 1968 ( 13 ) . The emergence of the standard variety was followed by growing movements to preserve and revitalize dialects.

Read the complete text