Advancing Uto-Aztecan Language Technologies: A Case Study on the Endangered Comanche Language

Jesus Alvarez C, Daua D. Karajeanes, Ashley Celeste Prado, John Ruttan · 2025

Read Advancing Uto-Aztecan Language Technologies: A Case Study on the Endangered Comanche Language by Jesus Alvarez C, Daua D. Karajeanes, Ashley Celeste Prado, John Ruttan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18159.txt.

Introduction

Jesus Alvarez and a team of co-authors bring language technology to Comanche, an endangered Uto-Aztecan language. Their twenty twenty-five paper calls this the first computational study of Comanche, a language near extinction. Without digital tools, such languages are shut out of research and revival work.

The team hand-built a set of four hundred twelve phrases and a pipeline to make more data. They tested two GPT-4o models on language identification. With no examples, the models did poorly on Comanche. With just five examples in the prompt, accuracy rose to near perfect. The moral is that small, community-led steps can put a language on the digital map.

Catalog record

CREATORJesus Alvarez C, Daua D. Karajeanes, Ashley Celeste Prado, John Ruttan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-18159

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Advancing Uto-Aztecan Language Technologies: A Case Study on the Endangered Comanche Language Jesus Alvarez C, Daua D. Karajeanes, Ashley Celeste Prado, John Ruttan Abstract The digital exclusion of endangered languages remains a critical challenge in NLP, limiting both linguistic research and revitalization efforts. This study introduces the first computational investigation of Comanche, an Uto-Aztecan language on the verge of extinction, demonstrating how minimal-cost, community-informed NLP interventions can support language preservation. We present a manually curated dataset of 412 phrases, a synthetic data generation pipeline, and an empirical evaluation of GPT-4o and GPT-4o-mini for language identification. Our experiments reveal that while LLMs struggle with Comanche in zero-shot settings, few-shot prompting significantly improves performance, achieving near-perfect accuracy with just five examples. Our findings highlight the potential of targeted NLP methodologies in low-resource contexts and emphasize that visibility is the first step toward inclusion. By establishing a foundation for Comanche in NLP, we advocate for computational approaches that prioritize accessibility, cultural sensitivity, and community engagement. † † Contact other authors at: [email protected], [email protected], [email protected], [email protected], [email protected], [email protected] 1 Introduction The decline of endangered languages represents not only a linguistic loss Low et al. 2022 but also the erosion of invaluable cultural, historical, and ecological knowledge Tulloch 2006 ; Cámara-Leret and Bascompte 2021 ; Sallabank and Austin 2023 . Despite growing advancements in language technology, computational efforts overwhelmingly favor widely spoken languages, leaving endangered languages largely unsupported Meighan 2021 ; Yang et al. 2025a ; Jerpelea et al. 2025 . Over 88% of the world’s languages have minimal to no representation in mainstream language technologies, exacerbating their digital marginalization Rangel 2019 . This exclusion hinders linguistic research and deepens the digital divide Valijärvi and Kahn 2023 ; Yang et al. 2025b , complicating preservation and revitalization efforts. Among these, Comanche, an Uto-Aztecan language, faces imminent extinction, with fewer than 50 fluent speakers remaining Chaika et al. 2024 . Figure 1: Stylized overview of our exploration of NLP applications for the endangered Comanche language. We present a case study on the Comanche language, demonstrating that with minimal cost and computational resources, it is possible to achieve what large corporations and academic institutions have largely neglected. As shown in Figure 1 , we contribute (1) a manually curated dataset, (2) synthetic data generation pipeline for resource expansion, and (3) an empirical evaluation of GPT-4o and GPT-4o-mini in zero-shot and few-shot language identification. Our findings highlight the potential of large language models (LLMs) in low-resource settings, offering insights into their applicability for endangered language preservation. This work marks the first-ever introduction of Comanche into the NLP domain, laying groundwork for future research and linguistic equity . 2 Related Work Efforts to preserve endangered languages, particularly Native American languages, date back to at least the early 20th century Charney 1993 , with early approaches relying heavily on linguistic documentation and literary preservation Schwartz and Dobrin 2016 . While these foundational efforts paved the way, they were hindered by the scarcity of available datasets and standardized benchmarks, leading researchers to explore alternative strategies for text processing Lorenzo et al. 2024 ; Spencer and Kongborrirak 2025 . Despite these advancements, modern computational linguistics continues to face significant challenges when working with polysynthetic languages such as Comanche and Apache, due to their intricate orthographic and morphological structures Kelly 2020 . In recent years there have been promising community-led revitalization initiatives, including immersive education programs, digital archives, and collaborations with computational linguists of Indian Affairs 2023 ; Schwartz et al. 2021 . Data scarcity remains a fundamental challenge in NLP Glaser et al. 2021 . Unlike widely spoken languages with abundant corpora, low-resource languages lack annotated datasets, limiting the effectiveness of LLMs for preservation Zhong et al. 2024 ; Dinh et al. 2024 . Few-shot prompting has emerged as a promising solution, allowing LLMs to generate synthetic data from minimal examples Zhang et al. 2021 , though its success hinges on data quality. Transfer learning Adimulam et al. 2022 has also been explored to improve low-resource NLP, but without robust evaluation frameworks tailored for Indigenous languages Shu et al. 2024 , achieving meaningful generalization remains a challenge Mager et al. 2023 . Figure 2: Family tree for Uto-Aztecan Languages, with Comanche highlighted. Figure 3: Data pipeline. 3 Native American Language Landscape The linguistic diversity of Native American languages is vast, spanning multiple language families with distinct phonetic, morphological, and syntactic properties. Despite this richness, many of these languages are critically endangered, with fluency declining due to historical policies of forced assimilation, boarding schools, and sociopolitical marginalization Krauss 1992 . Language documentation efforts have attempted to counteract this loss, but computational resources remain scarce, and mainstream NLP models are ill-equipped to process these languages effectively Blasi et al. 2022 . The lack of digital resources further exacerbates the challenge, preventing these languages from benefiting from advances in language technologies U.S. Department of the Interior 2022 . Comanche belongs to the Uto-Aztecan language family, one of the largest language families in the Americas, encompassing over 60 languages spoken across the western United States, Mexico, and Central America Opler 1943 . While some Uto-Aztecan languages, such as Nahuatl Andrews 2003 , have relatively larger speaker populations and a degree of digital presence, others, including Comanche, face imminent extinction. As shown in Figure 2 , Comanche developed as a distinct language after diverging from Shoshone in the 18th century, evolving unique phonological and lexical features Casagrande 1955 . Today, with fewer than 50 fluent speakers, Comanche lacks sufficient linguistic resources for computational modeling. 4 Data 4.1 Manual Data Collection To construct a foundational dataset for Comanche, we conducted a systematic review of linguistic resources, including academic literature, digital archives, and historical records. Given the scarcity of publicly available corpora, we aggregated and curated data from 15 distinct domains (Appendix B ), ensuring consistency through transcription and standardization. To enhance data reliability, we cross-referenced linguistic materials with community-driven documentation efforts, validating authenticity and linguistic accuracy. This structured dataset of 412 Comanche phrases, the first digitalized dataset of its kind, serves as a crucial resource for both language preservation and computational linguistic research in Comanche. 4.2 Synthetic Data Generation Given the extreme scarcity of parallel Comanche–English text, we leveraged few-shot prompting with GPT-4o to generate synthetic translations. Using a manually curated dataset of 100 Comanche–English sentence pairs, we split the data into an 80% training set and a 20% test set. During training, GPT-4o was provided examples from the training subset and then prompted to generate translations for the test set (Appendix ). The generated outputs were evaluated using normalized Levenshtein similarity, ensuring a minimum quality threshold of 0.1 1 1 1 Given that Comanche has never been explored in NLP, we set a baseline threshold of 0.1 due to the difficulty of the task. As the pipeline matures, we will refine our evaluation criteria and increase the required similarity score. before incorporation into the dataset. This controlled expansion strategy maintained linguistic integrity while demonstrating that even minimal data can be effectively leveraged to create valuable resources for endangered language NLP. While the pipeline shown in Figure 3 is in early stage, it underscores the potential of leveraging NLP for endangered language documentation and expansion. As data scarcity

Read the complete text