Is It Navajo? Accurate Language Detection in Endangered Athabaskan Languages
Ivory Yang, Weicheng Ma, Chunhui Zhang, Soroush Vosoughi · 2025
Read Is It Navajo? Accurate Language Detection in Endangered Athabaskan Languages by Ivory Yang, Weicheng Ma, Chunhui Zhang, Soroush Vosoughi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-15773.txt.
Introduction
Ivory Yang, Weicheng Ma, Chunhui Zhang, and Soroush Vosoughi build a tool to spot Navajo text, in a paper from 2025. Navajo is the most widely spoken Native American language, yet big tech language tools barely support it. Google's language identifier, for one, covers no Native American language at all and often guesses wrong on Navajo samples.
The team trained a simple random forest sorter on Navajo plus the twenty languages the Google tool most often suggests by mistake. Despite its simple build, the sorter scored near perfect accuracy. It also held up on other languages of the same family, spoken in Alaska, the Pacific Northwest, and the Southwest. The authors argue that language tools should be built for diversity, not only for the largest tongues.
Catalog record
| CREATOR | Ivory Yang, Weicheng Ma, Chunhui Zhang, Soroush Vosoughi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-15773
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Is It Navajo? Accurate Language Detection in Endangered Athabaskan Languages Ivory Yang, Weicheng Ma, Chunhui Zhang, Soroush Vosoughi Abstract Endangered languages, such as Navajo—the most widely spoken Native American language—are significantly underrepresented in contemporary language technologies, exacerbating the challenges of their preservation and revitalization. This study evaluates Google’s Language Identification (LangID) tool, which does not currently support any Native American languages. To address this, we introduce a random forest classifier trained on Navajo and twenty erroneously suggested languages by LangID. Despite its simplicity, the classifier achieves near-perfect accuracy (97-100%). Additionally, the model demonstrates robustness across other Athabaskan languages—a family of Native American languages spoken primarily in Alaska, the Pacific Northwest, and parts of the Southwestern United States—suggesting its potential for broader application. Our findings underscore the pressing need for NLP systems that prioritize linguistic diversity and adaptability over centralized, one-size-fits-all solutions, especially in supporting underrepresented languages in a multicultural world. This work directly contributes to ongoing efforts to address cultural biases in language models and advocates for the development of culturally localized NLP tools that serve diverse linguistic communities. 1 Introduction The urgency of preserving endangered languages is not merely a linguistic issue but one deeply connected to the preservation of cultural, historical, and ecological knowledge Tulloch 2006 ; Zariquiey et al. 2022 ; Zhang et al. 2022 ; Cusenza and Çöltekin 2024 ; Yang et al. 2025 . These languages reflect the intellectual heritage of diverse communities, playing a critical role in maintaining global cultural diversity. Yet, despite this significance, the development of language technologies has been disproportionately focused on languages with large speaker bases and economic clout, leaving languages with smaller populations—such as Native American languages—largely unsupported. This study centers on Navajo, the most widely spoken Native American language Dietrich et al. 2022 , which remains unsupported by commercial language technologies like Google’s Language Identification (LangID) tool Caswell et al. 2020 . The lack of comprehensive linguistic datasets and dedicated tools impedes both language preservation and learning efforts Shamsfard 2019 . This technological gap is even more pronounced for other Native American languages, many of which are on the verge of extinction due to minimal technological integration and educational resources Meredith 2013 ; Flavelle and Lachler 2023 . Figure 1: Google’s LangID does not currently support any Native American languages, including Navajo and other Athabaskan languages. Our model addresses these challenges effectively. Google LangID’s performance on the Navajo 10k dataset Goldhahn et al. 2012 revealed complete misidentification of Navajo sentences as unrelated languages, an expected outcome given that LangID does not currently support any Native American language. In response, we developed a language identification model tailored to accurately distinguish Navajo from languages erroneously suggested by LangID, achieving near-perfect accuracy. This success illustrates that low-resource languages, often overlooked by major technological platforms, can be effectively supported with targeted approaches and resources. Beyond Navajo, we extended our model to other languages in the Athabaskan family —including Western Apache, Mescalero Apache, Jicarilla Apache, and Lipan Apache George and Lopraisová . Our model’s robustness across these related languages underscores its potential applicability across broader linguistic groups (see Figure 1 ). This suggests a viable path for NLP technologies to not only support individual endangered languages but to facilitate revitalization efforts across entire language families. We highlight how centralization in language technology disproportionately benefits global languages, often sidelining underrepresented languages and thus contributing to the erosion of linguistic diversity Schneider 2022 . Our findings underscore the feasibility of creating decentralized, robust language identification tools, which, by focusing on the unique needs of specific languages, can play a significant role in preserving endangered languages. Furthermore, it offers promising pathways for leveraging NLP tools across culturally and linguistically related groups, enriching both academic research and community-driven language revitalization by fostering tools that are responsive to the specific needs of these communities. This aligns with the broader goal of developing NLP technologies that not only accommodate but also actively support the linguistic and cultural diversity of our vibrant multicultural world. 2 Background While there exist studies on endangered languages Zariquiey et al. 2022 ; Zhang et al. 2022 ; Cusenza and Çöltekin 2024 , their integration into business technologies remains insufficient. For example, although Google’s LangID supports over a hundred languages, it fails to include any Native American language, and so provides completely inaccurate suggestions when encountering Navajo. Similarly, advanced NLP models, such as ChatGPT, struggle with Navajo due to a lack of training data, which is predominantly derived from more widely spoken languages Hangya et al. 2022 . The scarcity of digital resources for Navajo further compounds these challenges, as it lacks sufficient digital presence needed for effective NLP tool development Magueresse et al. 2020 . This scarcity not only limits the use of standard NLP methodologies but also hampers preservation and revitalization efforts. These issues reflect broader market-driven priorities in language technology, which overlook less commercially viable languages Costa-jussà et al. 2022 , creating significant barriers to preserving cultural heritage and emphasizing the need for more inclusive technological support for endangered languages Todacheeny 2014 . 3 Identification for NatAm Languages Figure 2: Visual representation of some erroneously suggested languages by Google LangID, along with their frequency counts. The benefits of Native American language identification are twofold: to bolster the development of linguistic tools tailored to these languages, and to aid in their preservation and revitalization Mohanty et al. 2023 . Effective identification is foundational for creating technologies that understand and process these languages, addressing the significant digital divide in language technology support Mohanty et al. 2024 . Our evaluation aims at a detailed assessment of the models’ capability to accurately recognize and differentiate between Native American languages and others. By understanding the strengths and limitations of our models, we can refine our techniques to better serve the needs of Native American language communities. 3.1 Benchmark Construction To construct our dataset for evaluating language identification models, we used two distinct approaches to account for diversity and specificity. The first dataset was formed based on twenty languages 1 1 1 The languages are Icelandic, Lingala, Wolof, Czech, Polish, Manx, Fulah, Yoruba, Portuguese, Somali, Slovak, Tsonga, Spanish, Oromo, Indonesian, Igbo, Northern Sami, Irish, Arabic and English. that Google’s LangID misidentifies as when presented with Navajo sentences, with their distribution shown in Figure 2 . Each entry consists of 1k or 10k sentences extracted from the Leipzig corpora Goldhahn et al. 2012 , ensuring standardization against the Navajo 10k dataset in terms of linguistic features and contexts. The second dataset focuses on languages from the Athabaskan family, which are linguistically related to Navajo, including Western Apache, Mescalero Apache, Jicarilla Apache, and Lipan Apache Saxon 2023 . A sample of aligned words across these languages are included in Appendix A . To compile this dataset, we curated a limited sample of texts contributed by native speakers and language preservation organizations. Specifically, we collected texts in Western Apache Glosbe 2024 , Mescalero Apache Library 2024 , Jicarilla Apache Wikipedia 2024 , and Lipan Apache Indians.org 2024 . These curated texts not only enrich the model’s exposure to authentic linguistic scenarios but also enable the evaluation of its ability to discern subtle linguistic nuances among closely related languages, thereby enhancing the