NüshuRescue: Revitalization of the Endangered Nüshu Language with AI

Ivory Yang, Weicheng Ma, Soroush Vosoughi · 2024

Read NüshuRescue: Revitalization of the Endangered Nüshu Language with AI by Ivory Yang, Weicheng Ma, Soroush Vosoughi (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-00218.txt.

Introduction

Ivory Yang, Weicheng Ma, and Soroush Vosoughi present a 2024 paper on using AI to revive Nüshu. The script was once written by Yao women in China to express themselves inside a patriarchal society. Like most endangered languages, Nüshu has almost no digital text to train on. The team built a framework that teaches large language models from very little.

They first hand-built a gold corpus of five hundred Nüshu-Chinese sentence pairs, the first public set of its kind. Feeding a model just thirty-five examples, the system translated half of held-out sentences correctly and produced a silver corpus of ninety-eight new translations. Smaller custom models round out the toolkit, which the authors offer as a template for other fading languages.

Catalog record

CREATORIvory Yang, Weicheng Ma, Soroush Vosoughi
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-00218

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

NüshuRescue: Revitalization of the Endangered Nüshu Language with AI Ivory Yang, Weicheng Ma, Soroush Vosoughi Abstract The preservation and revitalization of endangered and extinct languages is a meaningful endeavor, conserving cultural heritage while enriching fields like linguistics and anthropology. However, these languages are typically low-resource, making their reconstruction labor-intensive and costly. This challenge is exemplified by Nüshu, a rare script historically used by Yao women in China for self-expression within a patriarchal society. To address this challenge, we introduce NüshuRescue, an AI-driven framework designed to train large language models (LLMs) on endangered languages with minimal data. NüshuRescue automates evaluation and expands target corpora to accelerate linguistic revitalization. As a foundational component, we developed NCGold, a 500-sentence Nüshu-Chinese parallel corpus, the first publicly available dataset of its kind. Leveraging GPT-4-Turbo, with no prior exposure to Nüshu and only 35 short examples from NCGold, NüshuRescue achieved 48.69% translation accuracy on 50 withheld sentences and generated NCSilver, a set of 98 newly translated modern Chinese sentences of varying lengths. In addition, we developed FastText-based and Seq2Seq models to further support research on Nüshu. NüshuRescue provides a versatile and scalable tool for the revitalization of endangered languages, minimizing the need for extensive human input. All datasets and code have been made publicly available at https://github.com/ivoryayang/NushuRescue . Figure 1: A simplified, stylized rendition of the NüshuRescue generation framework, using samples from NCGold. 1 Introduction Nüshu is a unique syllabic script originating from the ethnic Yao women in Jiangyong County, Hunan Province, China Broussard 2008 ; Liu 2014 . This rare and historically significant script, often referred to as “women’s script” Wang 2020 , is the only written language in the world developed by and used exclusively by women Ann-Gee 2013 . In a past era of high female illiteracy, where women’s voices were largely suppressed Leung 2003 , Nüshu served as a private means of communication and form of female empowerment in a male-dominated society Liu 1997 . Today, Nüshu is an endangered language with very limited surviving documentation Luo et al. 2022 , making it a critical focus for linguistic preservation and revitalization efforts Liu 2018 . In the broader field of Natural Language Processing (NLP), low-resource languages like Nüshu present significant challenges, such as the scarcity of available data Magueresse et al. 2020 and the absence of established linguistic tools Joshi et al. 2019 ; Krasadakis et al. 2024 . The preservation of such languages is not only vital for maintaining linguistic diversity Gibbs 2002 ; Brenzinger and de Graaf 2009 , but also for safeguarding the cultural heritage Romaine 2007 and historical narratives Hale 1992 they encapsulate. To preserve the Nüshu language, this paper provides two main contributions: (1) NüshuRescue: A LLM-based data generation framework to construct or scale up text corpora for low-resource languages, using minimal human labor and without presuming any prior knowledge of the target languages. (2.1) NCGold: An expert-validated parallel corpus of 500 Nüshu-Chinese translation sentence pairs. (2.2) NCSilver: A parallel corpus of 98 Nüshu-Chinese translation sentence pairs generated through the NüshuRescue framework. Both NCGold and NCSilver are the first publicly available datasets of their kind. Through our experiments, we find that LLMs like GPT-4-Turbo demonstrate strong language learning capabilities, even for languages with limited prior exposure, allowing the NüshuRescue framework to effectively generate higher-quality text for truly resource-scarce languages. While human expertise remains crucial for annotating seed data and ensuring translation accuracy, NüshuRescue significantly reduces the amount of human labor required compared to fully manual data annotation. As such, we believe that our NüshuRescue framework, as shown in Figure 1 , offers a promising solution for the preservation and revitalization of endangered languages. 2 Related Work Nüshu has garnered renewed cultural interest in recent years Thurnell-Read et al. 2022 , especially after receiving international representation in the Hollywood production “Snow Flower and the Secret Fan” Dargis 2011 . However, existing linguistic work on Nüshu is limited; “A Compendium of Chinese Nüshu” Zhao 1992 1 1 1 The very first version of this book was published in 1992; we referenced the most recent e-book released in 2019. remains the only formal print publication with expert-validated translations. Chiu 2012 provided a new perspective in “Heroines of Jiangyong” by compiling Nüshu scripts alongside English translations of their Chinese counterparts. While this is one step removed from a direct Nüshu-to-English translation and lacks formal linguistic mapping, it is nonetheless valuable for introducing Nüshu to the English-speaking domain. There have been only tentative attempts to explore Nüshu within the NLP community. Tang et al. 2023 and Sun et al. 2023 proposed a two-part project combining research and art, where two AI agents trained on a Chinese-Nüshu dictionary collaborate to create a standard writing system for encoding Chinese, blending linguistic analysis with artistic interpretation. However, no publicly available digital dataset for Nüshu exists, and using NLP methods to analyze its syntax and semantics remains virtually unexplored. The only significant digitalization effort to date has been the creation of a Nüshu-Chinese Unicode dictionary Contributors , which remains a work in progress as it continues to be expanded and standardized. Figure 2: Comparison of mapped Chinese (logographic) and Nüshu (syllabic) characters for the word “ocean”. Efforts to document and preserve other under-resourced and endangered languages have been more thoroughly explored. A common challenge across endangered language preservation projects is the need to gather data at scale. One approach is the collection of text corpora through web crawling and data extraction, as demonstrated by de Jesus and Nunes 2024 for Tetun, a language of Timor-Leste. However, this method relies on the presence of online resources, which is not the case for Nüshu. Another approach, transcription, and human annotation is more costly and labor-intensive, as seen in efforts to preserve Yoruba, a West African language Fagbolu et al. 2015 . Given these constraints, it is crucial to combine human annotation efforts with AI and NLP tools, so as to advance Nüshu preservation in a cost-effective and scalable manner. 3 The Nüshu Language Nüshu is a writing system originally created and exclusively used by ethnic Yao women in rural China Bissessar 2013 , and therefore possesses internal linguistic and literary rules difficult for those outside the community to fully grasp. Nüshu emerged independently as a phonetic writing system, borrowing sounds from spoken Chinese (particularly the local dialect) and representing them using a syllabic system Zhao 2014 . Nüshu is syllabic , meaning it uses symbols to represent individual syllables in spoken language Silber 1995 . In contrast, Chinese is logographic , meaning it uses characters that represent words or morphemes, with each character typically corresponding to a meaning rather than a specific sound Tan et al. 2001 . For example, Figure 2 illustrates the Nüshu and Chinese characters for the word ‘‘ocean’’, shown on the left and right, respectively. In Chinese, the character for ‘‘ocean’’ is logographic and conveys the concept as a whole, with the ‘‘water radical’’ (the three strokes on the left of the word) indicating its connection to water. Removing the ‘‘water radical’’ changes the character’s meaning to ‘‘each’’ or ‘‘every’’, illustrating how radicals 2 2 2 In Chinese, radicals are the building blocks of Chinese characters, often used as a means to organize them

Read the complete text