Smotrom tvoja på ander drogoj verden! Resurrecting Dead Pidgin with Generative Models: Russenorsk Case Study

Alexey Tikhonov, Sergei Shteiner, Anna Bykova, Ivan P. Yamshchikov · 2025

Read Smotrom tvoja på ander drogoj verden! Resurrecting Dead Pidgin with Generative Models: Russenorsk Case Study by Alexey Tikhonov, Sergei Shteiner, Anna Bykova, Ivan P. Yamshchikov (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-11065.txt.

Introduction

Alexey Tikhonov and co-authors use large language models to study Russenorsk, a dead trade pidgin once spoken between Russians and Norwegians. Their 2025 paper builds on the few literary sources that preserve the language. From those texts the team assembled a structured dictionary, sorted by synonyms and word origins.

The models then guessed rules for how Russenorsk formed words and sentences. Several of those guesses matched what scholars had proposed long before. The team also built a translation agent that renders modern Russian and Norwegian texts into plausible Russenorsk. The work shows how generative models can test ideas about languages that no one speaks anymore.

Catalog record

CREATORAlexey Tikhonov, Sergei Shteiner, Anna Bykova, Ivan P. Yamshchikov
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-11065

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Smotrom tvoja på ander drogoj verden! Resurrecting Dead Pidgin with Generative Models: Russenorsk Case Study Alexey Tikhonov, Sergei Shteiner, Anna Bykova, Ivan P. Yamshchikov Abstract Russenorsk, a pidgin language historically used in trade interactions between Russian and Norwegian speakers, represents a unique linguistic phenomenon. In this paper, we attempt to analyze its lexicon using modern large language models (LLMs) 1 1 1 We used anthropic/claude-3-5-sonnet-20241022 and openai/o1-2024-12-17 , based on surviving literary sources. We construct a structured dictionary of the language, grouped by synonyms and word origins. Subsequently, we use this dictionary to formulate hypotheses about the core principles of word formation and grammatical structure in Russenorsk and show which hypotheses generated by large language models correspond to the hypotheses previously proposed ones in the academic literature. We also develop a “reconstruction” translation agent that generates hypothetical Russenorsk renderings of contemporary Russian and Norwegian texts. 1 Introduction This paper is part of a relatively recent trend to use Large Language Models (LLMs) for scientific discovery in various research areas, demonstrating that these natural language processing models have unprecedented generalization capacity. To our knowledge, this is the first result that demonstrates how large language models could be effectively used in a study of dead contact languages. We first provide a brief overview of LLM-driven scientific discovery and then dive deeper into Russenorsk and its properties. 1.1 LLMs in Scientific Discovery Natural language processing methods could inform various research hypotheses in a very broad collection of research fields, be it biochemistry Ferruz et al. 2022 , human psychology Safdari et al. 2023 ; Sorokovikova et al. 2024 , or even ancient history Yamshchikov et al. 2022 ; Riemenschneider and Frank 2023 ; Gorovaia et al. 2024 ; Schmidt et al. 2024 . Yet this trend is boosted with the arrival of the automated Scientific Discovery Agents Jansen et al. 2024 — AI-driven systems designed to autonomously conduct scientific research by generating hypotheses, designing and executing experiments, analyzing data, and formulating conclusions without human intervention. They are used in various fields, including mathematics Lightman et al. 2023 ; Dong et al. 2023 , social sciences Yang et al. 2023 , astronomy Nguyen et al. 2023 ; Ciucă et al. 2023 , and chemistry Jegorovė et al. 2023 . Notably, the 2024 Nobel Prize in Chemistry was awarded to David Baker, Demis Hassabis, and John Jumper for their groundbreaking work in computational protein design and protein structure prediction, highlighting the transformative impact of AI-driven methods in scientific discovery Jumper et al. 2021 . Large Language Models (LLMs) are increasingly being used to support scientific research, particularly in data analysis and hypothesis generation. In our case, we explore how LLM-based Automated Scientific Discovery Agents can assist in studying Russenorsk and gaining new insights into this historical contact language. 1.2 Russenorsk Russenorsk is a highly unusual pidgin. de la Fuente 2020 states that its two primary lexifiers, Russian and Norwegian, contributed to its lexicon in roughly equal measure. This makes Russenorsk stand out from other pidgins. This statement is echoed in Stern 2020 . Boldižarová 2021 concludes that "to understand the Russenorsk pidgin, some knowledge of the second lexifier is needed" and that "the Norwegian language skills are very beneficial but insufficient". At the same time one has to admit that we have very limited amount of sources documenting the pidgin, and depending on the choice of the analyzed documents, different researchers come to drastically different conclusions about the properties of Russenorsk. For example, Kortlandt-Leiden 2000 follows Broch and Jahr 1981 and concludes that "Russenorsk is a variant of Norwegian with an admixture of Russian foreigners’ talk and elements from the native language of the speaker". 1.3 Key Contributions This paper attempts to leverage large language models to analyze the structure of synonym formation in Russenorsk, as well as to understand the fundamental principles of phonetic and morphological transformations of words from Russian and Norwegian when incorporated into the Russenorsk lexicon. We present three key contributions aimed at advancing the study of Russenorsk and its broader linguistic implications: • Expanded Russenorsk Vocabulary; we introduce a newly compiled set of lexemes that extends the existing Russenorsk wordlist, offering both contemporary scholars and digital tools a more comprehensive lexical resource. This vocabulary captures variant forms and rare lexical items noted in historical sources and field observations. • Linguistic Discovery Assistant; building on this enriched lexicon, we propose a pipeline that automates critical steps in scientific inquiry—from dictionary-based feature extraction to the generation of hypotheses and preliminary translations. This framework enables researchers to rapidly test linguistic assumptions, compare usage across contexts, and refine their understanding of Russenorsk’s structural properties. • Translation Reconstruction for Extinct Languages; finally, this paper is a case study presenting how the above pipeline can support the reconstruction of translations in a contact language no longer spoken. By leveraging parallel text alignment and informed lexical matching, our method offers a systematic approach to retrieving and interpreting content in Russenorsk, thus shedding light on its historical usage and guiding similar efforts for other extinct or endangered languages. 2 New Russenorsk Vocabulary We present a new, extensive Russenorsk Vocabulary based on a variety of sources available in digital form. To compile a Russenorsk vocabulary, we began by extracting lemmas from two primary sources: the online repository at https://en.wiktionary.org/wiki/Category:Russenorsk_lemmas and digitized version of Broch and Jahr 1984 . This process yielded a CSV file with 691 entries. Each entry encompasses: 1. Russenorsk form (unique words or fixed expressions, potentially with variant spellings), 2. Cyrillic representation (if identified), 3. Translations in English/Norwegian/Russian , 4. Part-of-speech , 5. Comment (additional notes or observations), 6. Russenorsk example from the source text, 7. Norwegian translation of the same example, 8. Russian translation of the Norwegian example (manually refined from automatic translations), 9. Book page reference (if an example was found), 10. Link to relevant Wiktionary information, 11. IPA pronunciation (if available). After assembling the initial dictionary, we employed a pipeline (based on a Sonnet-driven system) to cluster entries with similar morphology, and subsequently grouped these by semantic proximity. This reformatting required manual review over several days to remove erroneous groupings and “hallucinated” entries. Finally, the cleaned dictionary was reviewed by additional collaborators, who discovered a few remaining mistakes that were subsequently corrected by hand. Figure 1 provides an example of a vocabulary entry. Full vocabulary is available online 2 2 2 https://github.com/altsoph/RusNor/blob/main/vocabulary/rusnor.v0.1.json . Figure 1: An example of a resulting vocabulary entry. 3 Linguistic Discovery Assistant Using the constructed vocabulary as input we developed a Linguistic Discovery Assistant. We propose a pipeline for hypothesis generation that leverages a large language model (LLM) as an exploratory tool for analyzing Russenorsk linguistic phenomena. 3.1 Agentic Pipeline Let us provide an overview of the core agentic steps here. We publish the prompts, the answers, the generate hypotheses and further material regarding to facilitate further work and reproducibility 3 3 3 https://github.com/altsoph/RusNor/ . (1) Lexicon and Origin Hypotheses. We first supply the LLM with our compiled Russenorsk dictionary (Section 2 ), prompting it to propose theories regarding the source language of each borrowed term. These requests explicitly ask the model to identify whether the etymon stems from Russian, Norwegian, or a third language. (2) Phonetics and Morphology.

Read the complete text