The Cultural Gene of Large Language Models: A Study on the Impact of Cross-Corpus Training on Model Values and Biases

Emanuel Z. Fenech-Borg, Tilen P. Meznaric-Kos, Milica D. Lekovic-Bojovic, Arni J. Hentze-Djurhuus · 2025

Read The Cultural Gene of Large Language Models: A Study on the Impact of Cross-Corpus Training on Model Values and Biases by Emanuel Z. Fenech-Borg, Tilen P. Meznaric-Kos, Milica D. Lekovic-Bojovic, Arni J. Hentze-Djurhuus (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-12411.txt.

Introduction

Chat models carry the values of the texts they were fed, and those values may differ by culture. Emanuel Z Fenech-Borg and co-authors test that idea in a 2025 study. They call the inherited lean a cultural gene. Two hundred prompts probed two classic axes: how much a culture prizes the lone person versus the group, and how it views rank and power.

A Western-trained model and an Eastern-trained model answered the same prompts. Human judges scored the replies, and the two models split in a steady way. One leaned lone-person and low-rank; the other leaned group-first and rank-respecting. Scores against national culture data matched each model's home region. Story cases showed the leans at work in hard choices.

Catalog record

CREATOREmanuel Z. Fenech-Borg, Tilen P. Meznaric-Kos, Milica D. Lekovic-Bojovic, Arni J. Hentze-Djurhuus
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-12411

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Cultural Gene of Large Language Models: A Study on the Impact of Cross-Corpus Training on Model Values and Biases Emanuel Z. Fenech-Borg, Tilen P. Meznaric-Kos, Milica D. Lekovic-Bojovic, Arni J. Hentze-Djurhuus Abstract Large Language Models (LLMs) are being deployed globally, yet their underlying cultural and ethical assumptions remain underexplored. This paper investigates the concept of "cultural genes"—systematic value orientations that LLMs inherit from their training corpora. We introduce a novel methodology centered on a Cultural Probe Dataset (CPD) designed to evaluate models along key cross-cultural psychological dimensions, specifically Individualism-Collectivism (IDV) and Power Distance (PDI). Through a large-scale comparative study of a Western-centric model (GPT-4) and an Eastern-centric model (ERNIE Bot), we present robust quantitative and qualitative evidence of significant cultural divergence. Our results show that each model’s reasoning and value judgments are statistically aligned with the dominant cultural norms of its training data’s origin. For instance, GPT-4 exhibited a strong individualistic (IDV Score: 1.21) and low-power-distance (PDI Score: -1.05) orientation, closely mirroring its high Cultural Alignment Index (CAI) with the USA (0.91 IDV, 0.88 PDI). Conversely, ERNIE Bot demonstrated a collectivistic (-0.89 IDV) and high-power-distance (0.76 PDI) alignment, correlating strongly with Chinese cultural metrics (0.85 IDV CAI, 0.81 PDI CAI). These findings, supported by qualitative case studies, demonstrate that LLMs function as statistical mirrors of their cultural corpora. We discuss the profound implications of these findings for global AI ethics, fairness, and the critical need for developing culturally-aware AI systems to prevent the perpetuation of algorithmic cultural hegemony. I Introduction The recent proliferation of Large Language Models (LLMs) represents a paradigm shift in artificial intelligence, with systems demonstrating remarkable capabilities in understanding, generating, and interacting with [ 1 , 2 ] human language . This technological leap has catalyzed the integration of AI into the very fabric of our digital and physical lives. AI systems now optimize complex, heterogeneous edge networks through novel strategies like experience-driven model migration [ 3 ] , and they enhance the efficiency of federated learning via sophisticated neural architecture searches . The reach of AI extends even into our physical environment, with novel sensing technologies leveraging commodity WiFi for applications ranging from gesture recognition [ 2 ] and anti-interference activity detection [ 4 , 5 , 6 ] to unobtrusive emotion recognition [ 7 , 8 ] and even respiratory healthcare monitoring [ 9 , 10 ] . This pervasive integration underscores the profound impact of modern machine learning, built upon powerful techniques like contrastive learning [ 11 , 12 , 13 ] and efficient model compression [ 14 ] . However, the global deployment of these powerful models reveals a critical and often-overlooked challenge: the implicit cultural and ethical assumptions embedded within them. The discourse surrounding AI safety has rightfully focused on aligning models with human values [ 15 ] and mitigating their potential for harm [ 16 ] . Yet, this conversation frequently presumes a monolithic set of "human values," which often defaults to a Western, English-centric perspective [ 17 , 18 ] . As Bender et al. famously warned, LLMs can act as "stochastic parrots," mindlessly reflecting the statistical patterns of their vast training data [ 19 ] . This reflection is not neutral; it carries with it the biases, stereotypes, and worldview of the dominant culture within the data. The problem thus transcends simple gender or racial biases, which have been well-documented in word embeddings [ 20 ] and sentence encoders [ 21 ] , and extends to the very foundation of how models perceive and interpret the world. This paper posits that LLMs trained on culturally-specific corpora inherit what we term a "cultural gene"—a deeply embedded, systematic tendency to reason and respond in ways that align with the values and norms of that culture. This concept moves beyond surface-level biases in language generation [ 22 ] or the presence of stereotypes [ 23 ] , and instead seeks to uncover the foundational worldview imprinted upon the model. The foundational work of Hofstede on cultural dimensions provides a powerful framework for conceptualizing these differences, such as the spectrum between individualism and collectivism or variations in power distance [ 24 , 25 ] . Recent work has begun to probe these dimensions, asking whether models possess cultural intelligence [ 26 ] or how they represent knowledge from different cultures [ 27 ] , but a systematic methodology for quantifying these ingrained "genes" is still nascent. The challenge is immense, as these models are increasingly tasked with sensitive roles in domains like facial expression recognition, where cultural display rules are paramount and label noise can be a significant confounder [ 28 , 29 ] . The stakes of failing to address this challenge are substantial. Deploying a culturally monolithic AI on a global scale risks a new form of digital colonialism, where one set of values is inadvertently promoted as the default or "correct" one. This can lead to misunderstandings, perpetuate harmful stereotypes [ 30 ] , and create systems that are ineffective or even offensive in different cultural contexts. The problem is exacerbated in multimodal systems, where visual and linguistic cues are intertwined, such as in visual dialog [ 31 ] or video grounding , and in security applications where understanding human behavior is key, from recognizing micro-actions [ 32 , 33 ] to detecting malicious intent in side-channel attacks [ 34 , 35 ] or against authentication protocols [ 36 , 37 ] . Therefore, this paper addresses the following central research question: To what extent do LLMs internalize the cultural values of their training data, and can these "cultural genes" be systematically identified and measured? To answer this, we undertake a large-scale comparative study. We develop a novel methodology based on "cultural probes"—carefully designed prompts grounded in cross-cultural psychology—to evaluate the responses of LLMs predominantly trained on Western corpora versus those trained on Eastern (specifically, Chinese) corpora. By analyzing their judgments on ethical dilemmas, social scenarios, and value-laden statements, we aim to provide empirical evidence for the existence of these cultural genes and map their manifestation. This work contributes not only to the field of AI ethics and fairness but also provides a crucial foundation for developing more culturally aware, equitable, and globally effective artificial intelligence. II Related Work Our research is situated at the intersection of several rapidly evolving fields: bias and fairness in AI, cross-cultural Natural Language Processing (NLP), model interpretability, and value alignment. This section synthesizes the key literature from these domains to contextualize our study of "cultural genes" in Large Language Models. II-A Bias and Fairness in Language Models The study of bias in language models is a well-established field, initially gaining prominence with seminal work demonstrating how static word embeddings absorb societal biases, such as associating specific genders with certain professions [ 20 ] . This line of inquiry quickly expanded beyond static embeddings to analyze biases in generative models, showing how models can produce text that reinforces harmful stereotypes [ 22 ] . Methodologies were developed to measure these biases not just at the word level but also within sentence encoders [ 21 ] , leading to the creation of comprehensive benchmarks like StereoSet for quantifying stereotypical associations [ 23 ] . However,

Read the complete text