Towards Style Alignment in Cross-Cultural Translation

Shreya Havaldar, Adam Stein, Eric Wong, & Lyle UngarUniversity of Pennsylvania {shreyah,steinad,exwong,ungar}@seas.upenn.edu · 2025

Read Towards Style Alignment in Cross-Cultural Translation by Shreya Havaldar, Adam Stein, Eric Wong, & Lyle UngarUniversity of Pennsylvania {shreyah,steinad,exwong,ungar}@seas.upenn.edu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-00216.txt.

Introduction

Shreya Havaldar and co-authors tackle this 2025 failure of machine translation: style gets lost between cultures. A polite request in one language can land as blunt in another, because models flatten tone toward neutrality and handle non-Western languages worse. The team first characterizes how language models mistranslate style across cultures.

Their remedy, RASTA, retrieves examples that teach the model the target culture's communication norms, nudging the output's style to match the speaker's intent. The method uses learned stylistic concepts rather than retraining. The work matters wherever translation carries social weight, from customer care to diplomacy, and it names neutrality itself as a distortion, not a safe default.

Catalog record

CREATORShreya Havaldar, Adam Stein, Eric Wong, & Lyle UngarUniversity of Pennsylvania {shreyah,steinad,exwong,ungar}@seas.upenn.edu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-00216

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Towards Style Alignment in Cross-Cultural Translation Shreya Havaldar, Adam Stein, Eric Wong, & Lyle UngarUniversity of Pennsylvania {shreyah,steinad,exwong,ungar}@seas.upenn.edu Abstract Successful communication depends on the speaker’s intended style (i.e., what the speaker is trying to convey) aligning with the listener’s interpreted style (i.e., what the listener perceives). However, cultural differences often lead to misalignment between the two; for example, politeness is often lost in translation. We characterize the ways that LLMs fail to translate style --- biasing translations towards neutrality and performing worse in non-Western languages. We mitigate these failures with RASTA (Retrieval-Augmented STylistic Alignment), a method that leverages learned stylistic concepts to encourage LLM translation to appropriately convey cultural communication norms and align style. † † ∗ Equal contribution 1 1 1 Code, data, & prompts available at https://github.com/shreyahavaldar/style_alignment 1 Introduction People from different cultural backgrounds must interact as our world grows more interconnected. Machine translation helps promote such intercultural dialogue Shadiev and Huang 2016 ; Khasawneh 2023 , as shown in Figure 1 , with LLMs being increasingly adopted to facilitate translation ( Albarino 2024 ) . These models bridge the linguistic gap that may arise during communication; however, another important gap to address is the cultural gap Hershcovich et al. 2022 . Domains like healthcare and education benefit greatly from shared knowledge Lee 2023 ; however, communication practices differ across cultures Schouten and Meeuwesen 2006 ; Hofstede 1986 . These differences introduce unique challenges to cross-cultural communication Moorjani and Field 1988 . For instance, statements that are helpful and appropriate in one culture could be interpreted as critical in another Hall 1976 . Successful communication relies on a speaker’s intended style to align with a listener’s interpreted style 2 2 2 Linguistic style reflects the systematic variation in linguistic choices across different contexts and speakers, i.e. features of grammar and vocabulary that signal social identity, attitude, and communicative intent Biber and Conrad 2009 . Thomas 1983 ; Tannen 1983 . However, cultural differences in individuals’ thoughts and actions Lehman et al. 2004 can lead to a mismatch of such intent and interpretation, so, to successfully bridge the cultural gap, LLMs must translate style along with content (i.e. the literal meaning). In this work, we analyze and mitigate translation errors arising from this cultural gap. We focus on style, a key component of communication, and find that modern LLMs often destroy style during translation Kajava et al. 2020 ; Troiano et al. 2020 . Figure 1: An example of cross-cultural communication facilitated by an LLM. User 1 (American) intends to be polite, but User 2 (Japanese) interprets the message as slightly impolite, given Japanese cultural norms don’t typically condone calling a professor by their first name. Figure 2: Evaluating how translation affects style. We first select a multilingual style corpus (e.g. the Holistic Politeness Corpus from Havaldar et al. 2023 ) annotated by native speakers from corresponding cultures. We then train separate style quantifiers for each language using text annotated by native speakers. Using these style quantifiers to label the style of the translated text, we can measure how well style is preserved during translation. For instance, in Figure 1 , an American (User 1) refers to her professor by his first name. User 1 intends to be polite, and the LLM facilitating the interaction translates the message’s content. However, when the Japanese listener (User 2) reads the message, she interprets it as impolite, given that Japanese cultural norms discourage referring to professors by their first names. In this work, we characterize failures in style alignment of LLMs. To mitigate these failures, we develop a method where we learn stylistic concepts and leverage available native text to align style during translation without degrading translation quality. Our contributions are as follows: • We introduce style alignment as a goal for cross-cultural translation. • Using a variety of datasets and LLMs, we characterize the following style alignment failures: 1. LLMs struggle to translate style, and perform worse in non-Western languages. 2. LLMs bias translations towards a neutral style, reducing real-world variance. 3. Current translation metrics poorly reflect style alignment. • We present RASTA (Retrieval-Augmented STylistic Alignment), a method to preserve style during translation , generating translations preferred by bilingual speakers. 2 Designing a Metric for Style Alignment In a world where translation models perfectly take into account cultural differences in style, a text’s intended style in Language \mathcal{L}_{1} should match the translated text’s interpreted style in language \mathcal{L}_{2} . Figure 3: How well do LLMs align style during translation? We show \mathcal{A}(\mathcal{L}_{1},\mathcal{L}_{2}) for today’s top LLMs, averaged across language pairs. Google Translate is the best at this task, but all models are far from perfect. English Examples Label (0-1) Politeness This has already been debated to death. 0.024 Oh I believe this was already debated! 0.465 Intimacy Happy New Year! 0.372 Happy new year!!!! Love u 0.681 Formality uh, can i have more details pls? 0.044 Could you provide more details, please? 0.989 Table 1: Examples of text with the same content, but different style labels from our three style datasets. Using this assumption, we quantify the degree of style alignment, \mathcal{A} , by measuring the difference between the style of a text in language \mathcal{L}_{1} and the style of the same text translated to language \mathcal{L}_{2} . For example, we can train two style quantifiers for languages \mathcal{L}_{1} and \mathcal{L}_{2} , which output a number between 0 and 1 , measuring the degree of style expressed in an input text. Formally, our style quantifiers are mappings, \mathcal{C}_{1}:\mathcal{L}_{1}\rightarrow[0,1] and \mathcal{C}_{2}:\mathcal{L}_{2}\rightarrow[0,1] . Then, given a text x , a translator T:\mathcal{L}_{1}\rightarrow\mathcal{L}_{2} should ideally satisfy: \forall x\in\mathcal{L}_{1},\mathcal{C}_{1}(x)=\mathcal{C}_{2}(T(x)). (1) Since this strict equality is unlikely to hold in practice, we measure the extent to which this holds by calculating a style alignment score \mathcal{A} , i.e. the product-moment correlation between the style of the original and translated text. The style alignment score \mathcal{A} of a corpus X translated from \mathcal{L}_{1} into \mathcal{L}_{2} is calculated as follows: \mathcal{A}(\mathcal{L}_{1},\mathcal{L}_{2})=r\left(\mathcal{C}_{1}\left(X_{\mathcal{L}_{1}}\right),\mathcal{C}_{2}\left(T\left(X_{\mathcal{L}_{1}}\right)\right)\right) (2) This value measures how well the intended style of a speaker in language \mathcal{L}_{1} matches the interpretation of a listener in language \mathcal{L}_{2} . 2.1 Selecting Style Datasets In additional to an alignment metric, we also require data. Specifically, we require style datasets that span multiple languages , and are annotated by native speakers . We select three open source datasets meeting these criteria: 1. The Holistic Politeness Dataset Havaldar et al. 2023 , containing Wikipedia editor interactions annotated for politeness in English, Spanish, Japanese, and Chinese. 2. Multilingual Tweet Intimacy 3 3 3 Intimacy refers to whether a text is a communication between strangers vs. people who are emotionally close. Pei et al. 2023 , containing Facebook posts annotated for intimacy in English, Spanish, Brazilian-Portuguese, Italian, French, and Chinese. 3. GYAFC Rao and Tetreault 2018 and XFORMAL Briakou et al. 2021 , containing Yahoo Answers annotated for formality in English, Brazilian-Portuguese, French, and Italian. Given these datasets contain samples from different languages in the same domain , there is minimal difference between the distribution of translated text and native speaker text. Additional statistics for these three datasets are provided in Table A3 . 2.2 Training Style Quantifiers Automatically measuring intended and interpreted style requires reliable

Read the complete text