We Politely Insist: Your LLM Must Learn the Persian Art of Taarof

Nikta Gohari Sadr, Sahar Heidariasl, Karine Megerdoomian , Laleh Seyyed-Kalantari and Ali Emami · 2025

Read We Politely Insist: Your LLM Must Learn the Persian Art of Taarof by Nikta Gohari Sadr, Sahar Heidariasl, Karine Megerdoomian , Laleh Seyyed-Kalantari and Ali Emami (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-01035.txt.

Introduction

Nikta Gohari Sadr leads a team of five authors on TaarofBench, a benchmark for Persian taarof. Taarof is a system of ritual politeness in Iranian daily life. It stresses deference, modesty, and indirectness in speech. Large language models struggle with such culturally specific norms. Taarof is absent from existing cultural benchmarks, the team notes.

The benchmark holds hundreds of role-play scenarios across twelve social topics. Native speakers validated the scenarios before use. Five frontier models are evaluated against human baselines. Accuracy falls far below native speakers when taarof fits the scene. Scores vary by topic and improve with Persian prompts. Gender-based gaps appear as well. Responses rated polite by standard metrics often break taarof norms. Tuning and preference methods yield large gains.

Catalog record

CREATORNikta Gohari Sadr, Sahar Heidariasl, Karine Megerdoomian , Laleh Seyyed-Kalantari and Ali Emami
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-01035

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

We Politely Insist: Your LLM Must Learn the Persian Art of Taarof Nikta Gohari Sadr, Sahar Heidariasl, Karine Megerdoomian , Laleh Seyyed-Kalantari and Ali Emami Abstract Large language models (LLMs) struggle to navigate culturally specific communication norms, limiting their effectiveness in global contexts. We focus on Persian taarof , a social norm in Iranian interactions, which is a sophisticated system of ritual politeness that emphasizes deference, modesty, and indirectness, yet remains absent from existing cultural benchmarks. We introduce TaarofBench , the first benchmark for evaluating LLM understanding of taarof, comprising 450 role-play scenarios covering 12 common social interaction topics, validated by native speakers. Our evaluation of five frontier LLMs reveals substantial gaps in cultural competence, with accuracy rates 40-48% below native speakers when taarof is culturally appropriate. Performance varies between interaction topics, improves with Persian-language prompts, and exhibits gender-based asymmetries. We also show that responses rated ‘‘polite’’ by standard metrics often violate taarof norms, indicating the limitations of Western politeness frameworks. Through supervised fine-tuning and Direct Preference Optimization, we achieve 21.8% and 42.3% improvement in model alignment with cultural expectations. Our human study with 33 participants (11 native Persian, 11 heritage, and 11 non-Iranian speakers) forms baselines in varying degrees of familiarity with Persian norms. This work lays the foundation for developing diverse and culturally aware LLMs, enabling applications that better navigate complex social interactions. 1 1 1 The complete codebase and dataset are publicly accessible at GitHub and on Hugging Face . 1 Introduction Figure 1: A taarof scenario from TaarofBench , where each scenario defines the environment, location, roles, context, and user utterance. In this example, Persian cultural norms expect passengers to insist on paying despite the driver’s offer. Base and fine-tuned Llama 3 responses are evaluated against culturally grounded expectations derived from academic literature. Taarof 2 2 2 https://www.tappersia.com/taarof/ , a core element of Persian etiquette, is a system of ritual politeness where what is said often differs from what is meant. It takes the form of ritualized exchanges: offering repeatedly despite initial refusals 3 3 3 For an entertaining and illuminating example of this aspect of taarof, see this short video . , declining gifts while the giver insists, and deflecting compliments while the other party reaffirms them. This “polite verbal wrestling” Rafiee 1991 involves a delicate dance of offer and refusal, insistence and resistance, which shapes everyday interactions in Iranian culture, creating implicit rules for how generosity, gratitude, and requests are expressed. Consider the scenario in Figure 1 : at the end of a ride, an Iranian taxi driver says “Be my guest this time.” A non-Iranian might respond with “That’s very kind, thank you so much!”, a polite acceptance that seems appropriate. However, Iranian speakers would recognize this as ritual politeness ( taarof ) and instead insist on paying: “No, I couldn’t possibly. Please, let me pay for your service.” This is a clear example of a cross-cultural pragmatics problem Stadler 2012 , where the appropriate interpretation depends on cultural context rather than literal meaning. For Large Language Models (LLMs), this pragmatic understanding poses a significant challenge, particularly as these systems increasingly mediate cross-cultural communications. Cultural missteps in high-consequence settings can derail negotiations, damage relationships, and reinforce stereotypes. In contrast, culturally fluent LLMs offer transformative potential: democratizing access to knowledge that typically requires years of immersion, enabling culturally aware educational technologies, bridging communication gaps between communities, and preserving practices otherwise marginalized in digital spaces Blanchard and Mohammed 2024 ; Saha et al. 2025 ; Li et al. 2024 . Taarof serves as a test case for a broader question: can AI systems adapt to the rich diversity of human communication patterns beyond Western norms? Recent benchmarks Rao et al. 2025 ; Chiu et al. 2024 ; Zhao et al. 2024 and adaptation strategies Dwivedi et al. 2023 ; Alkhamissi et al. 2024 ; Masoud et al. 2025 ; Liu et al. 2025 have assessed the cultural understanding of LLMs, but most rely on multiple choice formats that do not capture authentic cultural reasoning. These efforts also predominantly focus on well-resourced regions, leaving traditions such as Persian taarof underexplored. Although some studies have begun to evaluate LLMs in Persian norms Saffari et al. 2024 ; Moosavi Monazzah et al. 2025 ; Pourbahman et al. 2025 , they address general social expectations rather than specific cultural practices. To address this gap, we introduce TaarofBench , a new benchmark to assess whether LLMs understand and express taarof norms in open-ended interactions. Unlike previous approaches, TaarofBench operationalizes taarof as a structured computational task, formalizing scenarios as tuples that capture relevant social, contextual and environmental factors. The benchmark consists of 450 role-play scenarios rooted in Persian social dynamics, each annotated with culturally expected behavior drawn from academic and ethnographic sources, and validated by native speakers. Our results reveal a striking pattern: Models perform substantially better in scenarios where taarof is discouraged (76-93% precision) than where it is expected (34- 42% precision), highlighting a systemic bias toward Western-style directness. Non-Iranian participants’ performance closely mirrors that of frontier LLMs, both struggling to produce culturally appropriate responses in taarof-expected scenarios. We also found a critical disconnect between general politeness detection (84.5% of Llama 3 responses rated as polite) and culturally appropriate behavior (only 41.7% of those same responses judged culturally accurate). Importantly, targeted adaptation through supervised fine-tuning and Direct Preference Optimization substantially improves model alignment with taarof norms. Our contributions are: • We provide the first computational formalization of taarof interactions and introduce TaarofBench , a novel open-ended benchmark that evaluates the ability of LLMs to recognize appropriate contexts for taarof and generate culturally authentic responses. • We perform comprehensive evaluations in five LLMs, revealing systematic failures in cultural reasoning that parallel human cross-cultural misunderstandings and demonstrating that standard politeness metrics fail to capture culturally specific communication norms. We also show how model behavior changes with language, cultural context, and gender. • We establish performance baselines through a controlled human study with participants of varying cultural backgrounds, quantifying the gap between native-level cultural competence and current LLM capabilities. • We show that targeted adaptation techniques can substantially improve cultural alignment, providing a foundation for developing more culturally aware LLMs for low-resource traditions. 2 TaarofBench 2.1 Formalization of Taarof Taarof represents a form of cultural commonsense Shen et al. 2024 that is shared within Persian culture but often not intuitive to outsiders. Whether and how taarof should be expressed depends on several key factors: the social roles of participants, the environment, the physical environment, and the conversation starter. This contextual complexity makes taarof particularly challenging to encode as explicit rules for LLMs to follow, as Persian speakers themselves develop this competence through years of immersion and social feedback rather than formal instruction. To capture these contextual dependencies and evaluate LLMs’ understanding of this cultural practice, we define each scenario instance I as a tuple: I=\{E,R_{u},R_{m},C,U,A_{\text{exp}}\} Where: • E : Environment where the exchange takes place (e.g., restaurant, office, home) • R_{u} : Role of the user (Speaker A) • R_{m} : Role of the model (Speaker B) • C : Conversational context, providing a brief background for the interaction • U : User utterance initiating the scenario • A_{\text{exp}} : Expected response pattern

Read the complete text