Prompt Programming for Cultural Bias and Alignment of Large Language Models Conference: ACM Symposium on Document Engineering 2025; August 25–58, 2026; Fribourg, Switzerland ACM Symposium on Document Engineering 2026 (DocEng ’26), August 25–58, 2026, Fribourg, Switzerland DOI: 10.1145/3704268.3748680 ISBN: 979-8-4007-1351-4/2025/09 CCS: Computing methodologies Artificial intelligence CCS: Computing methodologies Natural language processing CCS: Computing methodologies Machine learning

Maksim E. Eren, Eric Michalak, Brian Cook, Johnny Seales Jr · 2026

Read Prompt Programming for Cultural Bias and Alignment of Large Language Models Conference: ACM Symposium on Document Engineering 2025; August 25–58, 2026; Fribourg, Switzerland ACM Symposium on Document Engineering 2026 (DocEng ’26), August 25–58, 2026, Fribourg, Switzerland DOI: 10.1145/3704268.3748680 ISBN: 979-8-4007-1351-4/2025/09 CCS: Computing methodologies Artificial intelligence CCS: Computing methodologies Natural language processing CCS: Computing methodologies Machine learning by Maksim E. Eren, Eric Michalak, Brian Cook, Johnny Seales Jr (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-16827.txt.

Introduction

Eren and co-authors work on aligning language model outputs with the culture of a target population. Culture shapes reasoning, values, and choices, yet models often carry skewed defaults. Earlier work used survey-based metrics and hand-written culture prompts, mostly on closed models. This team re-checks those metrics on open-weight models. They then use DSPy prompt programming, treating prompts as programs tuned against a cultural-distance goal. In their tests, tuned prompts often beat hand engineering. They argue this route is more stable and transferable.

Catalog record

CREATORMaksim E. Eren, Eric Michalak, Brian Cook, Johnny Seales Jr
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45474
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.16827

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Prompt Programming for Cultural Bias and Alignment of Large Language Models Conference: ACM Symposium on Document Engineering 2025; August 25–58, 2026; Fribourg, Switzerland ACM Symposium on Document Engineering 2026 (DocEng ’26), August 25–58, 2026, Fribourg, Switzerland DOI: 10.1145/3704268.3748680 ISBN: 979-8-4007-1351-4/2025/09 CCS: Computing methodologies Artificial intelligence CCS: Computing methodologies Natural language processing CCS: Computing methodologies Machine learning Maksim E. Eren, Eric Michalak, Brian Cook, Johnny Seales Jr Abstract . Culture shapes reasoning, values, prioritization, and strategic decision-making, yet large language models (LLMs) often exhibit cultural biases that misalign with target populations. As LLMs are increasingly used for strategic decision-making, policy support, and document engineering tasks such as summarization, categorization, and compliance-oriented auditing, improving cultural alignment is important for ensuring that downstream analyses and recommendations reflect target-population value profiles rather than default model priors. Previous work introduced a survey-grounded cultural alignment framework and showed that culture-specific prompting can reduce misalignment, but it primarily evaluated proprietary models and relied on manual prompt engineering. In this paper, we validate and extend that framework by reproducing its social sciences survey based projection and distance metrics on open-weight LLMs, testing whether the same cultural skew and benefits of culture conditioning persist outside closed LLM systems. Building on this foundation, we introduce use of prompt programming with DSPy for this problem—treating prompts as modular, optimizable programs—to systematically tune cultural conditioning by optimizing against cultural-distance objectives. In our experiments, we show that prompt optimization often improves upon cultural prompt engineering, suggesting prompt compilation with DSPy can provide a more stable and transferable route to culturally aligned LLM responses. † † cc-license: by 1. Introduction Cultural systems shape how individuals interpret uncertainty, prioritize social goals, evaluate authority, and resolve moral trade-offs. These dimensions influence strategic decision-making in domains such as governance, organizational leadership, education, and public communication. For the purpose of this paper, we define culture as a system of societal norms and the way of life that are learned and shared among major groups in a population ( 17 ) ( 42 ) . As large language models (LLMs) increasingly assist in drafting policies, generating recommendations, categorizing and analyzing documents, and mediating cross-cultural interactions, their implicit value orientations can meaningfully affect downstream reasoning. Culture can also shape document engineering itself: it affects how prompts, templates, and schemas define salient categories, acceptable evidence, and legitimate justifications. Because LLMs are increasingly used for document engineering tasks such as summarization, categorization, classification, and auditing support, prompts and templates function as interaction specifications through which cultural assumptions enter via what the artifacts request, prioritize, and treat as a valid rationale. Cultural misalignment in model outputs is therefore not merely representational, but it can shift which options are surfaced, how trade-offs are justified, and what is treated as legitimate or desirable. Tao et al. ( 42 ) introduced a social sciences based survey-grounded framework for measuring cultural alignment by mapping LLM responses to standardized value instruments and computing distance from nationally representative benchmarks. They showed that, under generic prompting, models concentrate around Western value profiles, and that explicit culture conditioning through prompt engineering can reduce misalignment, pushing LLM responses to the target countries/territories. Although influential, Tao et al. ( 42 ) evaluated only proprietary models and relied solely on manual prompt engineering. In contrast, open-source models offer research advantages that closed systems typically cannot—democratized access, reproducibility, and broader support for diverse downstream applications ( 28 ) . Moreover, while prompt engineering can improve LLM outputs ( 38 ) , it is increasingly complemented, and in some settings supplanted, by programmatic prompt optimization frameworks such as DSPy ( 24 ) , which treat prompts as optimizable components and automatically search for prompts that best satisfy an explicit objective and format constraints. Our work here, therefore, addresses two research questions: (1) Do the findings of Tao et al. ( 42 ) hold for open-source LLMs? (2) Does prompt optimization culturally align LLM responses better than prompt engineering? To address the first research question, we reproduce Tao et al. ( 42 ) on open-weight models spanning scales and training regimes: Llama 3.3 (70B) ( 29 ) , Llama 4 (16 \times 17B) ( 30 ) , Gemma 3 (27B) ( 12 ) , and GPT-OSS (20B/120B) ( 34 ) . Across these models, we observe that culture conditioning remains detectable and consistent, indicating that Tao et al.’s findings extend beyond proprietary systems and persist across architectures and scales. To address the second research question, we compare manual cultural prompt engineering against DSPy -based prompt optimization, which treats prompting as a parameterized program and compiles prompts against explicit objectives under strict response-format constraints ( 24 ) . By casting cultural alignment as an optimization problem—minimizing human survey–derived cultural distance—we find that DSPy moves responses closer to the target cultures than manual prompting, often reducing cultural distance beyond generic prompting and hand-designed cultural templates. Together, these results suggest that programmatic prompt optimization yields more stable and transferable cultural conditioning across open-weight models, including for non-Western cultural positions relevant to strategic decision-making settings. In summary, our contributions include: (1) Validating and extending the prior work by Tao et al. ( 42 ) on five different open-source LLMs. (2) Introducing use of prompt programming with DSPy ( 24 ) for cultural alignment of LLMs. (3) Evaluating the cultural alignment performance of prompt programming using two DSPy teleprompters COPRO and MIPROv2 ( 7 ; 8 ) , and comparing the impact of a small vs. large instruction-suggester model during optimization (Llama 3.2 1B vs. GPT-OSS 120B). (4) Comparing the performance of prompt programming to prompt engineering for cultural alignment. 2. Related Work Recent work by Tao et al. ( 42 ) , on which we build upon in this paper, introduced a survey-grounded framework for measuring cultural alignment by mapping LLM responses to World Values Survey (WVS) items into the Inglehart–Welzel (IW) cultural map and computing distance to nationally representative benchmarks. Their evaluation of proprietary OpenAI models showed that generic prompting induces a consistent Western concentration in the responses, while culture-specific prompting can reduce cultural distance for many targets. Our work extends this work by replicating the full pipeline on open-weight models and additionally by introducing DSPy prompt programming as an alternative to manual cultural prompt engineering. As LLMs are incorporated into document-centric systems, document engineering —spanning multi-document summarization, categorization pipelines, auditing workflows, and the construction of prompts, templates, schemas, and documentation artifacts ( 13 ; 46 ) —provides the interface through which models are applied. These artifacts are not culturally invariant: schema and template choices shape which distinctions are encoded and what counts as evidence, and summarization can introduce systematic distortions in what is selected and emphasized ( 41 ) . More broadly, task and evaluation design embed cultural assumptions ( 33 ) , and prompt language or explicit cultural framing shifts expressed values, indicating that interaction specifications can act as cultural cues ( 6 ) . Further, documentation supports auditability and certification, with scope varying by perceived risk ( 25 ) . From a cross-cultural tooling perspective, O’Neil et al. ( 35 ) emphasize linguistic sovereignty, cultural specificity, and reciprocity, while Bravansky et al. ( 5 ) frame cultural alignment as context-dependent and shaped by interaction scaffolding. Taken together,

Read the complete text