Multiple LLM Agents Debate for Equitable Cultural Alignment

Dayeon Ki, Rachel Rudinger, Tianyi Zhou, Marine Carpuat · 2025

Read Multiple LLM Agents Debate for Equitable Cultural Alignment by Dayeon Ki, Rachel Rudinger, Tianyi Zhou, Marine Carpuat (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-24671.txt.

Introduction

Dayeon Ki, Rachel Rudinger, Tianyi Zhou, and Marine Carpuat test whether letting language models debate each other makes their answers fairer across cultures. A single model often misses the social norms of communities unlike those in its training data. The authors pair up two model-based agents that argue over a cultural scenario and then settle on a joint answer. A second version lets each agent choose, turn by turn, between debating and reflecting alone.

They tried seven open models in twenty-one pairings on a benchmark of etiquette norms from seventy-five countries. Debate beat single models on both accuracy and evenness across cultural groups. Small models of seven to nine billion parameters, when debating, matched a single model three times their size. The authors say structured argument between models is a cheap way to widen cultural competence. They release the framework for others to test on more tasks.

Catalog record

CREATORDayeon Ki, Rachel Rudinger, Tianyi Zhou, Marine Carpuat
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE103 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-24671

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Multiple LLM Agents Debate for Equitable Cultural Alignment Dayeon Ki, Rachel Rudinger, Tianyi Zhou, Marine Carpuat Abstract Large Language Models (LLMs) need to adapt their predictions to diverse cultural contexts to benefit diverse communities across the world. While previous efforts have focused on single-LLM, single-turn approaches, we propose to exploit the complementary strengths of multiple LLMs to promote cultural adaptability. We introduce a Multi-Agent Debate framework, where two LLM-based agents debate over a cultural scenario and collaboratively reach a final decision. We propose two variants: one where either LLM agents exclusively debate and another where they dynamically choose between self-reflection and debate during their turns. We evaluate these approaches on 7 open-weight LLMs (and 21 LLM combinations) using the NormAd-eti benchmark for social etiquette norms in 75 countries. Experiments show that debate improves both overall accuracy and cultural group parity over single-LLM baselines. Notably, multi-agent debate enables relatively small LLMs (7-9 B ) to achieve accuracies comparable to that of a much larger model (27 B parameters). 1 1 1 We release our code and dataset at https://github.com/dayeonki/cultural_debate . 1 Introduction Figure 1: Given a country, rule-of-thumb, and story from the NormAd-eti dataset, each method predicts a ternary label (Yes, No, Neither). Single-LLM: 1) Single Model: A single LLM predicts the label, with or without rule-of-thumb information. 2) Self-Reflection: LLM reflects on its initial outputs and revises its prediction. Multi-LLM Collaboration: 3) Debate-Only: Two LLM-based agents engage in a debate, generating initial decisions, providing feedback to each other, and making final decisions based on the exchanged feedback. If their final decisions differ, a judge LLM resolves the disagreement based on the debate history. 4) Self-Reflect+Debate: Each LLM can choose to self-reflect or debate during their turn. Large Language Models (LLMs) should be able to adapt their predictions to distinct cultural contexts to benefit diverse communities across the world. Recent efforts in this direction have focused on aligning LLMs to reflect diverse human values and norms across cultures Feng et al. (2024b) ; Choenni et al. (2024) ; Li et al. (2024a) ; Choenni and Shutova (2024) . However, these efforts have focused on single-LLM, single-turn generation approaches Cao et al. (2023) ; AlKhamissi et al. (2024) ; Xu et al. (2024) . Training specialized LLMs Li et al. (2024a) and prompt design Shen et al. (2024) have been shown to improve overall cultural alignment. Yet it can be expected that data selection and model design decisions make it challenging for any single model to support all cultures equally well. Meanwhile, a wealth of open-weight LLMs have been released, with varying training data distributions, alignment processes, and language coverage Yu et al. (2023) ; Du et al. (2023a) ; Bansal et al. (2024) , thus offering the potential for complementary perspectives and reasoning paths Hayati et al. (2024) ; Liang et al. (2024) . Interactions between such models may lead to more accurate understanding and evaluation of culturally sensitive scenarios, which motivates us to explore multi-LLM collaboration-based approaches. How can multiple LLMs collaborate toward equitable alignment across cultures? We investigate a common form of multi-LLM collaboration: debate Irving et al. (2018) ; Khan et al. (2024) ; Kenton et al. (2024) . We propose a Multi-Agent Debate framework, where two LLM agents debate over the given scenario and collaboratively arrive at a final decision with a judge LLM. We introduce two key variants as illustrated in Figure 1 : 1) Debate-Only , where multiple LLM agents exclusively engage in debate with a discussant, and 2) Self-Reflect+Debate , where each LLM agent dynamically choose between self-reflection and debating during its turn. To conduct a comprehensive comparison study, we investigate two additional strategies based on single-LLM in Figure 1 : 3) Single Model, where a single LLM generates outputs, and 4) Self-Reflection, where an LLM generates verbal self-reflections on its own outputs and incorporate them in subsequent iterations. Using the NormAd-eti benchmark Rao et al. (2024) , which probes social-etiquette related social norms across 75 countries, we evaluate the four above strategies across 7 LLMs (and 21 LLM combinations). We begin by improving single-LLM performance through cultural contextualization and self-reflection (§ 5.1 ), and show that the best-performing LLM often varies across cultures (§ 5.2 ), which motivates the multi-agent debate setup (§ 5.3 , § 5.4 ). As we will see, using multi-turn multi-agent approaches improve over single-turn single-LLM accuracies. We also analyze how predictions evolve throughout the debate stages: while the LLM agents often disagree initially (§ 6.1 ), debate effectively guides the agents to revise these decisions, with most revisions resulting in correct final outcomes. Moreover, we demonstrate that improvements are consistent across cultural groups, with the multi-agent debate setup achieving the highest parity in performance, particularly benefiting underrepresented cultural groups (§ 6.3 ). 2 Background and Related Work LLM Cultural Alignment. The accuracy of LLM predictions across diverse cultural contexts has received increased attention. One line of work examines the cross-cultural difference in moral values and beliefs encoded in LLMs and their alignment with diverse human perspectives Emelin et al. (2020) ; Scherrer et al. (2023) ; Jinnai (2024) ; Cao et al. (2023) ; Arora et al. (2023) ; Jin et al. (2024) . Another explores how LLMs interpret social etiquette and norms across varying cultural contexts Hayati et al. (2024) ; Li et al. (2023) ; Zhan et al. (2024) ; Shi et al. (2024) ; Rao et al. (2024) ; Ziems et al. (2023) . Building on these works, our study focuses specifically on the cultural alignment of LLMs with social norms, using NormAd-eti Rao et al. (2024) benchmark as a testbed. Extensive efforts have also been made to enhance cultural alignment in LLMs, encompassing advancements in pre-training Huang et al. (2024a) ; Zhang et al. (2024) ; Wang et al. (2024) , alignment training Choenni et al. (2024) ; Li et al. (2024a) ; Mukherjee et al. (2024) , and inference strategies, such as effective prompt design AlKhamissi et al. (2024) ; Cao et al. (2023) ; Shen et al. (2024) and in-context learning Choenni and Shutova (2024) ; Lahoti et al. (2023) . However, prior work has primarily focused on single LLMs in single-turn interactions, with the use of multiple LLMs under-explored. The closest work to ours is CulturePark Li et al. (2024b) , which leverages an LLM-powered multi-agent communication framework for cultural data collection. We depart from this work by adapting a multi-agent debate framework specifically to enhance cultural alignment, presenting a new perspective within model inference strategies. Multi-Agent Debate. The diverse perspectives of LLMs arise from differences in training data and alignment processes, making them well-suited for pluralistic alignment tasks Feng et al. (2024b) . Inspired by human reasoning, prior works have proposed frameworks where multiple LLMs generate responses, process others’ opinions, and engage in debates to reach consensus Estornell and Liu (2024) . This collaborative approach has shown potential in problem-solving by combining knowledge and extracting diverse perspectives Hayati et al. (2024) . Most works focus on improving factuality and reasoning capabilities, where they show that debate reduce the tendency of LLMs to hallucinate incorrect facts through “ society of minds ” interaction Du et al. (2023b) or encourage divergent thinking

Read the complete text