Synthetic Socratic Debates: Examining Persona Effects on Moral Decision and Persuasion Dynamics

Jiarui Liu, Yueqi Song, Yunze Xiao, Mingqian Zheng, Lindia Tjuatja, Jana Schaich Borg, Mona Diab, Maarten Sap · 2025

Read Synthetic Socratic Debates: Examining Persona Effects on Moral Decision and Persuasion Dynamics by Jiarui Liu, Yueqi Song, Yunze Xiao, Mingqian Zheng, Lindia Tjuatja, Jana Schaich Borg, Mona Diab, Maarten Sap (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-12657.txt.

Introduction

Jiarui Liu and co-authors run in 2025 fake debates tween chat agents to test how built traits sway moral calls and sweet talk wins. Models now work in touchy zones where trait pull counts. A six trait space frames the agents: age, sex, land, class, creed, and temper.

Agents face one hundred thirty one bond case woes in set bouts. Creed and temper swayed first stands and ends the most. Free and open traits won more joint ends and wins. Bold marks grew as bouts ran, while heart and trust plays ebbed. The team urges trait wise tests for such work.

Catalog record

CREATORJiarui Liu, Yueqi Song, Yunze Xiao, Mingqian Zheng, Lindia Tjuatja, Jana Schaich Borg, Mona Diab, Maarten Sap
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-12657

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Synthetic Socratic Debates: Examining Persona Effects on Moral Decision and Persuasion Dynamics Jiarui Liu, Yueqi Song, Yunze Xiao, Mingqian Zheng, Lindia Tjuatja, Jana Schaich Borg, Mona Diab, Maarten Sap Abstract As large language models (LLMs) are increasingly used in morally sensitive domains, it is crucial to understand how persona traits affect their moral reasoning and persuasive behavior. We present the first large-scale study of multi-dimensional persona effects in AI-AI debates over real-world moral dilemmas. Using a 6-dimensional persona space (age, gender, country, class, ideology, and personality), we simulate structured debates between AI agents over 131 relationship-based cases. Our results show that personas affect initial moral stances and debate outcomes, with political ideology and personality traits exerting the strongest influence. Persuasive success varies across traits, with liberal and open personalities reaching higher consensus and win rates. While logit-based confidence grows during debates, emotional and credibility-based appeals diminish, indicating more tempered argumentation over time. These trends mirror findings from psychology and cultural studies, reinforcing the need for persona-aware evaluation frameworks for AI moral reasoning. 1 Introduction Figure 1: We study how two agents with distinct personas engage in moral debate, presenting arguments and counterarguments in response to each other’s reasoning. Their strategies are evaluated using Aristotle’s modes of persuasion: Ethos (appeal to authority), Pathos (appeal to emotion), and Logos (appeal to logic). Figure 2: The two persona-conditioned agents that initially disagree on the moral dilemma alternate arguments for up to 5 turns, updating a 5-point moral stance rating after every turn. A moderator tracks the ratings, ends the debate once they converge or the turn limit is reached, and records stance shifts and metric scores for later analysis. The stand shifts during debate demonstrate underlying modes of persuasion. LLMs are increasingly endowed with personas such as demographic traits ( Hu and Collier 2024 ) , political orientation ( Rozado 2024 ) , social identities ( Chuang et al. 2024 ) , to shape the style and content of their output. These persona cues help LLMs simulate diverse perspectives in tasks such as education, healthcare, and customer service ( Tudor Car et al. 2020 ; Kanero et al. 2022 ; Shanahan et al. 2023 ; Shao et al. 2023 ) . As people increasingly turn to LLMs for guidance on morally complex decisions ( Wallach et al. 2010 ; Savulescu and Maslen 2015 ; Conitzer et al. 2017 ) , questions arise about how personas could affect these morally laden interactions. Understanding these decisions requires insights from moral psychology and social ethics, focusing not just on what LLMs decide, but also how and why . Previous work has largely focused on synthetic dilemmas ( Bauman et al. 2014 ; Bostyn et al. 2018 ; Chiu et al. 2024 ; Jin et al. 2024b ) or isolated persona traits ( Chen et al. 2024 ; Li et al. 2024 ) , leaving open how richer, intersecting identities shape moral judgment and reasoning. In this work, we investigate how personas influence moral decision-making and persuasive strategies in LLMs. Drawing from an existing dataset of human-written moral dilemmas ( Lourie et al. 2021 ) , we focus on highly controversial everyday scenarios centered on relationships. These dilemmas often lack clear answers and are characterized by conflicting values and emotional complexity ( McConnell 2002 ; Svensson 2006 ) . We address two research questions: RQ1: How does persona influence moral decision making in language models in a single turn? We first examine how rich, multi-dimensional personas influence LLMs’ judgments on controversial moral dilemmas. Each persona combines six dimensions varied between agents: age, gender, political ideology, socioeconomic status, nationality, and personality traits. We then assess whether different personas lead models to favor distinct positions aligned with specific moral principles, drawing on moral foundation theory from social psychology ( Graham et al. 2013 ) . RQ2: What persuasion strategies emerge when persona-rich agents engage in multi-turn moral debate? We then use AI-AI debates to study how personas influence moral reasoning and persuasion (Figure 1 ). Unlike single-turn responses, debates reveal how agents construct arguments, respond to challenges, and attempt to persuade ( Ehninger and Brockriede 2008 ) . Incorporating rich personas further simulates the diversity of moral reflection in the real world, capturing a plurality of values and perspectives ( Asen 2005 ; Ashkinaze et al. 2024 ) . To assess persuasive effectiveness, we introduce metrics such as confidence shifts, win rates, consensus formation, and debate efficiency. We also analyze rhetorical strategies, including appeals to emotion, logic, and authority ( Braet 1992 ) . Our findings reveal that certain persona traits significantly shape both initial moral stances and debate outcomes. Political ideology and personality emerged as the strongest predictors of moral judgment, with liberal and open-minded personas displaying more empathetic responses and greater persuasive success. In debate settings, these personas also reached consensus more efficiently. We also observed that while agents’ confidence typically increased over the course of debates, their reliance on emotional and credibility-based appeals diminished, indicating a shift toward more reasoned, less affective argumentation. These results offer actionable insights for designing LLMs that are sensitive to diverse value systems and transparent in how identity cues influence persuasive dynamics. This work represents an initial attempt to systematically examine the intersectionality of multiple persona dimensions in moral and persuasive reasoning, complementing recent efforts in intersectional studies of LLM behavior in NLP. 2 Related work Impact of LLM Persona on Moral Judgment Prior work has shown that LLMs’ moral decisions can shift significantly based on assigned personas, such as political ideology ( Rozado 2024 ; Chen et al. 2024 ; Li et al. 2024 ; Kim et al. 2025 ) and cultural background ( Gupta et al. 2023 ; Tao et al. 2024 ; Albert and Billinger 2024 ) . However, most work typically manipulates only one trait at a time ( Liu et al. 2024a ) , leaving other persona factors uncontrolled and potentially confounding results ( Deshpande et al. 2023 ; Jin et al. 2024a ) . Studies also show that LLMs exhibit moral biases even without explicit personas ( Hartmann et al. 2023 ; Anthropic 2023 ; Garcia 2024 ) , making it unclear whether the results reflect internal tendencies or implicit persona effects. Although some research has explored multidimensional personas ( AlKhamissi et al. 2024 ; Coppolillo et al. 2025 ) , it has not focused on moral reasoning. In contrast, we systematically assign six persona dimensions and evaluating how these combinations influence moral judgments. Agent Debates for Moral Decision-Making Previous work on LLM moral reasoning focuses on single-turn outputs or static persona comparisons, overlooking how views shift through interaction or how one persona might persuade another ( Kim et al. 2025 ; Garcia 2024 ; Bozdag et al. 2025b ) . Studies of multi-agent debates typically emphasize factual correctness over rhetorical or moral dynamics ( Park et al. 2023 ; Khan et al. 2024 ; Bozdag et al. 2025a ; Chen et al. 2025 ; Liang et al. 2024 ) . The limited work that addresses persuasion dynamics often relies on fixed roles or scripted tactics ( Anthropic 2024 ; Smit et al. 2023 ; Carrasco-Farre 2024 ) , and often operates in single-turn settings

Read the complete text