Too Nice to Tell the Truth: Quantifying Agreeableness-Driven Sycophancy in Role-Playing Language Models
Arya Shah, Deepali Mishra, Chaklam Silpasuwanchai · 2026
Read Too Nice to Tell the Truth: Quantifying Agreeableness-Driven Sycophancy in Role-Playing Language Models by Arya Shah, Deepali Mishra, Chaklam Silpasuwanchai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10733.txt.
Introduction
Shah, Mishra, and Silpasuwanchai investigate how persona agreeableness drives sycophancy in role-playing language models, where models validate users rather than stay factual. Testing 13 small open-weight models from 0.6B to 20B parameters, they benchmark 275 personas on agreeableness scales against 4,950 prompts across 33 topics designed to elicit flattery. Nine of 13 models show significant positive links between the trait and flattery rates, with correlations up to 0.87 and effect sizes up to 2.33. The trait thus reliably predicts persona-induced flattery, with implications for deploying role-playing systems.
Catalog record
| CREATOR | Arya Shah, Deepali Mishra, Chaklam Silpasuwanchai |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38284 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.10733
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Too Nice to Tell the Truth: Quantifying Agreeableness-Driven Sycophancy in Role-Playing Language Models Arya Shah, Deepali Mishra, Chaklam Silpasuwanchai Abstract Large language models increasingly serve as conversational agents that adopt personas and role-play characters at user request. This capability, while valuable, raises concerns about sycophancy: the tendency to provide responses that validate users rather than prioritize factual accuracy. While prior work has established that sycophancy poses risks to AI safety and alignment, the relationship between specific personality traits of adopted personas and the degree of sycophantic behavior remains unexplored. We present a systematic investigation of how persona agreeableness influences sycophancy across 13 small, open-weight language models ranging from 0.6B to 20B parameters. We develop a benchmark comprising 275 personas evaluated on NEO-IPIP agreeableness subscales and expose each persona to 4,950 sycophancy-eliciting prompts spanning 33 topic categories. Our analysis reveals that 9 of 13 models exhibit statistically significant positive correlations between persona agreeableness and sycophancy rates, with Pearson correlations reaching r = 0.87 r=0.87 and effect sizes as large as Cohen’s d = 2.33 d=2.33 . These findings demonstrate that agreeableness functions as a reliable predictor of persona-induced sycophancy, with direct implications for the deployment of role-playing AI systems and the development of alignment strategies that account for personality-mediated deceptive behaviors. 1 Introduction Figure 1: Overview of our experimental methodology. We evaluate 13 language models using 275 personas spanning low to high agreeableness and 4,950 opinion prompts across 33 categories. We measure baseline ( S_{base} ) and persona-conditioned ( S_{p} ) sycophancy rates, compute NEO-IPIP agreeableness scores, and introduce two metrics: Sycophancy Shift Induced by Persona (SSIP) and Trait-Truthfulness Gap (TTG). As large language models (LLMs) become integrated into everyday applications, their tendency to prioritize user validation over factual accuracy has emerged as a significant alignment challenge 40 ; 34 . This sycophancy manifests when models agree with user opinions regardless of veracity, alter correct answers under social pressure, or provide flattering feedback contradicting objective assessment 48 . While reinforcement learning from human feedback (RLHF) effectively aligns models with human preferences 33 ; 3 , it may inadvertently reward sycophantic behavior since annotators often prefer validating responses 40 . This challenge is acute for persona-based AI systems, where platforms like Character.AI demonstrate significant engagement alongside safety concerns 39 ; 52 . Despite progress in characterizing sycophancy, the relationship between personality traits of adopted personas and sycophantic behavior remains unexplored. The Big Five framework, particularly agreeableness, offers a promising lens: agreeableness reflects tendencies toward cooperation and conflict avoidance that may amplify sycophantic responses 17 ; 12 . Safety implications of persona personality configurations have received limited attention 42 . We pose the following research questions: RQ1: Does persona agreeableness positively correlate with sycophancy rates in language models? RQ2: How does this relationship vary across model architectures and sizes? RQ3: Do high-agreeableness personas exhibit greater deviation from baseline truthful behavior? We investigate these questions across 13 small, open-weight LLMs (0.6B to 20B parameters) using: (1) the NEO-IPIP agreeableness questionnaire 17 to measure 275 personas, (2) 4,950 sycophancy-eliciting prompts spanning 33 categories, and (3) rigorous statistical analysis including correlation tests, group comparisons, and regression. Our experiments reveal significant positive correlations in 9 of 13 models ( \alpha=0.05 ), with Pearson r reaching 0.87 (Llama 3.1 8B) and effect sizes up to Cohen’s d=2.33 (SmolLM3 3B). We introduce the Trait-Truthfulness Gap (TTG) to quantify how agreeableness amplifies deviation from baseline behavior, identifying a “zone of deception” where high-agreeableness personas sacrifice accuracy. Our contributions include: (1) the first systematic study establishing agreeableness as a predictor of persona-induced sycophancy, (2) a large-scale benchmark enabling reproducible research on personality-safety interactions, and (3) the TTG metric for identifying personas likely to compromise factual accuracy. We release our code and dataset on GitHub and Hugging Face respectively. 2 Related Work Prior Work Focus Persona Personality Sycophancy Gap Addressed 40 Sycophancy causes ✗ ✗ ✓ Model-level only 34 Model behaviors ✗ ✗ ✓ No persona variation 21 Multi-turn flip ✗ ✗ ✓ No personality traits 46 Persona consistency ✓ ✗ ✗ No sycophancy link 25 Trait simulation ✓ ✓ ✗ No safety outcomes 42 Role-play safety ✓ ✗ ✗ No trait measurement 28 Truthfulness ✗ ✗ ✗ Model-level only Our Work Trait-sycophancy ✓ ✓ ✓ Full integration Table 1: Comparison with prior work. Our approach uniquely integrates persona-level analysis, validated personality measurement, and sycophancy evaluation to establish the agreeableness-sycophancy relationship. Our work connects three research threads: sycophancy in language models, persona-based role-playing systems, and personality measurement in NLP. We synthesize these areas to motivate our hypothesis that agreeableness predicts sycophantic behavior. 2.1 Sycophancy in Language Models Sycophancy has emerged as a critical alignment challenge, where models prioritize user validation over factual accuracy. 34 first systematically characterized this phenomenon using model-written evaluations, revealing that RLHF-trained models exhibit inverse scaling on truthfulness. 40 extended this work, demonstrating that five state-of-the-art assistants consistently produce sycophantic responses across free-form text generation tasks, attributing this behavior to human preference judgments that favor agreeable responses. Several benchmarks now evaluate sycophancy. SYCON Bench 21 measures multi-turn sycophancy through “Turn of Flip” and “Number of Flip” metrics. SycEval 15 distinguishes progressive sycophancy (leading to correct answers) from regressive sycophancy (leading to errors). Syco-bench 14 introduces tests for picking sides, mirroring user positions, and delusion acceptance. BrokenMath 35 evaluates sycophancy in mathematical reasoning by presenting flawed premises. ELEPHANT 10 conceptualizes “social sycophancy” as excessive face-preservation behavior. Mitigation strategies include synthetic data interventions 48 , activation steering 22 , and self-augmented preference alignment 7 . Despite these advances, no prior work has examined how persona-level personality traits influence sycophancy susceptibility. 2.2 Role-Playing and Persona-Based LLMs Role-playing language agents (RPLAs) have gained popularity through platforms like Character.AI, enabling users to interact with personified models 8 . 39 analyze the cognitive and social implications of role-playing in LLMs, arguing that persona adoption fundamentally alters model behavior. Several benchmarks evaluate role-playing capabilities. CharacterEval 46 assesses persona consistency across dialogue turns. PERSIST 45 measures personality stability across model sizes and conversation histories. RPEval 5 evaluates emotional understanding, decision-making, and in-character consistency. CharacterBox 47 generates behavior trajectories for character fidelity assessment. Safety concerns have accompanied this capability. 42 document safety-utility tradeoffs in role-playing, finding that “villainous” personas increase harmful outputs by 62%. Persona modulation has been exploited for jailbreaking: 38 demonstrate that steering LLMs to adopt adversarial personalities enables harmful instruction compliance. GUARD 26 uses role-playing to automatically generate jailbreak prompts. These findings suggest that persona characteristics directly influence safety properties, yet no work has systematically linked measurable personality traits to specific behavioral outcomes like sycophancy. 2.3 Personality Traits in NLP and LLMs The Big Five personality framework provides a validated taxonomy comprising Openness, Conscientiousness, Extraversion, Agreeableness, and Neuroticism 12 . The International Personality Item Pool (IPIP) offers public-domain instruments for measuring these traits 17 , with the NEO-IPIP providing facet-level granularity including Trust, Altruism, Cooperation, and Sympathy within the Agreeableness domain. Recent work has applied personality measurement to LLMs. 25 demonstrate that LLMs can simulate Big Five traits, with word usage patterns reflecting assigned personalities. 51 find that LLMs exhibit reliable personality profiles under specific prompting conditions. 37 show that LLMs can complete personality questionnaires with human-like consistency. However, 41 raise concerns about measurement invariance