Persuasion at Play: Understanding Misinformation Dynamics in Demographic-Aware Human-LLM Interactions

Angana Borah, Rada Mihalcea, Verónica Pérez-Rosas · 2025

Read Persuasion at Play: Understanding Misinformation Dynamics in Demographic-Aware Human-LLM Interactions by Angana Borah, Rada Mihalcea, Verónica Pérez-Rosas (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-02038.txt.

Introduction

Angana Borah, Rada Mihalcea, and Veronica Perez-Rosas study how misinformation persuasion flows both ways between people and language models, in work from twenty twenty-five. Some demographic groups fall for false claims more than others. Models can now craft persuasive text at scale, which adds new risk.

The team measured human sway over models with stance data sets, and model sway over humans with generated arguments. A multi agent setup then tracked spread among demographic styled model agents. Model susceptibility mirrored human demographic patterns closely. Groups of like agents formed echo chambers, just as human groups do. The findings inform future guards against false content.

Catalog record

CREATORAngana Borah, Rada Mihalcea, Verónica Pérez-Rosas
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE84 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-02038

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Persuasion at Play: Understanding Misinformation Dynamics in Demographic-Aware Human-LLM Interactions Angana Borah, Rada Mihalcea, Verónica Pérez-Rosas Abstract Existing challenges in misinformation exposure and susceptibility vary across demographics, as some populations are more vulnerable to misinformation than others. Large language models (LLMs) introduce new dimensions to these challenges through their ability to generate persuasive content at scale and reinforcing existing biases. This study investigates the bidirectional persuasion dynamics between LLMs and humans when exposed to misinformative content. We analyze human-to-LLM influence using human-stance datasets and assess LLM-to-human influence by generating LLM-based persuasive arguments. Additionally, we use a multi-agent LLM framework to analyze the spread of misinformation under persuasion among demographic-oriented LLM agents. Our findings show that demographic factors influence LLM susceptibility, with up to 15 percentage point differences in correctness across groups. Multi-agent LLMs also exhibit echo chamber behavior, aligning with human-like group polarization patterns. Therefore, this work highlights demographic divides in misinformation dynamics and offers insights for future interventions. 1 Introduction Figure 1: In our study, we investigate the differences in persuasion effects of LLMs on humans, and of humans on LLMs. To assess the impact of persuasion, we conduct experiments involving human participants from diverse demographic groups—varying by age, gender, and geographical backgrounds; and LLMs with different demographic persona. In an era of rapid information exchange, misinformation poses a significant social challenge Broda and Strömbäck (2024) ; Sultan et al. (2024) with its impact shaped by diverse cultural backgrounds, belief systems, and access to information Verma et al. (2022) ; Knuutila et al. (2022) ; Chandrasekaran et al. (2024) . Furthermore, the increasing use of LLMs to search for information, ask questions, or make judgments about the credibility of the content, brings significant opportunities and risks in this landscape Garry et al. (2024) ; Wang et al. (2024b) ; Wang et al. (2025) . While previous research has highlighted the capabilities of LLMs in countering misinformation through well-designed interventions Gabriel et al. (2024) , they can also be misused to craft persuasive narratives Danry et al. (2022) and amplify the spread of misinformation. In this paper, we introduce PANDORA – a framework for P ersuasion AN alysis in D emographic-aware human-LLM interactions and misinf O rmation R esponse A ssessment. We use this framework to investigate four research questions through the lens of misinformation and its interaction with diverse demographics; specifically, we examine whether the source of persuasive content influences belief in misinformation and assess the susceptibility of humans and LLMs when exposed to persuasive messages: RQ1: How do individuals from diverse demographic backgrounds respond to persuasive messages generated by LLMs? RQ2: How do LLM personas representing various demographics respond to human persuasion? RQ3: How does susceptibility to persuasion differ between humans and LLMs across demographic groups? and RQ4: In multi-agent interactions, how do LLMs respond to persuasive arguments, and to what extent do they exhibit human-like group behaviors in the context of misinformation? Answering these questions is crucial for understanding the implications of LLM deployment in manipulation-prone environments. The paper makes the following contributions: First , we use LLMs to generate persuasive arguments representing opposing views for a given claim. We then assess how individuals from diverse demographic backgrounds respond to these arguments and examine their susceptibility to misinformation (Fig. 1 (1)). Second , we take human-authored arguments from stance datasets and evaluate how LLM-personas designed to reflect different demographics respond to persuasion and exhibit susceptibility to misinformation. (Fig 1 (2)). Third , we examine the effectiveness of persuasive arguments generated by humans and LLMs, as well as their respective susceptibility to misinformation across various demographic groups. Finally , we design a multi-agent LLM architecture to study the effect of both human- and LLM-driven persuasion on interactions involving demographic-aware LLM personas (Fig. 2 ). This setup allows to investigate how misinformation is perpetuated and to analyze LLM behavior in complex multi-agent settings. By integrating both human and LLM perspectives, our study aims to provide insights into how persuasion operates in human-LLM interactions while accounting for demographic factors. 2 Related Work LLM-generated Persuasion. Recent research has examined the persuasive capabilities of LLMs, including their ability to influence others Gabriel et al. (2024) ; Matz et al. (2024) and their susceptibility to being influenced Griffin et al. (2023) ; Chen et al. (2024) . Studies have shown that LLMs can play a dual role in persuasion: they can be beneficial, as shown by Gabriel et al. (2024) , and potentially harmful, as highlighted by Danry et al. (2022) . Understanding these dynamics is critical, as LLMs are increasingly integrated into human-facing applications, from education and customer service to social media and healthcare tools Andrew (2024) ; Nair et al. (2024) . Their persuasive power can shape opinions, behaviors, and beliefs, making it essential to assess how they influence human thought processes and decision-making Breum et al. (2024) ; Salvi et al. (2024) . Human-LLM Misinformation Dynamics. Several studies have examined the impact of LLM-generated misinformation on humans. Chen and Shu (2023) found that such misinformation is more difficult to detect for both humans and automated systems. Moreover, recent studies have shown that LLM-generated misinformation can significantly degrade the performance of Open-Domain Question Answering (ODQA) systems, highlighting the cascading effects of synthetic misinformation Pan et al. (2023) . Furthermore, LLMs have been shown to be vulnerable to misinformation attacks that can alter their internal knowledge representations Han et al. (2024) . Despite these findings, limited research has explored the mutual influence of persuasion in humans and LLMs Salvi et al. (2024) . To our knowledge, our study is the first to systematically compare and contrast the quality and impact of human and LLM-driven persuasion in the context of misinformation, offering novel insights into their bidirectional interactions. Multi-Agent LLM Simulations. LLMs have been increasingly studied as tools to simulate social systems Park et al. (2023) ; Zhou et al. (2024) . Previous work has shown that LLM agents produce plausible individual and emergent social behaviors, collaborating or competing to achieve complex social goals. Although computational models have been developed to simulate human susceptibility to misinformation in various demographics Liu et al. (2024) , multi-agent LLM simulations remain underexplored in this domain. For instance, Li et al. (2024) examined how LLM personality traits, such as extraversion, influence the dissemination of information within groups. However, their work did not address demographic-oriented LLM simulations, leaving open questions on how demographic factors shape misinformation dynamics in multi-agent LLM systems. Our study addresses this gap by introducing, to our knowledge, the first use of demographic-aware multi-agent LLM interactions in the context of misinformation. Figure 2: Multi-Agent LLM Architecture : Homogeneous and Heterogeneous groups engage in interaction rounds to decide if a news item is true or false. They are provided with persuasion texts during the interaction. Note that n=4 for our experiments. 3 PANDORA Framework The PANDORA framework comprises three components to explore persuasion dynamics on misinformation under single-agent (LLM-to-human and human-to-LLM) and multi-agent LLM settings. 3.1 LLM-to-Human Persuasion Our LLM-to-Human persuasion component examines how persuasive content generated by LLMs influences human beliefs. Fig. 1 (1) shows an overview of our setup, where LLMs produce both refuting and supporting persuasive arguments for a given claim, and their

Read the complete text