AI persuading AI vs AI persuading Humans: LLMs’ Differential Effectiveness in Promoting Pro-Environmental Behavior Preprint

Alexander Doudkin, Pat Pataranutaporn, Pattie Maes · 2025

Read AI persuading AI vs AI persuading Humans: LLMs’ Differential Effectiveness in Promoting Pro-Environmental Behavior Preprint by Alexander Doudkin, Pat Pataranutaporn, Pattie Maes (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-02067.txt.

Introduction

Alexander Doudkin, Pat Pataranutaporn, and Pattie Maes test whether AI chatbots can persuade in a 2025 study on green behavior. Fighting climate change needs people to act on what they know, a step that often stalls. The team compared chatbots' sway over three groups of 1,200 each: real people, simulated people built from real data, and fully synthetic personas.

Chatbots used personal or standard scripts and four persuasion styles. Synthetic and simulated agents shifted their stated stance a lot, while real humans barely moved, a gap the authors call the synthetic persuasion paradox. Simulated testers thus overstate how well AI persuasion works on people.

Catalog record

CREATORAlexander Doudkin, Pat Pataranutaporn, Pattie Maes
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE80 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-02067

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AI persuading AI vs AI persuading Humans: LLMs’ Differential Effectiveness in Promoting Pro-Environmental Behavior Preprint Alexander Doudkin, Pat Pataranutaporn, Pattie Maes Abstract . Pro-environmental behavior (PEB) is vital to combat climate change, yet turning awareness into intention and action remains elusive. We explore large language models (LLMs) as tools to promote PEB, comparing their impact across 3,200 participants: real humans (n=1,200), simulated humans based on actual participant data (n=1,200), and fully synthetic personas (n=1,200). All three participant groups faced personalized or standard chatbots, or static statements, employing four persuasion strategies (moral foundations, future self-continuity, action orientation, or ”freestyle” chosen by the LLM). Results reveal a ”synthetic persuasion paradox”: synthetic and simulated agents significantly affect their post-intervention PEB stance, while human responses barely shift. Simulated participants better approximate human trends but still overestimate effects. This disconnect underscores LLM’s potential for pre-evaluating PEB interventions but warns of its limits in predicting real-world behavior. We call for refined synthetic modeling and sustained and extended human trials to align conversational AI’s promise with tangible sustainability outcomes. Figure 1. Overview of the system and research approach. Teaser figure illustrating an overview of the system architecture and research approach for evaluating AI‐driven persuasive interventions for pro-environmental behavior. The schematic depicts key components including participant groups, intervention conditions, and the overall study flow. 1. Introduction Climate change has become the quintessential challenge of our time, imperiling ecosystems, societies, and the broader stability of Earth’s support systems ( on Climate Change, IPCC ) . Growing evidence and scientific consensus highlight the urgency of this crisis, yet translating environmental awareness into sustained action on an individual level remains elusive ( Myers et al., 2021 ; Knutti, 2019 ; Lynas et al., 2021 ) . Understanding the drivers behind individuals’ pro-environmental behavior (PEB) is a longstanding endeavor in psychology and social sciences, with prominent theoretical frameworks such as the Theory of Planned Behavior and meta-analytic studies on PEB predictors guiding the research ( Gifford, 2011 ; Gifford et al., 2011 ; Hines et al., 1987 ; Bamberg and Möser, 2007 ; Ajzen, 1991 ) . On an individual level, partially within policy context, many intervention and persuasion strategies—such as Nudging, leveraging norms, or future self-continuity—have shown significant influence on PEB ( Goldstein et al., 2008 ; Lehner et al., 2016 ; Demarque et al., 2015 ; Vlasceanu et al., 2024 ; Duarte et al., 2024 ) . However, the so-called intention-action gap remains one of the key limitations for most of the interventions and strategies and their long-term efficacy ( Knutti, 2019 ; Nguyen et al., 2019 ; Kollmuss and Agyeman, 2002 ) . As a parallel development, innovative possibilities for encouraging human behavior have emerged through advances in conversational AI. Large language models (LLMs) enable real-time, adaptive dialogue that can ultimately personalize interactions to facilitate human behavior. Successful studies show how such agents significantly shape areas such as debunking conspiracy theories, promoting healthier lifestyles, or increasing educational efficiency ( Wang et al., 2023 ; Aggarwal et al., 2023 ; Costello et al., 2024 ) . Similarly, recent research in human-computer interaction (HCI) suggests interactive systems can also promote PEB by facilitating conversational AI experiences—although empirical evidence is still limited ( Giudici, 2024 ; Hillebrand and Johannsen, 2021 ; Breiter et al., 2024 ) . While AI could solve increased PEB, it is also a catalyst for adverse environmental impact. Thus, it is critical to weigh the benefits with the consequences. The development and deployment of AI systems require significant computational resources, resulting in substantial energy consumption and carbon emissions ( Ligozat et al., 2021 ; d’Aramon et al., 2024 ) . Large language models and other sophisticated AI systems demand extensive data centers with high electricity usage, often powered by fossil fuels. Additionally, the hardware manufacturing process for AI infrastructure involves resource extraction and electronic waste concerns. The tension between conversational AI’s environmental costs and benefits necessitates careful evaluation of each application’s net impact. This includes considering the entire lifecycle environmental footprint against measurable environmental benefits, particularly ensuring that increased consumption doesn’t offset efficiency gains. Another research stream applying recent LLMs is synthetic study generation: Real-world experiments with humans are only one of the study evaluation techniques nowadays. Specifically in HCI, synthetic data generation by LLMs—representing human ”Doppelgänger” for pre-evaluation or complete replacement before human experiments— has seen its first application areas and research conclusions ( Cho et al., 2024 ; Hämäläinen et al., 2023 ; Argyle et al., 2023 ) . Thus, the question arises: can synthetic participants be used as a preliminary testing ground to identify the most effective LLM-driven PEB interventions before exposing them to actual human participants, reducing the cost and energy associated with full-scale human studies? By leveraging synthetic evaluations to obtain initial insights into human PEB, researchers could iteratively refine and optimize intervention strategies before deploying them to actual participants. Such an approach promises to streamline the research process, enabling more targeted and meaningful interventions while mitigating resource-intensive human trials. 1.1. Research Objectives and Hypotheses This study pursues two primary objectives. First, it evaluates the impact of chat-based interfaces on PEB among actual human participants. Second, it establishes a foundation for synthetic pre-evaluations and participant simulations, exploring the fidelity with which human responses to LLM-based PEB interventions can be replicated. To achieve this, we propose a series of hypotheses that examine the validity of synthetic insights, the effectiveness of personalization, and the comparative impact of various persuasive strategies on promoting sustainable actions. 1.1.1. RQs and Hypotheses Accordingly, the following research questions and accompanying hypothesis were set: ” How do personalization and persuasion strategies in interactive AI chat interfaces contribute to facilitating PEB in humans? ” (RQ1) and ” How do personalization and psychologically grounded persuasion strategies influence the alignment between synthetic (LLM-generated) predictions and actual human PEBs, and what design principles can be derived to bridge potential gaps? ” (RQ2) • Hypothesis 1.1: Personalization Effectiveness Personalized chatbot interventions will yield greater increases in PEB compared to ”Non-Personal Chat” chatbot interventions and statement-only conditions in human participants. • Hypothesis 1.2: Communication Strategy Impact Psychologically grounded strategies (Future Self Continuity, Action-Oriented Messaging, Moral Foundations, and ”Freestyle”) will increase PEB of human participants, indicating its superior persuasive efficacy against no specific strategy employed. • Hypothesis 2: Synthetic Insight Validity Synthetic participants (both using real-human personas and entirely synthetic personas) provide valuable insights into human responses to PEB interventions, such that trends observed in synthetic evaluations will significantly correlate with human responses across intervention conditions. The human-participant-facing aspects of this study (RQ1) were preregistered on AsPredicted (Registration [retracted for anonymity]). 1.1.2. Contributions Overall, this paper contributes to the fields of HCI, behavioral psychology, and environmental communication in two ways: (1) Empirical insights into persuasion strategies, personalization, and the effectiveness of conversational AI for PEB on actual and simulated/synthetic human participants. We systematically investigate four persuasion strategies influencing users’ PEB, offering data-driven evidence on tailoring messages to diverse audiences. We also assess the impact of personalized conversational AI compared to static communication methods. Based on our findings, we propose design principles for creating agents that engage users on a personal level by incorporating individualized contextual information. (2) Identification of LLM Biases in Simulating Human PEB. We quantify the

Read the complete text