Towards Strategic Persuasion with Language Models

Zirui Cheng, Jiaxuan You · 2025

Read Towards Strategic Persuasion with Language Models by Zirui Cheng, Jiaxuan You (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-22989.txt.

Introduction

Language models can persuade people about as well as humans can, which brings both promise and risk. Zirui Cheng and Jiaxuan You build a theory-led test bed for that skill. They ground the work in Bayesian persuasion theory. Human persuasion data sets become arenas where models act as strategic persuaders. Scores measure how much a model gains by shaping what others learn.

Top models earned high persuasion gains and used tactics that match theory. The pair then trained models with reinforcement learning inside these arenas. Even small models raised their gains a lot after training. The setup gives a scalable way to study machine persuasion.

Catalog record

CREATORZirui Cheng, Jiaxuan You
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE94 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-22989

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Towards Strategic Persuasion with Language Models Zirui Cheng, Jiaxuan You Abstract Large language models (LLMs) have demonstrated strong persuasive capabilities comparable to those of humans, offering promising benefits while raising societal concerns about their deployment. However, systematically evaluating the persuasive capabilities of LLMs is inherently challenging, as the effectiveness of persuasion among humans varies significantly across different domains. In this paper, we take a theory-driven approach to provide a scalable and principled framework for measuring the persuasive capabilities of LLMs. Grounded in the Bayesian Persuasion (BP) framework, we repurpose existing human-human persuasion datasets to construct environments for evaluating and training LLMs in strategic persuasion. Our results reveal that frontier models can consistently achieve high persuasion gains and exhibit sophisticated persuasion strategies that align with theoretical predictions. Building on this, we use reinforcement learning to train LLMs for strategic persuasion in our environments. Our results also demonstrate that even small LLMs can obtain significantly higher persuasion gains through reinforcement learning. 1 Introduction The efficiency of economic and political systems depends on the accuracy of individuals’ beliefs ( DellaVigna & Gentzkow 2010 ) . Although some beliefs come from direct observation, much of the information people rely on is supplied by actors with vested interests. Therefore, persuasion , the effort to shape or change behaviors or thoughts, has played an important role in numerous economic realms, such as advertising ( Anderson & Renault 2006 ) , voting ( Alonso & CÂmara 2016 ) , security ( Brown et al. 2005 ) , medical research ( Kolotilin 2013 ) , and financial regulation ( Gick & Pausch 2012 ) . However, previous research has long debated the consequences of persuasion: some emphasize manipulation by political and economic elites ( Lippmann 1922 ; Robinson 1933 ; Galbraith 1971 ) , while others argue that even motivated communication can provide useful information that improves efficiency ( Bernays 1928 ; Downs 1957 ; Stigler 1961 ) . With rapid advances in large language models (LLMs), frontier models have demonstrated remarkable capabilities to generate persuasive content that is comparable to humans ( Durmus et al. 2024 ; Salvi et al. 2024 ) . GPT-4o’s persuasive capabilities in text were rated as a "medium" risk—the highest risk factor identified in OpenAI’s evaluations ( OpenAI et al. 2024 ) , intensifying societal concerns over the responsible deployment of LLMs. Such persuasive capabilities present both significant opportunities and substantial risks in various domains. For example, in health campaigns, LLMs can be leveraged in public health messaging to promote COVID-19 vaccination ( Karinshak et al. 2023 ) ; in marketing and sales, LLMs can outperform human experts in generating real estate marketing descriptions ( Wu et al. 2025 ) ; and in political elections, LLMs can influence user political views merely by engaging in casual, policy-oriented conversations ( Potter et al. 2024 ) . However, it is challenging to measure the progress of LLMs’ persuasive capabilities across different domains. Empirical evidence in human persuasion reveals highly heterogeneous effects even in human-human persuasion ( DellaVigna & Gentzkow 2010 ) : advertising may sway inexperienced consumers but leave experienced ones unmoved, while political communication often reinforces prior beliefs rather than changing them. Even within the same domain, results vary widely across contexts, making it difficult to compare findings or generalize conclusions. Despite previous research efforts to evaluate the persuasiveness of LLMs by measuring the persuasiveness of the generated text with human evaluation or automatic evaluation ( Durmus et al. 2024 ; Salvi et al. 2024 ; Singh et al. 2024 ; Bozdag et al. 2025a ; Wu et al. 2025 ) , there are very limited systematic methods to tackle such challenges. Different evaluation setups and various evaluation metrics lacking conceptual clarity often resulted in limited, inconsistent, or even mixed results with respect to the persuasive capabilities of LLMs ( Bozdag et al. 2025b ) . Meanwhile, developing scalable methods to advance LLMs’ persuasive capabilities presents inherent challenges. Previous research predominantly relies on human evaluation of LLMs’ persuasive effects, with some studies claiming that certain LLMs can produce persuasive arguments comparable to humans ( Durmus et al. 2024 ) . However, human evaluation remains inherently subjective and resource-intensive; thus, accurate evaluation with humans is challenging. For example, Durmus et al. 2024 found that model-based persuasiveness scores did not correlate well with human judgments of persuasiveness. Despite the potential drawbacks of current LLMs in evaluating persuasiveness, underspecified human factors could also lead to significant differences in results. Figure 1: Strategic persuasion with LLMs. LLMs can influence human decisions and behaviors through strategic information revelation without resorting to deception. Controlled partial information revelation often proves more effective in persuasion settings than either complete transparency or total opacity. To tackle similar challenges, previous research in game theory has provided a rigorous foundation by conceptualizing persuasion as strategic interactions between informed senders and uninformed receivers. Frameworks such as cheap-talk models ( Crawford & Sobel 1982 ) and persuasion games ( Milgrom & Roberts 1986 ) formalize how agents update their beliefs and adjust their actions under the assumption of Bayesian rationality. Within previous literature, Bayesian persuasion ( Kamenica & Gentzkow 2011 ) has emerged as a particularly influential paradigm. By defining persuasion as the strategic provision of information , it offers a systematic framework to identify when and how an informed sender can shape the decisions of a rational receiver. In addition, subsequent work demonstrates that this framework can rigorously characterize the welfare and equilibrium implications of selective information disclosure, even when receivers fully anticipate the sender’s strategic motives. In this paper, we take a theory-driven approach to tackle the challenges. We propose a scalable and principled framework for understanding the persuasive capabilities of LLMs grounded in the Bayesian persuasion framework, thus bringing rigor to both conceptual and operational work on the persuasive capabilities of LLMs. We begin by considering LLMs’ persuasive capabilities as the Sender’s ability to strategically reveal information that causes a Receiver to update their beliefs in a direction favorable to the Sender’s objectives. Within this framework, we repurpose previous datasets in human-human persuasion to construct environments where the Sender and Receiver are both implemented with LLMs. We conduct a human study with 45 participants to show the plausibility of the environment design. In our experiments, analysis with frontier models reveals that stronger models such as DeepSeek-R1 ( DeepSeek-AI et al. 2025 ) can achieve significantly higher gains from persuasion. In the meantime, stronger models also exhibit more sophisticated behaviors aligning with characterizations of better strategies in theoretical predictions, such as adaptive information revelation. Furthermore, we investigate potential methods to advance the persuasive capabilities of LLMs. We use reinforcement learning algorithms to train LLMs for strategic persuasion. With our environments, we train the Sender LLMs against the Receiver LLMs. Our results indicate that even small LLMs (Llama3.2-3B-Instruct ( Grattafiori et al. 2024 ) ) can be trained to advance strategic persuasion capabilities that are comparable to large LLMs. The results of our experiment indicate that LLMs trained through reinforcement learning can achieve significantly higher persuasion gains. Moreover, such improvement in persuasive capabilities can also be transferred to different Receiver architectures, providing evidence that LLMs can learn effective strategies in information design in our environments.

Read the complete text