Tailored Truths: Optimizing LLM Persuasion with Personalization and Fabricated Statistics
Jasper Timm, Chetan Talele, Jacob Haimes · 2025
Read Tailored Truths: Optimizing LLM Persuasion with Personalization and Fabricated Statistics by Jasper Timm, Chetan Talele, Jacob Haimes (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-17273.txt.
Introduction
Jasper Timm, Chetan Talele, and Jacob Haimes measure how well language models can persuade people in a 2025 study. Models can now tailor arguments to a reader using personal data, which raises the scale at which disinformation could work. The team set up debates in which a person argued with model-made text meant to change their view.
Thirty-three people took part. The researchers measured each person's agreement with the debate claim before and after, and tracked both how far views moved and whether they moved the model's way. They compared several tactics: arguments shaped by the reader's traits, arguments backed by invented statistics, and a mix of both. The study names itself with a warning: tailored text plus fake numbers is a potent mix, and knowing its strength is a first step to defense.
Catalog record
| CREATOR | Jasper Timm, Chetan Talele, Jacob Haimes |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-17273
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Tailored Truths: Optimizing LLM Persuasion with Personalization and Fabricated Statistics Jasper Timm, Chetan Talele, Jacob Haimes Abstract Large Language Models (LLMs) are becoming increasingly persuasive, demonstrating the ability to personalize arguments in conversation with humans by leveraging their personal data. This may have serious impacts on the scale and effectiveness of disinformation campaigns. We studied the persuasiveness of LLMs in a debate setting by having humans ( n = 33 n=33 ) engage with LLM-generated arguments intended to change the human’s opinion. We quantified the LLM’s effect by measuring human agreement with the debate’s hypothesis pre- and post-debate and analyzing both the magnitude of opinion change, as well as the likelihood of an update in the LLM’s direction. We compare persuasiveness across established persuasion strategies, including personalized arguments informed by user demographics and personality, appeal to fabricated statistics, and a mixed strategy utilizing both personalized arguments and fabricated statistics. We found that static arguments generated by humans and GPT-4o-mini have comparable persuasive power. However, the LLM outperformed static human-written arguments when leveraging the mixed strategy in an interactive debate setting. This approach had a 51% chance of persuading participants to modify their initial position, compared to 32% for the static human-written arguments. Our results highlight the concerning potential for LLMs to enable inexpensive and persuasive large-scale disinformation campaigns. 1 Introduction LLMs have the potential to influence public opinion on a massive scale ( Buchanan et al., 2021 ) , with prior work noting that this capability can be leveraged to durably reduce belief in conspiracy theories ( Costello et al., 2024 ; Liu et al., 2024 ) . However, threat actors can also use LLMs for malicious purposes, from influencing the results of critical elections and referendums to boosting the popularity of states or figures with otherwise controversial or unfavorable standing. These potential use cases have significant implications for the fairness of democratic processes and social stability ( Barman et al., 2024 ; Goldstein et al., 2023 ; Himelein-Wachowiak et al., 2021 ; Woollacott, 2024 ) . Although previous studies have compared the ability of humans and LLMs to create persuasive arguments, as well as the impact of having personalized information on opponents in a debate setting 1 1 1 A controlled, turn-based environment in which two parties make a case for opposing sides of an argument. ( Durmus et al., 2024 ; Salvi et al., 2024 ) , there are few works focused on the upper limit of LLM persuasion. We investigate the capability of LLMs to persuade human participants in a debate setting using dialogue that incorporates personalization, fabricated statistics, and a combination approach. To contextualize the effectiveness of these debates, we additionally have participants read static arguments: one written by a human, and another that is LLM generated. In this work, we: • Create and leverage a custom platform for studies involving human-LLM interaction to conduct m=198 persuasion trials over n=33 participants. • Determine that, in a debate setting, GPT-4o-mini is often more persuasive than presenting individuals with a static argument, with effectiveness depending on the debate strategy applied. • Show that simple prompting and scaffolding approaches improve the persuasiveness of GPT-4o-mini—the mixed approach used in the debate setting is meaningfully more persuasive than a static human-written argument. 2 Background and Related Work Information Operations (InfoOps) The collection and use of information to influence, disrupt, or corrupt the decision-making process of adversaries is known as InfoOps ( CNSS, 2022 ) . State sponsored actors are typically the most active in conducting InfoOps ( Bradshaw et al., 2021 ) , and common applications include shifting public opinion, increasing polarization, and sowing discord within groups. “Bots” are often used in InfoOps to automate simple yet time-consuming tasks, such as populating accounts with authentic looking posts, responding to popular posts from opponents with links to fake news articles, and increasing engagement in their posts by liking and replying to each other’s posts in a coordinated network ( Harding, 2024 ; Himelein-Wachowiak et al., 2021 ) . With the advent of LLMs, the possibility of engaging users in a more interactive manner, such as by addressing their particular arguments in an extended discussion, is plausible at mass scale. There is evidence that LLMs are already being used in InfoOps—this year OpenAI released a report which included the use of their API in disinformation campaigns ( Anand, 2024 ; Linvill & Warren, 2024 ; OpenAI, 2024b ) . Use cases mentioned included: generating fake news articles, editing and proofreading propaganda content, and creating synthetic personas. Generating comments in response to other propaganda accounts’ posts were used to simulate public engagement; however, the report did not mention directly engaging with comments or posts from genuine users. These reported incidents provide a lower bound on the actual usage of LLMs in InfoOps as (i) model providers may not detect or report every incident, and (ii) self-hosted models can be used without monitoring. Accessibility and general capabilities Wang et al. (2023) state that GPT-4 is able to engage in debates with insight—incorporating relevant facts and counter arguments with logical consistency, while others have even claimed the model can employ techniques such as fact based reasoning and empathetic storytelling to deliver coherent and convincing responses ( Breum et al., 2023 ) . These capabilities can then be augmented with scaffolding techniques, such as scratchpads and multi-agent systems, which have been shown to enhance LLM capabilities, especially on complex tasks ( Nye et al., 2021 ; Wang et al., 2024 ) . Many models can also be fine-tuned to further improve performance on specific tasks, such as increased persuasiveness and reduced refusal ( Dubey et al., 2024 ) . These advanced systems are not only powerful, but accessible; running frontier LLMs is very inexpensive ( OpenAI, 2024a ) , and open-weight models can be downloaded and deployed without substantial expertise. Persuasion When comparing the persuasive potential of LLMs to humans, studies have shown that frontier LLMs can be as good or sometimes better than humans, but evidence is limited ( Durmus et al., 2024 ) . Salvi et al. (2024) found that GPT-4 was more persuasive in debate than humans, without personalization, but the result was not statistically significant. ( Durmus et al., 2024 ) found that when focusing on a technique of deception, frontier models could outperform humans when creating persuasive arguments. Studies conducted using both human and LLM generated arguments, which compare the effectiveness of many persuasive approaches to argument, have shown that humans find knowledge , that is, facts and ideas, to be the most persuasive ( Breum et al., 2023 ; Monti et al., 2022 ) . When asked to generate persuasive arguments without specifying any strategy, LLMs default to a knowledge approach ( Breum et al., 2023 ) ; attributing this to LLM understanding, however, seems incorrect. Studies have shown that passages an LLM predicts to be persuasive often do not correlate well with what humans actually find persuasive ( Durmus et al., 2024 ) . While LLMs tend to give a similar rating to many persuasion techniques, humans reported an overwhelming preference for knowledge , with the other techniques trailing far behind ( Breum et al., 2023 ) . In the