Lies, Damned Lies, and Distributional Language Statistics: Persuasion and Deception with Large Language Models

Cameron R. Jones, Benjamin K. Bergen · 2024

Read Lies, Damned Lies, and Distributional Language Statistics: Persuasion and Deception with Large Language Models by Cameron R. Jones, Benjamin K. Bergen (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-17128.txt.

Introduction

Cameron Jones and Benjamin Bergen review what is known about how well large language models persuade and deceive, in a 2024 paper. AI text can now match human writing for persuasive force, and models seem able to produce deceptive output on request. The review gathers the experiments, weighs the risks, and grades the proposed defenses.

Measured effects so far are small, the authors find. But fine-tuning, added media modes, and social embedding could all amplify them. Open questions include how persuasive these systems can become, whether truth holds any built-in edge over falsehood, and which mitigations actually work in practice. The paper maps an agenda for a risk that will grow with deployment.

Catalog record

CREATORCameron R. Jones, Benjamin K. Bergen
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE132 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-17128

Browse the full library · About the Tower of Babel