LLM Spirals of Delusion: A Benchmarking Audit Study of AI Chatbot Interfaces

Peter Kirgis, Ben Hawriluk, [2pt] Sherrie Feng, Aslan Bilimer, Sam Paech, Zeynep Tufekci, [4pt] Princeton University Phillips Exeter Academy Independent Equal contribution · 2026

Read LLM Spirals of Delusion: A Benchmarking Audit Study of AI Chatbot Interfaces by Peter Kirgis, Ben Hawriluk, [2pt] Sherrie Feng, Aslan Bilimer, Sam Paech, Zeynep Tufekci, [4pt] Princeton University Phillips Exeter Academy Independent Equal contribution (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-06188.txt.

Description

Kirgis and five colleagues audit how chatbots handle delusional and conspiratorial talk across 56 twenty-turn conversations with ChatGPT-4o and ChatGPT-5 via APIs and chat interfaces. Chat-interface results differ sharply from API results, so API-only testing misses real-world impact. In chat, ChatGPT-5 shows milder delusion reinforcement, escalation, and sycophancy than ChatGPT-4o, tying behavior to company policy choices. Similar overall intensity can hide different turn-by-turn paths, updated models still show substantial negative behavior, and the same API endpoint reverses behavior within two months.

Catalog record

CREATORPeter Kirgis, Ben Hawriluk, [2pt] Sherrie Feng, Aslan Bilimer, Sam Paech, Zeynep Tufekci, [4pt] Princeton University Phillips Exeter Academy Independent Equal contribution
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65539
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.06188

Browse the full library · About the Tower of Babel