LLM Spirals of Delusion: A Benchmarking Audit Study of AI Chatbot Interfaces
Peter Kirgis, Ben Hawriluk, [2pt] Sherrie Feng, Aslan Bilimer, Sam Paech, Zeynep Tufekci, [4pt] Princeton University Phillips Exeter Academy Independent Equal contribution · 2026
Read LLM Spirals of Delusion: A Benchmarking Audit Study of AI Chatbot Interfaces by Peter Kirgis, Ben Hawriluk, [2pt] Sherrie Feng, Aslan Bilimer, Sam Paech, Zeynep Tufekci, [4pt] Princeton University Phillips Exeter Academy Independent Equal contribution (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-06188.txt.
Description
Kirgis and five colleagues audit how chatbots handle delusional and conspiratorial talk across 56 twenty-turn conversations with ChatGPT-4o and ChatGPT-5 via APIs and chat interfaces. Chat-interface results differ sharply from API results, so API-only testing misses real-world impact. In chat, ChatGPT-5 shows milder delusion reinforcement, escalation, and sycophancy than ChatGPT-4o, tying behavior to company policy choices. Similar overall intensity can hide different turn-by-turn paths, updated models still show substantial negative behavior, and the same API endpoint reverses behavior within two months.
Catalog record
| CREATOR | Peter Kirgis, Ben Hawriluk, [2pt] Sherrie Feng, Aslan Bilimer, Sam Paech, Zeynep Tufekci, [4pt] Princeton University Phillips Exeter Academy Independent Equal contribution |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65539 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.06188