Collaborative Evaluation of Deepfake Text with Deliberation-Enhancing Dialogue Systems

Jooyoung Lee, Xiaochen Zhu, Georgi Karadzhov, Tom Stafford, Andreas Vlachos, Dongwon Lee · 2025

Read Collaborative Evaluation of Deepfake Text with Deliberation-Enhancing Dialogue Systems by Jooyoung Lee, Xiaochen Zhu, Georgi Karadzhov, Tom Stafford, Andreas Vlachos, Dongwon Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-04945.txt.

Description

Jooyoung Lee and five co-authors tested in 2025 whether groups, helped by a chatbot, can spot machine-written text. Fake text from modern generators is hard to tell from human writing alone. Their chatbot is built to deepen group discussion rather than to answer directly. The team compared solo work with group work, with and without the bot.

Groups beat solo workers at spotting fake paragraphs. The bot did not raise scores overall, but it changed how groups talked: members joined in more, agreed more, and gave reasons more often. People who already valued group work gained the most from the bot. The authors say such bots may help teams judge content together, even when headline accuracy stays flat.

Catalog record

CREATORJooyoung Lee, Xiaochen Zhu, Georgi Karadzhov, Tom Stafford, Andreas Vlachos, Dongwon Lee
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-04945

Browse the full library · About the Tower of Babel