Fake News Detection After LLM Laundering: Measurement and Explanation

Rupak Kumar Das, Dr. Jonathan Dodge · 2025

Read Fake News Detection After LLM Laundering: Measurement and Explanation by Rupak Kumar Das, Dr. Jonathan Dodge (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-18649.txt.

Description

Rupak Kumar Das and Jonathan Dodge wrote this 2025 study on whether fake news detectors still work after a language model rewrites the story. Models can now launder a fake story into fresh wording that sounds smooth and well-sourced. Most past work tested detectors on human-written fakes, not on these washed versions.

The team found that detectors do worse on the washed fakes than on the raw ones. They also ranked which models are best at evading, at washing to evade, and at washing while keeping the sense. Word-level explanations pointed to a prime suspect: the rewrite shifts the story's emotional tone, which throws off detectors that lean on tone. Worse, a standard score for rewrite quality stayed high even when the tone had shifted. The authors release data sets pairing stories with their washed versions.

Catalog record

CREATORRupak Kumar Das, Dr. Jonathan Dodge
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-18649

Browse the full library · About the Tower of Babel