Detecting Data Contamination in Large Language Models

Juliusz Janicki, Savvas Chamezopoulos, Evangelos Kanoulas, Georgios Tsatsaronis · 2026

Read Detecting Data Contamination in Large Language Models by Juliusz Janicki, Savvas Chamezopoulos, Evangelos Kanoulas, Georgios Tsatsaronis (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19561.txt.

Description

Janicki and colleagues study membership inference attacks for detecting data contamination in large language models. Language models train on vast data, some possibly from copyrighted sources. Membership inference attacks aim to detect whether specific documents entered training corpora. Black-box attacks need significant data manipulation, making comparison hard. The authors compare state-of-the-art black-box attacks on unified datasets and develop Familiarity Ranking, a new method giving models more freedom of expression. Whether any current method works well remains open.

Catalog record

CREATORJuliusz Janicki, Savvas Chamezopoulos, Evangelos Kanoulas, Georgios Tsatsaronis
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66107
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.19561

Browse the full library · About the Tower of Babel