Detecting Data Contamination in Large Language Models
Juliusz Janicki, Savvas Chamezopoulos, Evangelos Kanoulas, Georgios Tsatsaronis · 2026
Read Detecting Data Contamination in Large Language Models by Juliusz Janicki, Savvas Chamezopoulos, Evangelos Kanoulas, Georgios Tsatsaronis (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-19561.txt.
Description
Janicki and colleagues study membership inference attacks for detecting data contamination in large language models. Language models train on vast data, some possibly from copyrighted sources. Membership inference attacks aim to detect whether specific documents entered training corpora. Black-box attacks need significant data manipulation, making comparison hard. The authors compare state-of-the-art black-box attacks on unified datasets and develop Familiarity Ranking, a new method giving models more freedom of expression. Whether any current method works well remains open.
Catalog record
| CREATOR | Juliusz Janicki, Savvas Chamezopoulos, Evangelos Kanoulas, Georgios Tsatsaronis |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66107 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.19561