PDR: A Plug-and-Play Positional Decay Framework for LLM Pre-training Data Detection

Jinhan Liu, Yibo Yang, Ruiying Lu, Piotr Piękos, Yimeng Chen, Peng Wang, Dandan Guo · 2026

Read PDR: A Plug-and-Play Positional Decay Framework for LLM Pre-training Data Detection by Jinhan Liu, Yibo Yang, Ruiying Lu, Piotr Piękos, Yimeng Chen, Peng Wang, Dandan Guo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-06827.txt.

Description

Research by Jinhan Liu and co-authors was posted on arXiv in 2026. It deals with PDR. The preprint joined the arXiv PAPERS collection in 2026. Detecting pre-training data in Large Language Models (LLMs) is crucial for auditing data privacy and copyright compliance.

Yet it remains challenging in black-box, zero-shot settings where computational resources and training data are scarce. While existing likelihood-based methods have shown promise, they typically aggregate token-level scores using uniform weights, thereby neglecting the inherent information-theoretic dynamics of autoregressive generation. For specialists, the preprint offers a compact account of the problem and the authors' approach.

Catalog record

CREATORJinhan Liu, Yibo Yang, Ruiying Lu, Piotr Piękos, Yimeng Chen, Peng Wang, Dandan Guo
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE98 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-06827

Browse the full library · About the Tower of Babel