Detecting RLVR Training Data via Structural Convergence of Reasoning

Hongbo Zhang, Yang Yue, Jianhao Yan, Guangsheng Bao, Yue Zhang, Yue Zhang · 2026

Read Detecting RLVR Training Data via Structural Convergence of Reasoning by Hongbo Zhang, Yang Yue, Jianhao Yan, Guangsheng Bao, Yue Zhang, Yue Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-11792.txt.

Description

Reinforcement learning with checkable rewards now trains many reasoning models, but hidden training data raises leakage worries for benchmarks. Standard likelihood-based spotting falters because this training tunes models from reward feedback on own thought paths, not token odds. Hongbo Zhang and five co-authors show the training leaves a behavioral mark. Prompts seen during training yield more rigid, similar outputs, while unseen prompts keep more variety.

They introduce Min-kNN Distance, a simple black-box test that samples several completions per prompt and averages the smallest nearest-neighbor edit distances. It needs no reference model and no token odds. Across several trained models the test cleanly separates seen from unseen examples, beating existing membership inference and leakage spotting baselines. Rigidity, in short, betrays prior sight.

Catalog record

CREATORHongbo Zhang, Yang Yue, Jianhao Yan, Guangsheng Bao, Yue Zhang, Yue Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-11792

Browse the full library · About the Tower of Babel