Evidencing Unauthorized Training Data from AI Generated Content using Information Isotopes
Tao Qi, Jinhua Yin, Dongqi Cai, Yueqi Xie, Huili Wang, Zhiyang Hu, Peiru Yang, Guoshun Nan, Zhili Zhou, Shangguang Wang, Lingjuan Lyu, Yongfeng Huang, Nicholas D. Lane · 2025
Read Evidencing Unauthorized Training Data from AI Generated Content using Information Isotopes by Tao Qi, Jinhua Yin, Dongqi Cai, Yueqi Xie, Huili Wang, Zhiyang Hu, Peiru Yang, Guoshun Nan, Zhili Zhou, Shangguang Wang, Lingjuan Lyu, Yongfeng Huang, Nicholas D. Lane (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-20800.txt.
Introduction
Tao Qi and co-authors found a way to prove stolen training data from a model's own output in a 2025 paper. AI firms race to gather top human data, and some may train on text they had no right to use. The services run on closed cloud systems, so owners cannot peek inside to check.
Their method plants tracer traits, called information isotopes, that ride along in the data. When a model trained on that data writes, the tracers leave a mark that can be detected from outside. Owners can then show misuse with proof, not mere doubt. The work aims to guard privacy and ownership rights in the data race.
Catalog record
| CREATOR | Tao Qi, Jinhua Yin, Dongqi Cai, Yueqi Xie, Huili Wang, Zhiyang Hu, Peiru Yang, Guoshun Nan, Zhili Zhou, Shangguang Wang, Lingjuan Lyu, Yongfeng Huang, Nicholas D. Lane |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-20800
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Evidencing Unauthorized Training Data from AI Generated Content using Information Isotopes Tao Qi, Jinhua Yin, Dongqi Cai, Yueqi Xie, Huili Wang, Zhiyang Hu, Peiru Yang, Guoshun Nan, Zhili Zhou, Shangguang Wang, Lingjuan Lyu, Yongfeng Huang, Nicholas D. Lane Abstract In light of scaling laws, many AI institutions are intensifying efforts to construct advanced AIs on extensive collections of high-quality human data. However, in a rush to stay competitive, some institutions may inadvertently or even deliberately include unauthorized data (like privacy- or intellectual property-sensitive content) for AI training, which infringes on the rights of data owners. Compounding this issue, these advanced AI services are typically built on opaque cloud platforms, which restricts access to internal information during AI training and inference, leaving only the generated outputs available for forensics. Thus, despite the introduction of legal frameworks by various countries to safeguard data rights, uncovering evidence of data misuse in modern opaque AI applications remains a significant challenge. In this paper, inspired by the ability of isotopes to trace elements within chemical reactions, we introduce the concept of information isotopes and elucidate their properties in tracing training data within opaque AI systems. Furthermore, we propose an information isotope tracing method designed to identify and provide evidence of unauthorized data usage by detecting the presence of target information isotopes in AI generations. We conduct experiments on ten AI models (including GPT-4o, Claude-3.5, and DeepSeek) and four benchmark datasets in critical domains (medical data, copyrighted books, and news). Results show that our method can distinguish training datasets from non-training datasets with 99% accuracy and significant evidence (p-value < 0.001 <0.001 ) by examining a data entry equivalent in length to a research paper. The findings show the potential of our work as an inclusive tool for empowering individuals, including those without expertise in AI, to safeguard their data rights in the rapidly evolving era of AI advancements and applications. Introduction Artificial intelligence (AI) technologies, exemplified by large language models (LLMs), have witnessed remarkable advancements, showcasing exceptional capabilities in generating content with human-like coherence [ 1 , 2 , 3 ] . Leveraging these advanced techniques, prominent AI platforms such as ChatGPT and Claude have emerged as effective tools for assisting users in a diverse range of tasks, like daily information seeking [ 4 , 5 , 6 ] , auxiliary medical diagnosis [ 7 , 8 , 9 , 10 , 11 ] , content creation [ 12 , 13 , 14 , 15 ] , and scientific discovery [ 16 , 17 , 18 , 19 , 20 , 21 ] . These AI systems have demonstrated the ability to provide expert-level insights tailored to user needs, thereby exerting a growing influence across various societal domains [ 22 , 23 , 24 , 25 , 26 , 27 ] . Recent investigations into the underlying mechanisms of AI systems have revealed that their primary source of intelligence lies in the extensive knowledge embedded within their training data [ 28 , 29 , 30 , 31 ] . Building upon the cumulative achievements in AI development, the principle of scaling has been proposed to underscore the benefits of increasing both model size and dataset volume for enhancing AI performance [ 32 ] . This scaling law has become a foundational principle in modern AI development, guiding the creation of advanced systems capable of demonstrating emergent super intelligence [ 33 , 34 , 31 , 35 , 36 ] . Figure 1: The unauthorized data usage issue in AI training and corresponding detection methodologies. A SOTA AI systems and their disclosure of training data details. The diameter of the circles represents the extent of disclosed information regarding training data sources. Results indicate that recent AI systems (those outside the gray box) often achieve superior performance, however, most refrain from disclosing the specific sources of their training data. This lack of transparency complicates efforts to verify unauthorized data usage in AI training. B The workflow of existing methods for detecting AI training data. C A case study on detecting training data through AI-generated content. When presented with a segment of training data, the continuation generated by the AI often exhibits low similarity with the original human-authored continuation due to the advanced AI optimization algorithms. This shows the difficulty in providing conclusive evidence of training data usage through AI generations. D An illustration of the traceability property of information isotopes within opaque AI systems. The success of scaling laws has intensified competition among AI developers to collect ever-larger human-produced data for training purposes [ 37 , 38 ] . However, many large-scale and high-quality datasets sourced from public internet platforms are governed by strict licensing agreements that prohibit commercial use or even data collection [ 37 , 39 , 40 ] . Besides, the online user data collected from social media or private domains (e.g., the user interaction records on AI platforms) may also contain privacy-sensitive information, the utilization of which for AI training shall be authorized [ 40 , 41 , 42 ] . Regrettably, some AI developers, either inadvertently or deliberately, incorporate unauthorized data into their training processes, thereby infringing upon the rights of data owners and raising significant ethical and legal concerns [ 37 , 39 , 40 ] . Moreover, AIs trained on such unauthorized data are also at an elevated risk of producing outputs that are relevant to privacy- or intellectual property-sensitive information embedded in their training data [ 43 , 44 ] . These risks not only facilitate the illegal distribution of unauthorized data, exacerbating infringements on data ownership rights, but also expose AI users to potential legal and ethical liabilities associated with data misuse. A growing number of lawsuits, including The N.Y. Times v. Microsoft [ 45 ] , Tremblay v. OpenAI [ 46 ] , Andersen v. Stability AI [ 47 ] , Authors Guild v. OpenAI [ 48 ] , and other similar cases, highlight the urgent need of data rights protection in AI development. To safeguard the rights of data owners, governance institutions worldwide have enacted legislation to prevent the unauthorized use of data [ 49 , 50 , 51 , 52 ] . A critical aspect of protecting data rights, particularly in legal disputes, lies in presenting robust evidence on data misuse. In traditional data breach scenarios, infringers typically exploit unauthorized transactions of raw data for personal or commercial gain [ 53 ] . Thus, examining the consistency between the original data and the unauthorized data can serve as compelling evidence of infringement [ 53 , 54 ] . For example, the verbatim replication of original literary work on unauthorized platforms is a clear indication of data infringement. However, in the context of AI training, unauthorized data usage manifests differently, instead of distributing raw data, infringers mainly exploit it to enhance AI system performance [ 55 , 56 , 57 , 58 ] . Consequently, only the resulting AI services, rather than the original data, are made publicly accessible, posing significant challenges in identifying and evidencing data infringement [ 40 , 59 ] . This issue is further exacerbated by the tendency of AI developers to obscure or entirely withhold information regarding the sources of their