The KL3M Data Project: Copyright-Clean Training Resources for Large Language Models
Michael J Bommarito II, Jillian Bommarito & Daniel Martin Katz · 2025
Read The KL3M Data Project: Copyright-Clean Training Resources for Large Language Models by Michael J Bommarito II, Jillian Bommarito & Daniel Martin Katz (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-07854.txt.
Description
Michael Bommarito and co-authors introduce a copyright-clean training corpus for language models in a 2025 paper. Nearly every large model has trained on text of murky legal status, leaving builders and users exposed to copyright and contract claims.
The KL3M Data Project answers with the largest pipeline built to keep that risk low. It gathers over 132 million documents from sixteen sources, each checked against a strict rights and licensing protocol. The team releases everything: the collection code, the original documents with their provenance, cleaned text, ready-to-train tokens, and extra sets for tasks like questions, summaries, and drafting. The open release gives model builders a lawful foundation to stand on.
Catalog record
| CREATOR | Michael J Bommarito II, Jillian Bommarito & Daniel Martin Katz |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-07854