The KL3M Data Project: Copyright-Clean Training Resources for Large Language Models

Michael J Bommarito II, Jillian Bommarito & Daniel Martin Katz · 2025

Read The KL3M Data Project: Copyright-Clean Training Resources for Large Language Models by Michael J Bommarito II, Jillian Bommarito & Daniel Martin Katz (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-07854.txt.

Description

Michael Bommarito and co-authors introduce a copyright-clean training corpus for language models in a 2025 paper. Nearly every large model has trained on text of murky legal status, leaving builders and users exposed to copyright and contract claims.

The KL3M Data Project answers with the largest pipeline built to keep that risk low. It gathers over 132 million documents from sixteen sources, each checked against a strict rights and licensing protocol. The team releases everything: the collection code, the original documents with their provenance, cleaned text, ready-to-train tokens, and extra sets for tasks like questions, summaries, and drafting. The open release gives model builders a lawful foundation to stand on.

Catalog record

CREATORMichael J Bommarito II, Jillian Bommarito & Daniel Martin Katz
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-07854

Browse the full library · About the Tower of Babel