Biomed-Enriched: A Biomedical Dataset Enriched with LLMs for Pretraining and Extracting Rare and Hidden Content
Rian Touchent, Nathan Godey & Eric de la Clergerie · 2025
Read Biomed-Enriched: A Biomedical Dataset Enriched with LLMs for Pretraining and Extracting Rare and Hidden Content by Rian Touchent, Nathan Godey & Eric de la Clergerie (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-20331.txt.
Description
Rian Touchent, Nathan Godey, and Eric de la Clergerie present a 2025 data set of biomedical text, enriched by language models, called Biomed-Enriched. Real clinical text is hard to share because hospital records are private. The team built a public stand-in from PubMed articles, sorted and graded by machine readers.
A large model first scored 400,000 paragraphs for their type, their field, and how fit they are for college-level learning. A small model trained on those scores then labeled the whole open corpus. The labels let users carve out rich subsets, among them two million clinical case paragraphs. Early training tests with these subsets reached the same scores with a third of the text, and lifted results on medical exam questions. The authors offer the set for biomedical language work.
Catalog record
| CREATOR | Rian Touchent, Nathan Godey & Eric de la Clergerie |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-20331