EmbGen: Teaching with Reassembled Corpora
Arun Lenin, Kai Rouse, Andrea Nicastro, Anna Leontjeva · 2026
Read EmbGen: Teaching with Reassembled Corpora by Arun Lenin, Kai Rouse, Andrea Nicastro, Anna Leontjeva (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-19394.txt.
Introduction
Lenin and team present EmbGen, a pipeline that teaches small tuned models with synthetic examples built from a domain corpus. Teacher-model pipelines often yield samey outputs and miss links across passages and documents. EmbGen splits a corpus into entity-description pairs, reassembles them by embedding similarity, and samples question-answer pairs within and across clusters. Against three rivals on three datasets, it lifts a combined accuracy-and-completeness score by 12.5 percent at five million tokens and 88.9 percent at twenty million on the most varied set.
Catalog record
| CREATOR | Arun Lenin, Kai Rouse, Andrea Nicastro, Anna Leontjeva |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 135150 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.19394