EmbGen: Teaching with Reassembled Corpora

Arun Lenin, Kai Rouse, Andrea Nicastro, Anna Leontjeva · 2026

Read EmbGen: Teaching with Reassembled Corpora by Arun Lenin, Kai Rouse, Andrea Nicastro, Anna Leontjeva (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-19394.txt.

Introduction

Lenin and team present EmbGen, a pipeline that teaches small tuned models with synthetic examples built from a domain corpus. Teacher-model pipelines often yield samey outputs and miss links across passages and documents. EmbGen splits a corpus into entity-description pairs, reassembles them by embedding similarity, and samples question-answer pairs within and across clusters. Against three rivals on three datasets, it lifts a combined accuracy-and-completeness score by 12.5 percent at five million tokens and 88.9 percent at twenty million on the most varied set.

Catalog record

CREATORArun Lenin, Kai Rouse, Andrea Nicastro, Anna Leontjeva
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE135150
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2605.19394

Browse the full library · About the Tower of Babel