Mashup Learning: Faster Finetuning by Remixing Past Checkpoints

Sofia Maria Lo Cicero Vaina, Artem Chumachenko, Max Ryabinin · 2026

Read Mashup Learning: Faster Finetuning by Remixing Past Checkpoints by Sofia Maria Lo Cicero Vaina, Artem Chumachenko, Max Ryabinin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-10156.txt.

Description

Sofia Maria Lo Cicero Vaina, Artem Chumachenko and Max Ryabinin reuse old fine tuning checkpoints to start new training runs faster. Each past run leaves weights with useful skills, yet those artifacts usually sit unused. Mashup Learning picks the most relevant past checkpoints for a target data set, merges them, and trains from that blend. Across many benchmarks it lifts accuracy and cuts the steps and wall clock time needed.

Catalog record

CREATORSofia Maria Lo Cicero Vaina, Artem Chumachenko, Max Ryabinin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39572
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.10156

Browse the full library · About the Tower of Babel