Mashup Learning: Faster Finetuning by Remixing Past Checkpoints
Sofia Maria Lo Cicero Vaina, Artem Chumachenko, Max Ryabinin · 2026
Read Mashup Learning: Faster Finetuning by Remixing Past Checkpoints by Sofia Maria Lo Cicero Vaina, Artem Chumachenko, Max Ryabinin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-10156.txt.
Description
Sofia Maria Lo Cicero Vaina, Artem Chumachenko and Max Ryabinin reuse old fine tuning checkpoints to start new training runs faster. Each past run leaves weights with useful skills, yet those artifacts usually sit unused. Mashup Learning picks the most relevant past checkpoints for a target data set, merges them, and trains from that blend. Across many benchmarks it lifts accuracy and cuts the steps and wall clock time needed.
Catalog record
| CREATOR | Sofia Maria Lo Cicero Vaina, Artem Chumachenko, Max Ryabinin |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39572 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.10156