Will it Merge? On The Causes of Model Mergeability
Adir Rahamim, Asaf Yehudai, Boaz Carmeli, Leshem Choshen, Yosi Mass, Yonatan Belinkov · 2026
Read Will it Merge? On The Causes of Model Mergeability by Adir Rahamim, Asaf Yehudai, Boaz Carmeli, Leshem Choshen, Yosi Mass, Yonatan Belinkov (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-06672.txt.
Description
Adir Rahamim and co-authors ask why some models merge well in 2026. Model merging combines several fine-tuned models into one multitask model. It promises multitask ability without retraining from scratch, they note.
Yet factors deciding merging success or failure remain poorly understood. They investigate why specific models merge better than others systematically. To do so, they propose a concrete, measurable definition of mergeability. A measurable definition turns folklore into testable claims about models. Practitioners merging checkpoints get guidance on which pairs should work. The study matters as merged models proliferate in open model ecosystems. Readers learn mergeability is a property to measure, not guess. Their definition gives future merging methods a target to optimize.
Catalog record
| CREATOR | Adir Rahamim, Asaf Yehudai, Boaz Carmeli, Leshem Choshen, Yosi Mass, Yonatan Belinkov |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-06672