Extracting Small Translation Specialists from LLMs by Aggressively Pruning Experts
Liu O. Martin Lucas Bandarkar Nanyun Peng University of California, Los Angeles · 2026
Read Extracting Small Translation Specialists from LLMs by Aggressively Pruning Experts by Liu O. Martin Lucas Bandarkar Nanyun Peng University of California, Los Angeles (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28042.txt.
Description
Liu O. Martin, Lucas Bandarkar, and Nanyun Peng shrink translation models by pruning experts a generalist language model does not need for translation. Because multilingual skills separate cleanly, half the experts can go with negligible loss and no retraining. A brief fine-tune then recovers baseline quality with three-quarters pruned, and nearly nine-tenths pruned stays usable.
Catalog record
| CREATOR | Liu O. Martin Lucas Bandarkar Nanyun Peng University of California, Los Angeles |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56185 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.28042