Extracting Small Translation Specialists from LLMs by Aggressively Pruning Experts

Liu O. Martin Lucas Bandarkar Nanyun Peng University of California, Los Angeles · 2026

Read Extracting Small Translation Specialists from LLMs by Aggressively Pruning Experts by Liu O. Martin Lucas Bandarkar Nanyun Peng University of California, Los Angeles (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28042.txt.

Description

Liu O. Martin, Lucas Bandarkar, and Nanyun Peng shrink translation models by pruning experts a generalist language model does not need for translation. Because multilingual skills separate cleanly, half the experts can go with negligible loss and no retraining. A brief fine-tune then recovers baseline quality with three-quarters pruned, and nearly nine-tenths pruned stays usable.

Catalog record

CREATORLiu O. Martin Lucas Bandarkar Nanyun Peng University of California, Los Angeles
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56185
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2605.28042

Browse the full library · About the Tower of Babel