Mosaic: Composite Projection Pruning for Resource-efficient LLMs
Bailey J. Eccles, Leon Wong, and Blesson Varghese · 2025
Read Mosaic: Composite Projection Pruning for Resource-efficient LLMs by Bailey J. Eccles, Leon Wong, and Blesson Varghese (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-06323.txt.
Description
Bailey Eccles, Leon Wong, and Blesson Varghese shrink large language models by pruning their projections. Their 2025 paper introduces Mosaic, a system for making and serving trimmed models. Heavy compute and memory needs keep big models off modest hardware, and coarse pruning cuts too bluntly, deleting parts the model needs.
Their fine-grained method prunes projection layers directly. A composite recipe then pairs two cuts: a scattered one that guards accuracy and a structured one that sheds real size. Across models, data sets, and hardware, Mosaic built pruned models about seven times faster than rivals. Its models read text far more cleanly and answered more accurately than coarse-pruned peers, while running faster on less graphics memory. The code is public.
Catalog record
| CREATOR | Bailey J. Eccles, Leon Wong, and Blesson Varghese |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-06323