Progressive Binarization with Semi-Structured Pruning for LLMs
Xianglong Yan, Tianao Zhang, Zhiteng Li, Yulun Zhang † · 2025
Read Progressive Binarization with Semi-Structured Pruning for LLMs by Xianglong Yan, Tianao Zhang, Zhiteng Li, Yulun Zhang † (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-01705.txt.
Description
Xianglong Yan and co-authors shrank large language models two ways at once in a 2025 paper. Binarization, the most extreme squeeze, stores each weight in one bit. Even then, models hold spare parts that pruning can cut, yet a naive mix of both wrecks quality.
Their frame adds the cuts in a slow, staged way and prunes in a semi-structured pattern that hardware likes. The stages let the model heal between cuts, so skill falls gently. The result fits big models on small devices with less loss. Phones and edge boxes are the prize.
Catalog record
| CREATOR | Xianglong Yan, Tianao Zhang, Zhiteng Li, Yulun Zhang † |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-01705