Progressive Binarization with Semi-Structured Pruning for LLMs

Xianglong Yan, Tianao Zhang, Zhiteng Li, Yulun Zhang † · 2025

Read Progressive Binarization with Semi-Structured Pruning for LLMs by Xianglong Yan, Tianao Zhang, Zhiteng Li, Yulun Zhang † (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-01705.txt.

Description

Xianglong Yan and co-authors shrank large language models two ways at once in a 2025 paper. Binarization, the most extreme squeeze, stores each weight in one bit. Even then, models hold spare parts that pruning can cut, yet a naive mix of both wrecks quality.

Their frame adds the cuts in a slow, staged way and prunes in a semi-structured pattern that hardware likes. The stages let the model heal between cuts, so skill falls gently. The result fits big models on small devices with less loss. Phones and edge boxes are the prize.

Catalog record

CREATORXianglong Yan, Tianao Zhang, Zhiteng Li, Yulun Zhang †
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-01705

Browse the full library · About the Tower of Babel