Pi voting Fa ctorization: A Compact Meta Low-Rank Representation of Sparsity for Efficient Inference in Large Language Models
Jialin Zhao, Yingtao Zhang, Carlo Vittorio Cannistraci · 2025
Read Pi voting Fa ctorization: A Compact Meta Low-Rank Representation of Sparsity for Efficient Inference in Large Language Models by Jialin Zhao, Yingtao Zhang, Carlo Vittorio Cannistraci (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-19090.txt.
Description
Jialin Zhao and co-authors compress large language models by factoring their weight matrices a second time. Low-rank pruning shrinks layers and runs happily on graphics cards, but it often doubles perplexity where rival pruning styles hold up. Their method, Pivoting Factorization, finds the independent pivot rows inside any low-rank layer and rewrites the rest as combinations of them.
That lossless re-expression saves about a quarter more memory and runs about a quarter faster than the low-rank form alone. A companion reconstruction step, done without retraining, repairs the damage pruning caused, limiting how errors stack up. Together the framework matches semi-structured pruning on quality while beating it on GPU manners. Code is public for builders squeezing models onto real hardware.
Catalog record
| CREATOR | Jialin Zhao, Yingtao Zhang, Carlo Vittorio Cannistraci |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-19090