Deterministic Differentiable Structured Pruning for Large Language Models

Weiyu Huang, Pengle Zhang, Xiaolu Zhang, Jun Zhou, Jun Zhu, Jianfei Chen · 2026

Read Deterministic Differentiable Structured Pruning for Large Language Models by Weiyu Huang, Pengle Zhang, Xiaolu Zhang, Jun Zhou, Jun Zhu, Jianfei Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08065.txt.

Description

Huang and colleagues improve structured pruning for large language models, which trims inference cost by removing low-importance parts. Pruning can be seen as learning a gate per component under an l0 sparsity limit, but the discreteness of that limit has pushed prior work toward stochastic hard-concrete relaxations. Those relaxations create a train-test mismatch once sampled masks are discretized for deployment, and keep masks in a bounded, near-binary range. Their Deterministic Differentiable Pruning method optimizes masks alone and drops the stochasticity.

Catalog record

CREATORWeiyu Huang, Pengle Zhang, Xiaolu Zhang, Jun Zhou, Jun Zhu, Jianfei Chen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69664
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.08065

Browse the full library · About the Tower of Babel