Layer-Wise High-Impact Parameter Ratio Optimization in Post-Training Quantization for Large Language Models

Cuong Pham, Hoang Anh Dung, Cuong C. Nguyen, Trung Le, Gustavo Carneiro, Thanh-Toan Do, [0.5em] Department of Data Science, AI, Monash University, Australia · 2025

Read Layer-Wise High-Impact Parameter Ratio Optimization in Post-Training Quantization for Large Language Models by Cuong Pham, Hoang Anh Dung, Cuong C. Nguyen, Trung Le, Gustavo Carneiro, Thanh-Toan Do, [0.5em] Department of Data Science, AI, Monash University, Australia (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-17801.txt.

Introduction

Cuong Pham, Hoang Anh Dung, Cuong Nguyen, Trung Le, Gustavo Carneiro, and Thanh-Toan Do tackle shrinking large language models by quantization, which stores weights with fewer bits. At very low bit counts, accuracy falls mainly because a few high impact weights are handled poorly.

Earlier methods kept a fixed share of such weights in each layer at full precision. The new framework chooses a share per layer through an optimization that accounts for links between layers. It gives high impact weights a moderate bit width and pushes the rest very low, balancing speed, memory, and accuracy under a fixed budget.

Catalog record

CREATORCuong Pham, Hoang Anh Dung, Cuong C. Nguyen, Trung Le, Gustavo Carneiro, Thanh-Toan Do, [0.5em] Department of Data Science, AI, Monash University, Australia
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-17801

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Layer-Wise High-Impact Parameter Ratio Optimization in Post-Training Quantization for Large Language Models Cuong Pham, Hoang Anh Dung, Cuong C. Nguyen, Trung Le, Gustavo Carneiro, Thanh-Toan Do, [0.5em] Department of Data Science, AI, Monash University, Australia Abstract Large language models (LLMs) have significantly advanced natural language processing, but their massive parameter counts create substantial computational and memory challenges during deployment. Post-training quantization (PTQ) has emerged as a promising approach to mitigate these challenges with minimal overhead. While existing PTQ methods can effectively quantize LLMs, they experience substantial accuracy loss at extremely low bit-widths, primarily due to high-impact parameters that significantly influence quantization performance. Several approaches address these issues by identifying and retaining the high-impact parameters in FP16 format. However, they apply fixed ratios of high-impact parameters across all layers, overlooking layer-wise sensitivity variations. In this paper, we propose a quadratic optimization framework that determines layer-specific ratios of high-impact parameters while considering inter-layer dependencies. We quantize high-impact parameters to moderate bit-widths, which often result in negligible performance degradation in quantized LLMs, while the remaining parameters can be quantized to extremely low bit-widths. Under the same resource-constrained budget, this allows for preserving more high-impact parameters than methods that keep selecting a few in FP16 format. Additionally, the proposed framework allows us to leverage an advanced quantization method that often requires extensive learnable parameters solely for high-impact parameters, while applying a computationally efficient method to the rest. Our approach achieves an effective balance between computational efficiency and model accuracy while maintaining high performance compared to state-of-the-art methods. 1 Introduction Large language models (LLMs) ( 30 ; 28 ; 36 ) , have gained significant attention due to their remarkable performance in handling complex natural language tasks ( 10 ) , such as language generation, translation, question answering, and text summarization. However, the significantly large size of these models, often comprising billion-level parameters, demands significant computational resources for inference and deployment. To address this issue, an attractive approach is network quantization ( 9 ) , which not only reduces the computation costs, but also significantly reduces the memory usage. Compared to quantization aware training (QAT) that requires huge training costs and access to large training data, the post-training quantization (PTQ) ( 9 ; 18 ; 34 ; 32 ) , which requires limited calibration data and computational resources, is more in demand for quantizing LLMs. Previous PTQ methods ( 32 ; 34 ; 27 ) for LLMs have demonstrated the ability to quantize LLMs to lower precision. For example, quantizing weights to 4 bits often results in negligible performance degradation. However, when quantized to extremely low bit-width (e.g., 2-bit weight-only quantization), these methods will lead to significant performance degradation compared to full-precision models. Several approaches ( 18 ; 13 ; 27 ; 5 ) indicate that high-impact parameters that significantly influence quantization performance are often the biggest challenge in LLM quantization. In CherryQ ( 5 ) , the authors separate high-impact parameters in an element-wise manner. In SqueezeLLM ( 13 ) , the authors represent sensitive weight values in an efficient sparse format and adopt codebook-based non-uniform quantization, which is not hardware-friendly compared to standard uniform quantization methods. Although these approaches successfully improve performance of PTQ for LLMs, applying a fixed ratio of high-impact parameters across all layers overlooks layer-wise variation in parameter importance. Consequently, this approach may be suboptimal as the ratio of importance of parameters differs across layers. Additionally, handling important parameters in an element-wise manner in CherryQ ( 5 ) or using non-uniform quantization as in SqueezeLLM ( 13 ) may not be hardware-friendly and pose challenges for hardware deployment. In this paper, we propose a principled approach inspired by ( 3 ; 6 ) for mixed-precision quantization of convolutional neural networks via quadratic optimization to identify the accurate ratio of high-impact parameters for each layer in a channel-wise manner. Specifically, we propose an efficient quadratic optimization approach to determine the optimal ratio of high-impact parameters, which takes into account the impact of different layer sensitivities on model performance. Under the same resource-constrained budget, retaining all high-impact parameters in FP16 format or full precision is not always the best strategy, as it limits the total number of such parameters that can be preserved due to high precision cost. Instead, quantizing high-impact parameters to moderate bit-widths (e.g., 4-bit), the precision that results in negligible performance degradation in quantized models, allows preserving a greater ratio of high-impact parameters for each layer within the budget. Meanwhile, the remaining normal parameters can be quantized to extremely low bit-widths (e.g., 2-bit). Additionally, the more advanced and accurate quantization methods such as AdaRound ( 23 ) often lead to better overall results. However, the number of learnable parameters when applying AdaRound is equal to the number of weight parameters, which makes it infeasible to apply AdaRound directly to large language models. To address this, CBQ ( 8 ) proposes LoRA-Rounding, which considerably reduces the number of learnable parameters. Although this technique achieves substantial improvements for quantizing LLMs, it depends on rank selection, and the significantly reduced parameter space may constrain the search for optimal rounding solutions. Therefore, different from previous methods ( 5 ; 13 ; 8 ) , the proposed approach allows us to adopt a hybrid quantization strategy to balance accuracy and computational efficiency by leveraging advanced quantization methods such as AdaRound only for high-impact parameters, while quantizing the vast majority of remaining parameters using more efficient quantization approaches such as OmniQuant ( 27 ) . This hybrid strategy effectively allocates computational resources based on optimized high-impact parameter allocation, significantly reducing overhead and maintaining overall model quality. To summarize, the main contributions of this paper are as follows: We propose a novel approach to determine the optimal ratios of high-impact parameters across layers in large language models. Rather than applying a fixed ratio, our approach captures layer-wise sensitivity variations through a quadratic optimization framework. This enables more accurate allocation of quantization precision based on each layer’s contribution to overall model performance. Additionally, the proposed approach allows us to utilize advanced PTQ methods that require optimizing a large learnable matrix, such as AdaRound ( 23 ) , for only the most important parameters. By combining an advanced PTQ method that optimizes a learnable weight-rounding matrix for the most impactful parameters with a lightweight and efficient quantization method for the remaining parameters, our approach achieves a strong balance between performance and efficiency through optimized high-impact parameter allocation. 2 Related works Quantization for large language models. Quantization is an effective approach to compress LLMs, which helps to significantly reduce inference cost and memory usage. Many studies ( 20 ; 27 ; 33 ; 32 ) show the presence of significantly high-impact parameters in LLMs, and these parameters make the quantization process more challenging and require special handling. One common approach is to use an equivalent transformation to handle the high-impact parameters in LLMs. Other approaches ( 34 ; 27 ; 18 ) propose shifting transformations and scaling transformations to further improve the performance of quantized models. Recently, rotation transformations ( 29 ; 1 ; 21 ) have been proposed to handle high-impact parameters in LLMs. Several works also explore mixed-precision quantization ( 13 ; 14 ; 5 ) to

Read the complete text