CKA-Guided Modular Quantization: Beyond Bit-Width to Algorithmic Diversity
Jinhao Zhang, Yunquan Zhang, Daning Cheng · 2025
Read CKA-Guided Modular Quantization: Beyond Bit-Width to Algorithmic Diversity by Jinhao Zhang, Yunquan Zhang, Daning Cheng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-16282.txt.
Introduction
Jinhao Zhang and four co-authors shrink language models more cleverly in a paper made public on arXiv in 2025. Quantization stores a model's numbers in fewer bits to save memory and speed. Most post-training methods apply one uniform strategy to every layer, even though layers differ a lot in which algorithm suits them.
Their framework, CALM, tests several quantization algorithms on each layer separately. It scores them with centered kernel alignment, a similarity measure between representations, and picks the best strategy per layer. The winners combine into one hybrid model, with no fine-tuning needed. Across mainstream models including LLaMA and Qwen, CALM beat both uniform quantization and leading mixed-precision methods on perplexity and downstream tasks. The plug-and-play design makes it easy to adopt in existing pipelines.
Catalog record
| CREATOR | Jinhao Zhang, Yunquan Zhang, Daning Cheng |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-16282
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CKA-Guided Modular Quantization: Beyond Bit-Width to Algorithmic Diversity Jinhao Zhang, Yunquan Zhang, Daning Cheng Abstract Current mainstream post-training quantization methods for large language models typically apply a uniform quantization strategy across all network layers, overlooking the substantial differences in algorithmic suitability among layers. To address this limitation, we propose CKA-Guided Modular Quantization—a fine-tuning-free, plug-and-play framework for algorithmic heterogeneous quantization. Our method independently evaluates multiple PTQ algorithms on each layer and employs Linear Centered Kernel Alignment (CKA) as a metric to automatically select the optimal quantization strategy per layer. The individually optimized strategies are then integrated to construct a hybrid quantized model. Experiments demonstrate that our approach consistently outperforms both uniform quantization baselines and state-of-the-art mixed-precision methods across mainstream LLMs—including LLaMA and Qwen—in terms of perplexity (PPL) and downstream task performance. 1 Introduction Post-training quantization (PTQ) is a key technique for compressing large language models (LLMs) to enable efficient deployment. Existing PTQ methods—such as GPTQ, AWQ, and SmoothQuant—typically apply the same quantization strategy uniformly across all layers. While this simplifies implementation, it overlooks an important empirical fact: different decoder layers vary significantly in their sensitivity to quantization, and thus benefit differently from distinct quantization approaches. This variation arises from fundamental differences in how these methods operate. For instance, GPTQ reduces quantization error by optimizing weights after quantization; AWQ preserves salient weights to maintain the activation distribution; and SmoothQuant improves stability at low bit-widths by smoothing activations before quantization. These complementary strategies suggest that no single method is optimal for every layer. Motivated by this observation, we ask: Can we construct a single quantized model by selecting the most effective quantization method for each layer—combining them to achieve better overall performance than any uniform approach? Our approach differs from conventional mixed-precision quantization (e.g., using INT4 in some layers and INT8 in others), which varies only the bit-width while keeping the quantization algorithm fixed. In contrast, we explore algorithmic heterogeneity: applying different quantization algorithms to varying layers to better match their individual characteristics, shown in Figure 1 . Figure 1: Comparison between previous multi-precision quantization and our proposed multi-quantization-methods approach. Left: existing methods use different bit-widths (e.g., low vs. high precision) but a single quantization algorithm across layers. Right: our method applies diverse quantization algorithms (e.g., GPTQ, AWQ, SmoothQuant) to different layers, enabling algorithmic heterogeneity for improved performance. To implement this idea, we propose CKA-Guided Modular Quantization. We use Linear Centered Kernel Alignment (CKA)—a well-established metric for measuring similarity between neural network representations—as a proxy for functional fidelity. Specifically, for each decoder layer, we apply multiple PTQ methods independently and compute the CKA similarity between the activations of each quantized variant and those of the original full-precision model, using a small calibration dataset. The method yielding the highest CKA score is selected for that layer, and the chosen layers are assembled into a single heterogeneous quantized model. We evaluate our method on several LLMs, including LLaMA and Qwen, across language modeling and downstream tasks. Results show that our approach consistently outperforms both individual PTQ baselines and state-of-the-art mixed-precision methods—without any retraining or fine-tuning. Our work demonstrates that achieving an optimal trade-off between efficiency and accuracy in LLM quantization requires not only choosing appropriate bit-widths but also selecting the right quantization algorithm for each layer. The proposed framework is fully post-training, training-free, and compatible with any off-the-shelf PTQ method, making it a practical plug-and-play enhancement for existing compression pipelines. In summary, our contributions are: • We present the first systematic study of combining diverse PTQ methods at the layer level and propose a general framework for optimal integration. • We introduce a layer-wise quantization method selection strategy based on Linear CKA, enabling data-driven per-layer algorithm choice. • Extensive experiments show that our method achieves state-of-the-art performance across multiple models and benchmarks. 2 Related work Post-Training Quantization Foundational works such as AdaRound ( 9 ) , GPTQ ( 2 ) , AWQ ( 4 ) , and SmoothQuant ( 16 ) have established widely adopted paradigms for minimizing quantization error through weight reconstruction and outlier mitigation. Building on these baselines, recent advanced methods introduce novel perspectives: QuIP ( 1 ) utilizes incoherence processing to enhance extreme low-bit quantization, while OmniQuant ( 12 ) introduces learnable clipping thresholds. Furthermore, SpinQuant ( 5 ) optimizes rotation matrices to suppress outliers before quantization. Centered Kernel Alignment Centered Kernel Alignment (CKA) ( 8 ) , particularly its linear variant ( 3 ) , has emerged as a standard proxy for gauging neural representational similarity. It has been widely employed to analyze training dynamics ( 10 ) , compare diverse architectures ( 11 ) , and guide model compression 15 ; 7 . Notably, high CKA similarity is often interpreted as a signal of redundancy, utilized for expert pruning in Mixture-of-Experts models ( 6 ) and model merging in KnOTS ( 13 ) . 3 Methodology Figure 2: Overview of our CKA-Guided Modular Quantization Framework. (a) We first analyze layer-wise sensitivity using CKA. (b) Then, we competitively select the optimal quantization method (e.g., GPTQ & SmoothQuant) for each layer. (c) Finally, we integrate these layers into a unified model. This framework achieves optimal heterogeneity at the algorithmic level without retraining. Figure 3: Layer-wise CKA score distribution of Llama-3-8B under different quantization methods. 3.1 Algorithmic Suitability Different PTQ algorithms exhibit fundamental differences in their design principles and optimization objectives, leading to varying sensitivities to weight distributions. GPTQ employs a layer-wise greedy optimization approach, formulating quantization error minimization as a constrained quadratic programming problem and updating weights sequentially using Hessian information; it is particularly effective for layers with concentrated weight distributions and few outliers. In contrast, AWQ identifies “sensitive” weight channels—those most influential to the output—based on activation magnitudes and preserves higher precision for them while aggressively quantizing the rest. This method assumes a strong correlation between weight importance and the magnitude of corresponding activations, enabling superior performance when activation distributions are skewed and contain prominent hotspot channels. SmoothQuant, on the other hand, introduces a smoothing factor between weights and activations to shift quantization difficulty from the activation side to the weight side. By reparameterizing the forward pass to balance dynamic ranges, it demonstrates greater robustness in scenarios involving extreme weight outliers and large variations in activation magnitudes. Clearly, none of these algorithms is universally optimal across all network layers: GPTQ favors smooth and compact weight distributions, AWQ relies on activation-guided sparse importance structures, and SmoothQuant excels at handling high-dynamic-range weights and activations. Consequently, the statistical characteristics of each layer’s weights—such as kurtosis, skewness, and outlier ratio—directly determine which quantization strategy is most effective. A single algorithm is unlikely to achieve optimal performance across an entire model, highlighting the necessity of layer-adaptive quantization. Centered Kernel Alignment (CKA) is a widely used metric for measuring the similarity between two feature representation spaces and is commonly applied in the evaluation of quantization strategies. We use CKA to compare the decoder output features of LLaMA-8B models quantized by different PTQ methods against those of the full-precision model, thereby assessing how effectively each strategy preserves the original representational fidelity. As shown in the Figure 3 , no single quantization method consistently maintains optimal performance across all layers. This variation reveals the limitations of monolithic, one-size-fits-all quantization