InfoQ: Mixed-Precision Quantization via Global Information Flow

Mehmet Emre Akbulut Hazem Hesham Yousef Shalby, Fabrizio Pittorino, Manuel Roveri · 2025

Read InfoQ: Mixed-Precision Quantization via Global Information Flow by Mehmet Emre Akbulut Hazem Hesham Yousef Shalby, Fabrizio Pittorino, Manuel Roveri (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-04753.txt.

Introduction

Mehmet Emre Akbulut and co-authors present a way to shrink neural networks by giving each layer its own bit width. Their paper from 2025 is called InfoQ. Picking the best width per layer is a hard search, and past ways used costly search or local clues that miss knock on effects.

The key claim is that a layer should be judged by how its shrinking changes data flow through the whole network. The method shrinks one layer at a time, runs a single pass, and measures the shift in shared data content in later layers. Scores then feed a math plan that picks widths under a size or cost cap. The search needs far less data than past best methods.

Catalog record

CREATORMehmet Emre Akbulut Hazem Hesham Yousef Shalby, Fabrizio Pittorino, Manuel Roveri
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-04753

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

InfoQ: Mixed-Precision Quantization via Global Information Flow Mehmet Emre Akbulut Hazem Hesham Yousef Shalby, Fabrizio Pittorino, Manuel Roveri Abstract Mixed-precision quantization (MPQ) is crucial for deploying deep neural networks on resource-constrained devices, but finding the optimal bit-width for each layer represents a complex combinatorial optimization problem. Current state-of-the-art methods rely on computationally expensive search algorithms or local sensitivity heuristic proxies like the Hessian, which fail to capture the cascading global effects of quantization error. In this work, we argue that the quantization sensitivity of a layer should not be measured by its local properties, but by its impact on the information flow throughout the entire network. We introduce InfoQ, a novel framework for mixed-precision quantization that is training-free in the bit-width search phase. InfoQ assesses layer importance by performing a single forward pass to measure the change in mutual information in the remaining part of the network, thus creating a global sensitivity score. This approach directly quantifies how quantizing one layer degrades the information characteristics of subsequent layers. The resulting scores are used to formulate bit-width allocation as an integer linear programming problem, which is solved efficiently to minimize total sensitivity under a given budget (e.g., model size or BitOps). Our retraining-free search phase provides a superior search-time/accuracy trade-off (using two orders of magnitude less data compared to state-of-the-art methods such as LIMPQ), while yielding up to a 1% accuracy improvement for MobileNetV2 and ResNet18 on ImageNet at high compression rates (14.00 × \times and 10.66 × \times ). 1 Introduction The significant computational demands of Deep Neural Networks (DNNs) are a primary barrier to their deployment on resource-constrained edge devices. Mixed-precision quantization (MPQ) is a key technique to overcome this, assigning low bit-widths to robust layers while preserving precision for sensitive ones to outperform uniform quantization ( Dong et al. 2023 ) . However, identifying the optimal bit-width configuration for a network is a combinatorial problem; the search space grows exponentially with network depth, making an exhaustive search infeasible. Current approaches to this challenge fall into two categories, both of which suffer from fundamental limitations. Search-based methods ( Wang et al. 2019 ; Wu et al. 2018 ) use expensive reinforcement learning or neural architecture search (NAS) to find good configurations. While sometimes effective, they are computationally prohibitive and treat the network as a black box, failing to build a principled model of quantization impact. More efficiently, criterion-based methods use a proxy metric to score layer sensitivity in a single shot. A relevant class of these methods use the trace of the Hessian ( Dong et al. 2019b ; Dong et al. 2019a ) . The intuition is that layers in flat regions of the loss landscape are less sensitive. However, the prohibitive cost of the full Hessian forces these methods to use a block-diagonal approximation , which explicitly ignores all inter-layer dependencies. This makes the Hessian-based analysis fundamentally local, failing to capture how quantization error in one layer cascades and degrades the representational quality of subsequent layers. Other criteria, like learned step-sizes ( Tang et al. 2023 ) , are similarly layer-local and often require expensive retraining. This leaves a critical gap: a fast, principled MPQ method that evaluates sensitivity based on its global impact across layers. In this work, we argue that the true sensitivity of a layer is not an intrinsic, local property, but is defined by the global impact it has on the information flow throughout the entire network . We introduce InfoQ , a framework that directly builds upon this principle. Instead of using local proxies, we ask a more fundamental question: How does quantizing a layer degrade the ability of downstream layers to represent critical information about the input and the final task? To answer this, InfoQ leverages tools from information theory. For each layer and candidate bit-width, we perform a single forward pass and measure the resulting change in mutual information (MI) at subsequent observer layers. This change directly quantifies the global, cascading effect of the quantization error. These global sensitivity scores are then used to formulate the bit-width allocation as an Integer Linear Programming (ILP) problem, which is solved efficiently to find the optimal configuration under a given resource budget (e.g., model size or BitOps). Our search phase is entirely training-free and provides a global, interpretable sensitivity measure, in contrast to existing local methods. Method AutoQ DNAS LIMPQ HAWQv2 MPQCO InfoQ (Ours) Iterative Search Avoidance ✗ ✗ ✓ ✓ ✓ ✓ Unlimited Search Space ✓ ✗ ✓ ✓ ✗ ✓ Training-Free Search ✗ ✗ ✗ ✓ ✓ ✓ Fully Automatic Bit Assignment ✓ ✓ ✓ ✓ ✗ ✓ Global Impact Metric ✗ ✗ ✗ ✗ ✗ ✓ Table 1: Comparison of key properties in state-of-the-art MPQ methods. InfoQ is the only method that combines a training-free search with a global sensitivity metric, enabling fully automatic bit allocation that accounts for network-wide error propagation. Our contributions are: 1. We introduce InfoQ , the first MPQ framework to use a global sensitivity metric based on information flow, directly capturing the cascading effects of quantization error ignored by local methods. 2. Our method achieves state-of-the-art accuracy, recovering full-precision accuracy on ResNet18 and narrowing the gap to just 0.34% on ResNet50 at high compression rates, all while using orders of magnitude less data for the search phase than competing methods at the same accuracy level. 3. Using a practical method for mutual information estimation, we analyze deep networks compression from an information-theoretic perspective, highlighting a valuable application for both the model compression and information theory literature. 2 Related Work Mixed-precision quantization (MPQ) consistently demonstrates superior performance over uniform-precision approaches ( Dong et al. 2023 ) . The central challenge in MPQ is navigating the combinatorial search space of bit-width configurations. Methodologies to solve this problem are broadly categorized as search-based and criterion-based . The search-based methods solve MPQ problem with computationally intensive search algorithms. Reinforcement learning (RL) has been employed to select layer-wise ( Wang et al. 2019 ) or even kernel-wise ( Lou et al. 2020 ) bit allocations. Another explored direction adapts techniques from Neural Architecture Search (NAS), such as differentiable search over a super-network of quantization operators ( Wu et al. 2018 ; Cai and Vasconcelos 2020 ; Yu et al. 2020 ) . While these methods can yield high-performing configurations, their reliance on costly, iterative search (often requiring a significant number of GPU-hours) and large validation datasets makes them impractical for many applications. Our work bypasses this expensive search phase entirely. To circumvent the cost of search, criterion-based methods use an efficient proxy metric for layer sensitivity to guide a one-shot bit allocation. Methods like HAWQ ( Dong et al. 2019b ) and HAWQv2 ( Dong et al. 2019a ) use the trace or eigenvalues of the Hessian as a proxy for layer sensitivity, using second-order information from the loss landscape. As noted in the Introduction, these methods are constrained to a block-diagonal approximation of the Hessian, making their analysis fundamentally local. Other works have proposed alternative proxies, including layer-wise orthogonality metrics ( Ma et al. 2021 ) and the learned scale parameters of quantizers ( Tang et al. 2023 ) . While significantly faster than search-based methods, these approaches share

Read the complete text