GoQuant: Geometric Orthogonal Residual Projection for Multiplier-Free Power-of-Two Transformer Quantization
Maoyang Xiang, Tao Luo, Bo Wang · 2026
Read GoQuant: Geometric Orthogonal Residual Projection for Multiplier-Free Power-of-Two Transformer Quantization by Maoyang Xiang, Tao Luo, Bo Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-26092.txt.
Introduction
Xiang, Luo and Wang tackle ultra-low-bit quantisation for large models on edge devices. Dense multiply-accumulate arrays strain memory and timing, while power-of-two quantisation swaps products for bit shifts. Its uneven lattice blurs angular detail below four bits. GoQuant reframes quantisation as dual-basis projection, building a sharper residual lattice with shift-and-add products. Its analytic solver skips gradient or iterative search. A data-free mode quantises LLaMA-2-7B in 0.47 minutes, a refined mode in about 4.4 minutes.
Catalog record
| CREATOR | Maoyang Xiang, Tao Luo, Bo Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46632 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.26092
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GoQuant: Geometric Orthogonal Residual Projection for Multiplier-Free Power-of-Two Transformer Quantization Thanks: In preparation. Maoyang Xiang, Tao Luo, Bo Wang Abstract The deployment of Large Language Models (LLMs) and Vision Transformers (ViTs) on edge devices is significantly constrained by memory limitations and the critical timing bottlenecks introduced by dense Multiply-Accumulate (MAC) arrays. In the ultra-low bit regime, logarithmic Power-of-Two (PoT) quantization provides a hardware-efficient alternative by replacing MAC operations with bit-shifts. However, the non-uniform exponential lattice is inherently limited by a Low Angular Resolution Regime , a structural flaw that becomes particularly pronounced at sub-4-bit thresholds, leading to a notable degradation of high-dimensional feature manifolds. To address this geometric limitation, we propose Geometric Orthogonal Residual Projection Quantization (GoQuant), an algorithm-hardware co-design framework. By formulating quantization as a dual-basis geometric projection, GoQuant adaptively synthesizes a higher-resolution residual lattice using strictly shift-and-add operations. Furthermore, its analytical solver offers a practical alternative to computationally intensive gradient-based optimization, reducing the full-model calibration time for LLaMA-2-7B to approximately 15 minutes . Extensive evaluations demonstrate GoQuant’s applicability across modalities and its hardware efficiency. Under the 3-bit (W3/A16) constraint, it achieves a perplexity of 6.10 on LLaMA-2-7B, comparing favorably to conventional MAC-intensive baselines like AWQ without relying on asymmetric scaling, while maintaining competitive accuracy in 4-bit scenarios. At the silicon level, standard-cell RTL synthesis at a 28nm node indicates that GoQuant effectively mitigates the timing bottlenecks associated with dense multiplier trees. By flattening the combinational logic depth, our parallel shift-and-add datapath reduces the critical path delay to 0.35 ns . This theoretically allows the accelerator to operate at 2.85 GHz , suggesting an agile, multiplier-free execution paradigm for high-throughput edge intelligence. K eywords Orthogonal \cdot Power-of-Two \cdot Multiplier-Free 1 Introduction The deployment of large language models (LLMs) and vision transformers (ViTs) on edge devices is frequently constrained by the multiplier tax —the critical combinational logic depth and routing complexity associated with hardware multiply-accumulate (MAC) units. In modern silicon processes, a 16-bit floating-point multiplier consumes an order of magnitude more energy and introduces significantly deeper logic paths than simple addition or bit-wise operations. To advance high-throughput edge computing, there is a growing motivation to transition from computation-heavy, multiplication-centric architectures to multiplier-free paradigms. In this context, Power-of-Two (PoT) quantization emerges as a promising approach, offering potential improvements in timing efficiency by replacing deep multiplication trees with parallel bit-shifts. Figure 1: The geometric worldview of quantization. Beyond simple algebraic accumulation (top), the vector inner product is fundamentally a geometric projection (bottom). While magnitude errors ( Scaler ) are predictable scalars that can be easily calibrated, standard quantization introduces unpredictable and uncorrectable angular deviation ( \cos\theta_{q} ). Despite its hardware advantages, low-bit quantization often faces challenges regarding precision. Conventional approaches typically attribute this performance degradation to a scalar distribution mismatch between the discrete lattice and the Gaussian statistics of neural weights. However, this scalar-centric perspective often overlooks the high-dimensional nature of Transformer operations [ 3 ] . As illustrated in Fig. 1 , the inner product is essentially the projection of a continuous weight vector onto a discrete lattice manifold. In high-dimensional spaces, the fidelity of this projection depends not just on magnitude, but critically on the preservation of the vector’s direction, which dictates the alignment of latent features. While current methods effectively manage the scaling factor ( Scaler ), directional integrity can remain unpredictable, contributing significantly to performance degradation in extreme quantization. When applying this geometric perspective to the hardware-friendly PoT domain, a key limitation emerges: its inherently non-uniform angular resolution. Unlike linear lattices, the angular distribution of PoT basis vectors is governed by the \arctan(2^{k}) function. Consequently, it operates within a low angular resolution regime , as shown in Fig. 2 , which is particularly pronounced around the diagonal regions of the projection space. This structural characteristic creates an Angular Gap , where the quantized vector’s orientation can deviate enough to substantially compromise the semantic integrity of the feature manifold. Figure 2: The Power-of-Two (PoT) lattice structure exhibits a non-uniform angular resolution, particularly in high-magnitude regions. As illustrated by the shaded area, the grid density decreases significantly, resulting in a Low Angular Resolution Regime . This structural characteristic introduces notable Angular Gaps between valid lattice points, irrespective of the bit-width. To address the angular degradation associated with a 1-D PoT mapping, we introduce the Geometric Orthogonal Residual Projection Quantization (GoQuant) framework. Rather than mapping continuous high-dimensional vectors onto a single discrete basis ( \mathbf{b}_{1} ), GoQuant constructs a 2-D orthogonal subspace to correct the angular distortion mathematically. By deriving a secondary basis ( \mathbf{b}_{2} ) that is orthogonal to the primary projection ( \langle\mathbf{b}_{1},\mathbf{b}_{2}\rangle=0 ), the framework captures the orthogonal residual—directional information often lost during the initial 1-D mapping. This dual-basis projection helps mitigate the Low Angular Resolution Regime and preserves the spatial orientation of the feature manifold, while remaining compatible with the zero-MAC hardware constraints of the PoT domain. To implement this projection efficiently while maintaining representational fidelity, GoQuant utilizes a decoupled, three-stage pipeline. First, a preconditioned manifold smoothing mechanism is applied to adjust the weight topology. Second, a geometric residual matching process determines the discrete orthogonal basis ( \mathbf{b}_{2} ) in Euclidean space. By isolating this discrete search from activation data, the method enables an \mathcal{O}(N) basis selection that reduces susceptibility to calibration bias. Finally, a data-driven joint scale optimization incorporates calibration data to compute the continuous coefficients ( c_{1} and c_{2} ). This stage evaluates channel-wise importance based on empirical input features, dynamically prioritizing the projection fidelity of critical feature dimensions according to their activation magnitudes. Evaluating multiplier-free networks solely on algorithmic metrics may not fully reflect their physical deployment constraints. To address the gap between theoretical sparsity and practical silicon implementation, we extend our evaluation to standard-cell RTL synthesis, analyzing the timing implications associated with conventional arithmetic units. In summary, the main contributions of this work are as follows: • We formalize the Low Angular Resolution Regime inherent to extreme PoT quantization. To address this, we propose the GoQuant framework, providing a deterministic, \mathcal{O}(N) closed-form algorithmic solution to extract orthogonal discrete bases without relying on gradient-based optimization. • By providing an analytical alternative to computationally intensive backpropagation and iterative searches, GoQuant substantially accelerates the deployment pipeline. We reduce the full-model calibration time for LLaMA-2-7B from hours (e.g., AWQ, SpinQuant) to approximately 15.1 minutes on a single workstation, facilitating efficient on-site edge adaptation. • GoQuant demonstrates that strict hardware constraints can still yield competitive representational fidelity. Under a zero-MAC, shift-and-add execution paradigm, it attains reliable accuracy across modalities, achieving a perplexity of 5.09 on LLaMA-2-13B ( W4/A16 ) and 79.54% Top-1 accuracy on ViT-Base ( W4/A4 ). • We evaluate the hardware efficiency of our architecture through 28nm RTL synthesis. By replacing dense multiplier trees with a parallel shift-and-add datapath, the design effectively reduces combinational logic depth, resulting in a critical path delay of 0.35 ns and a theoretical maximum clock frequency of \approx 2.85 GHz . Furthermore, under an iso-frequency comparison at 1.8 GHz (matching the conventional MAC baseline), the accelerator delivers a highly efficient 3.33 TOPS/W , alleviating the routing congestion and area overhead typically associated with deep MAC carry-chains. 2 Related Work The deployment of large-scale foundation models on resource-constrained edge platforms has driven