Dual-Precision Floating Point Multiply-Accumulate Processing Engine for AI Applications

Shubham Kumar 2 , Vijay Pratap Sharma 1 , Vaibhav Neema 2 , Santosh Kumar Vishvakarma 1 , Senior Member, IEEE · 2026

Read Dual-Precision Floating Point Multiply-Accumulate Processing Engine for AI Applications by Shubham Kumar 2 , Vijay Pratap Sharma 1 , Vaibhav Neema 2 , Santosh Kumar Vishvakarma 1 , Senior Member, IEEE (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-04507.txt.

Introduction

Kumar and colleagues present DHFP-PE, a dual-precision float processing element for AI speed-up, with FP8 and FP4 formats for low-power, high-throughput workloads. A bit-splitting technique lets a single 4-bit multiplier work either as a standard 4x4 multiplier for FP8 or as twin 2x2 multipliers for 2-bit inputs. It avoids copied logic. Built in 28 nm technology, the element reaches up to 60.4 percent area cut and large power savings against current designs. It suits energy-tight AI use and mixed-precision computing in accelerator chips.

Catalog record

CREATORShubham Kumar 2 , Vijay Pratap Sharma 1 , Vaibhav Neema 2 , Santosh Kumar Vishvakarma 1 , Senior Member, IEEE
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23212
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.04507

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Dual-Precision Floating Point Multiply-Accumulate Processing Engine for AI Applications Thanks: This work was supported by the Special Manpower Development Program for Chip to Start-Up (SMDP-C2S), Ministry of Electronics and Information Technology (MeitY), Government of India, Grant: EE-9/2/21 - R&D-E. Corresponding Author: Santosh Kumar Vishvakarma Email: [email protected] Shubham Kumar 2 , Vijay Pratap Sharma 1 , Vaibhav Neema 2 , Santosh Kumar Vishvakarma 1 , Senior Member, IEEE Abstract The rapid adoption of low-precision arithmetic in artificial intelligence and edge computing has created a strong demand for energy-efficient and flexible floating-point multiply–accumulate (MAC) units. This paper presents a dual-precision floating-point MAC processing element supporting FP8 (E4M3, E5M2) and FP4 (2 x E2M1, 2 x E1M2) formats, specifically optimized for low-power and high-throughput AI workloads. The proposed architecture employs a novel bit-partitioning technique that enables a single 4-bit unit multiplier to operate either as a standard 4 × 4 4\times 4 multiplier for FP8 or as two parallel 2 × 2 2\times 2 multipliers for 2-bit operands, achieving the maximum hardware utilization without duplicating logic. Implemented in 28nm technology, the proposed PE achieves an operating frequency of 1.94 GHz with an area of 0.00396 mm 2 and power consumption of 2.13 mW, resulting in up to 60.4% area reduction and 86.6% power savings compared to state-of-the-art designs, making it well suited for energy-constrained AI inference and mixed-precision computing applications when deployed within larger accelerator architectures. I Introduction The rapid progress in artificial intelligence (AI) and deep learning has increased the demand for energy-efficient hardware accelerators capable of performing large-scale multiply–accumulate (MAC) operations. Although high-precision formats such as FP16 and FP32 are commonly employed during the training phase, there is a growing trend toward adopting lower-precision formats, including FP8 and FP4, for inference and edge-AI applications due to their reduced memory requirements and improved computational efficiency. Nevertheless, most existing MAC or processing element (PE) architectures are optimized for medium-to-high precision data ( \geq 8 bits) and do not fully exploit the unique data characteristics of FP8 and FP4. Several adaptable multiple-precision floating-point processing elements (PEs) have been proposed; Fig. 1 illustrates a typical AI hardware accelerator architecture employing adaptable multiple-precision floating-point processing elements (PEs). Prior works [ 12 ] , [ 22 , 19 ] rely on high-precision split (HPS) paradigms that jointly Fig. 1: Typical AI Accelerator architecture with emphasis on the Processing Element (PE). utilize high-precision (HP) and single-precision (SP) formats for training-centric workloads. Similarly, the reconfigurable PEs in [ 5 , 11 ] , along with fused multiply–add (FMA) architectures in [ 14 , 8 , 10 , 21 ] , employ HPS and low-precision split (LPS) computation schemes, primarily targeting training efficiency rather than inference-optimized execution. Additionally, numerous earlier studies [ 2 , 4 , 20 , 18 ] utilize quantization methods to facilitate low-precision inference. While these methods are efficient, they frequently necessitate calibration, scaling, and supplementary control mechanisms, which can complicate the design. This research utilizes a truncation-based FP4/FP8 inference approach to streamline hardware design while minimizing area and power usage. The studies referenced in [ 7 , 15 , 6 ] investigate low-precision floating-point representations, such as FP4 (E3M0, E3M4) and FP8 (E5M2, E4M3), mainly to enhance training efficiency, while [ 9 ] uses FP8 to decrease memory area requirements. Meanwhile, [ 13 ] introduces a multiple-precision fused multiply–add (FMA) unit that Fig. 2: Accelerated GPU performance gains enabled by reduced-precision numerical formats. Source: AMD [ 1 ] . allows for hardware reuse across various floating-point formats for AI tasks, whereas the works cited in [ 23 ] examine low-precision numerical formats using different approaches, primarily aiming at edge-AI applications. In contrast, [ 3 ] suggests a bit-split combination MAC architecture that simultaneously utilizes both low- and high-precision calculations to optimize deep neural network (DNN) processes. However, these approaches are not optimized for inference-centric workloads, where extremely low-precision computations are essential for improving throughput and energy efficiency. In contrast, this work presents an inference-oriented processing element (PE) incorporating a compact FP4/FP8 multiply–accumulate (MAC) unit [ 17 ] , specifically designed to reduce computational complexity and hardware overhead. Recent developments in GPU performance scaling suggest a significant transformation in how computational throughput is employed for modern AI applications. As demonstrated in Fig. 2 , drawing from performance predictions and trends provided by AMD, the performance gains anticipated up to 2025 show a modest increase of about 2\times over a span of two years, largely fueled by progress in higher-precision computations. With the swift growth of deep learning model sizes and increasing data volumes, emerging GPU architectures place greater emphasis on low-precision, AI-optimized computations, achieving approximately annual performance doubling starting in 2025. In this framework, reduced-precision formats such as FP8 and FP4 exhibit significantly higher FLOP growth compared to traditional precision formats, highlighting their importance in sustaining performance scaling under stringent power and area constraints. This shift motivates the development of hardware architectures optimized for low-precision floating-point computation, enabling high throughput while preserving numerical accuracy. Consequently, specialized FP4/FP8 arithmetic units and enhanced multiply–accumulate (MAC) architectures serve as key enablers for next-generation AI accelerators. Fig. 3: Proposed bit-partitioning method and Unit Multiplier: (a) 4-bit operand for FP8; (b) 2-bit operand for FP4 The result sign, mantissas are multiplied, and exponents are summed with appropriate bias adjustment, while accumulation represents the summation of multiple products. Lower-precision formats such as FP4 and FP8 follow the same structural principles, as illustrated in Fig. 4 , but with reduced bit width, offering lower storage requirements, improved bandwidth efficiency, and faster computation compared to FP16 or FP32. Furthermore, integrating this type of accelerator with a RISC-V processor can significantly enhance its applicability in biomedical devices [ 16 ] . A=(-1)^{S_{a}}\times(1.M)\times 2^{E_{a}-\text{bias}} (1) B=(-1)^{S_{b}}\times(1.M)\times 2^{E_{b}-\text{bias}} (2) A\cdot B=\sum_{n=0}^{N-1}(-1)^{S_{an}+S_{bn}}\left(M_{an}\times M_{bn}\right)2^{E_{an}+E_{bn}-2\times\text{bias}} (3) I-A Bit Partitioning and Unit Multiplier To support FP8 precision with a 4-bit unit multiplier, Fig. 3 illustrates a bit-partitioning approach. For FP4 operation, the 4-bit multiplier is logically divided into two independent 2-bit units, allowing the same hardware to execute either a conventional unsigned 4\times 4 multiplication or two parallel unsigned 2\times 2 multiplications without additional circuitry. Each operand is split into higher (a_{3},a_{2}) and lower (a_{1},a_{0}) 2-bit segments, which are processed independently using High-Performance Synthesis (HPS). Fig. 5 (a) shows the standard 4-bit multiplication, while Fig. 5 (b) demonstrates concurrent dual 2-bit MAC operations. Fig. 4: Datapath of the proposed fully-pipelined dual-precision PE. Equation (4) describes the operation of the proposed unit multiplier using a mode-dependent masking function. Each term (a_{i}b_{j})2^{i+j} represents a weighted partial product of the 4-bit mantissas, while the masking function \delta_{m}(i,j) determines which partial products are activated. In FP8 mode (m=0) , all partial products are enabled, resulting in a conventional 4\times 4 unsigned mantissa multiplication that produces a single 8-bit output. In contrast, in FP4 mode (m=1) , cross-partition partial products are disabled, allowing the same hardware to execute two independent 2\times 2 multiplications concurrently. This bit-partitioning framework enables reconfiguration without additional multiplier hardware. By fully utilizing the unit multiplier across precision modes, the design reduces area, power, and critical-path delay while supporting higher operating frequencies. Dynamic precision switching further allows adaptation to varying computational demands, improving overall energy efficiency. P^{(m)}=\sum_{i=0}^{N}\sum_{j=0}^{N}\delta_{m}(i,j)\,(a_{i}b_{j})\,2^{i+j} (4) I-B Implementation of variable precision MAC

Read the complete text