From Characterization to Microarchitecture: Designing an Elegant and Reliable BFP-Based NPU
Jie Zhang † 1 , Jiapeng Guan § 1 , Hao Zhou § , Xiaomeng Han † , Tinglue Wang † , Ran Wei ¶ and Zhe Jiang † ∗ · 2026
Read From Characterization to Microarchitecture: Designing an Elegant and Reliable BFP-Based NPU by Jie Zhang † 1 , Jiapeng Guan § 1 , Hao Zhou § , Xiaomeng Han † , Tinglue Wang † , Ran Wei ¶ and Zhe Jiang † ∗ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10494.txt.
Introduction
Zhang and six colleagues probe block floating point chips for fault weak spots. Block floating point suits edge neural chips, yet its fault behavior stayed little mapped. Bit and path level fault runs show uneven weak spots and blunt end to end checks. Their fix splits mantissa math from the shared exponent path in a row column blocking plan. The result nears dual backup safety at about 3.6 percent speed cost and under 2 percent hardware cost.
Catalog record
| CREATOR | Jie Zhang † 1 , Jiapeng Guan § 1 , Hao Zhou § , Xiaomeng Han † , Tinglue Wang † , Ran Wei ¶ and Zhe Jiang † ∗ |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37384 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.10494
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
From Characterization to Microarchitecture: Designing an Elegant and Reliable BFP-Based NPU Thanks: 1 Both authors contributed equally. Thanks: ∗ Corresponding author: Zhe Jiang. Email: [email protected]. Jie Zhang † 1 , Jiapeng Guan § 1 , Hao Zhou § , Xiaomeng Han † , Tinglue Wang † , Ran Wei ¶ and Zhe Jiang † ∗ Abstract . Block Floating-Point (BFP) is emerging as an attractive data format for edge Neural Processing Units (NPUs), combining wide dynamic range with high hardware efficiency. However, its behavior under hardware faults and suitability for safety-critical deployments remain underexplored. Here, we present the first in-depth empirical reliability study of BFP-based NPUs. Using RTL-level fault injection on NPUs, our bit- and path-level analysis reveals pronounced heterogeneous vulnerabilities and shows conventional end-to-end check becomes ineffective under nonlinear block scaling. Guided by these insights, we design a fault-tolerant BFP-based NPU microarchitecture that aligns the BFP computational semantics with reliability constraints. The design uses a row/column-wise blocking strategy to decouple the fixed-point mantissa computations from the scalar exponent path, and introduces ultra-lightweight protection mechanisms for each. Experimental results demonstrate our design achieves near–dual modular redundancy reliability with only 3.55% geometric mean performance overhead and less than 2% hardware cost. 1. Introduction Block Floating-Point (BFP) ( 64 ; 68 ; 10 ) is an emerging format gaining traction in modern edge Neural Processing Units (NPUs) ( 11 ; 24 ; 23 ) . In BFP, a “block” of elements shares a single common exponent, while each element retains its own mantissa. By aligning the exponents within the block, arithmetic operations on the mantissa can be executed entirely using integer units, requiring only a single exponent adjustment per block. This simplifies the complexity of Multiply–and-Accumulate (MAC) datapaths and Floating-Point (FP) pipelines, enhancing computational throughput and energy efficiency compared to the IEEE-754 FP formats, hence has been widely adopted in many industrial products, e.g., NVIDIA’s Blackwell GPUs ( 44 ) , AMD’s Strix Point NPUs ( 3 ) , and Tenstorrent AI accelerators ( 8 ) . While performance improvement drives the widespread adoption of BFP, reliability is equally important for edge NPUs, especially for the ones deployed in safety-critical scenarios, e.g., autonomous driving ( 16 ; 40 ) , industrial control ( 55 ; 59 ) , etc. This means that the NPU must be resilient to hardware faults and able to detect errors within a narrow Fault Tolerant Time Interval (FTTI), often measured in milliseconds, before escalating into hazards. Existing work. A variety of fault-tolerance techniques have been explored in prior works for edge NPUs using conventional data formats, e.g., INT8/16 ( 33 ; 48 ) , FP16 ( 42 ; 15 ) , BF16 ( 35 ; 15 ) . These works typically start with an offline reliability analysis (e.g., fault injection or analytical modeling ( 48 ; 15 ; 47 ) ) to identify the vulnerable bits, modules, or pipeline stages. Based on the analysis, targeted safety mechanisms are then developed and deployed ( 6 ; 45 ; 1 ) . For instance, protecting the systolic array using Algorithm-Based Fault Tolerance (ABFT) ( 2 ; 52 ; 43 ) , redundancy (e.g., hardware Dual-Module Redundancy (DMR) ( 5 ; 54 ) , or software Instruction Redundancy (IR) ( 29 ; 60 ; 30 ) ), and safeguarding registers or memory cells with ECC or parity ( 39 ; 46 ) . Although these works investigate different data formats, the underlying NPU microarchitectures and computation flows remain similar. Hence, their protection schemes are easily adaptable across NPUs using different data formats. Challenges. Unlike the conventional formats, BFP redefines both data representation and computation flow, bringing new reliability concerns that existing protection schemes fail to capture: Where to protect : BFP’s shared-exponent couples elements, meaning a single exponent bit-flip distorts the entire block and propagates amplified correlated errors. Conversely, extracting the maximum shared-exponent in BFP block gives the mantissa greater significance compared to traditional FP formats, which may cause leading mantissa bit flips to dominate the block’s numerical contribution. Quantitatively characterizing these error dynamics across hierarchical levels (bit, block, tensor, layer) is non-trivial: coarse models miss dominant failures, while fine-grained analyses explode in complexity. (a) Different models. (b) Different configurations. Figure 1 . Failure of conventional ABFT-style end-to-end protection on BFP workloads. (a) Protection effectiveness of ABFT under INT8 and BFP. (b) False positive rate of ABFT for INT8 and BFP under different systolic array sizes. At a fault rate of 5\times 10^{-8} , the characteristics of BFP introduce intrinsic perturbations in the data, causing the checker’s false positives to skyrocket and rendering the conventional ABFT ineffective. How to protect : BFP decouples exponent and mantissa processing, demanding a rethinking of fault-tolerance deployment. As Fig. 1 shows, traditional matrix-level schemes (e.g., ABFT) assume linear error accumulation, which fails under BFP’s nonlinear block scaling and shared-exponent normalization. The challenge lies in designing BFP-aware protection that preserves its computational efficiency, selectively protects the most error-sensitive components, and operates within the NPU’s stringent area, latency, and energy budgets. Striking this balance between protection coverage and performance overhead represents a key open problem toward reliable BFP-based NPUs. (a) DNNs under different fault rates. (b) LLMs under different fault rates. (c) Bit flips at different positions(non-compute modules). (d) BFP vs. FP in exponent impact(compute modules). (e) BFP vs. FP in mantissa impact (DNNs). (f) BFP vs. FP in mantissa impact (LLMs). Figure 2 . Model accuracy or perplexity under different conditions and comparison of exponent error effects between BFP and FP. DNNs ( 36 ; 27 ; 57 ; 26 ; 53 ; 38 ; 58 ) were assessed on DBPedia-14 ( 49 ) (BERT) and Tiny ImageNet ( 63 ) (others), and LLMs ( 66 ; 12 ) on WikiText-2 ( 41 ) . Contributions. We address these challenges via the first in-depth reliability study of BFP-based NPUs. Using RTL-level fault injection, we characterize failure modes and tolerance thresholds across modules and fault intensities on representative models, revealing key bit-/path-level vulnerabilities: the shared-exponent amplifies correlated errors, and high-order mantissa bits are sensitive due to leading-zero–driven normalization. Guided by these observations, we propose a BFP-semantic, pipeline-oriented reliability principle and a row/column-wise hardware mapping, decoupling computation into a fixed-point mantissa array and a short scalar exponent pipeline; we exploit exponent-path time slack for low-cost recompute-and-compare, perform fixed-point local consistency checks, and harden compact format-conversion units. Evaluations show our design achieves near-DMR robustness with 3.55% average performance (vs. DMR 20% to 132%, IR 10% to 70%), 1.3% area and 2.81% power overheads, \geq 98% detection coverage, and sub-microsecond latency. 2. Preliminary: the Mechanics of BFP BFP is an efficient data format designed to balance the wide dynamic range with the hardware efficiency of fixed-point. For a block of N numbers X=\{x_{0},x_{1},\dots,x_{N-1}\} , each element is defined as: (1) x_{i}=(-1)^{s_{i}}\cdot 2^{e_{i}}\cdot m_{i}\hskip 8.19447pt(0\leq i\leq N-1) The BFP format represents this block by sharing a common exponent, e_{sh} . This shared-exponent is typically chosen as the maximum of all exponents within the block, i.e., e_{sh}=\max_{0\leq i\leq N-1}(e_{i}) . After conversion, the data block can be expressed as: (2) X_{\mathrm{BFP}}=2^{e_{sh}}\cdot\left\{(-1)^{s_{0}}m^{\prime}_{0},(-1)^{s_{1}}m^{\prime}_{1},\dots,(-1)^{s_{N-1}}m^{\prime}_{N-1}\right\} where m^{\prime}_{i} is the aligned mantissa, obtained by right-shifting the original mantissa m_{i} by (e_{sh}-e_{i}) bits. The dot product of