Streamlining SIMD ISA Extensions with Takum Arithmetic: A Case Study on Intel AVX10.2
Laslo Hunhold · 2025
Read Streamlining SIMD ISA Extensions with Takum Arithmetic: A Case Study on Intel AVX10.2 by Laslo Hunhold (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-14067.txt.
Introduction
Chipmakers keep adding tiny number formats for AI, and the instruction set groans under the variety. Laslo Hunhold argues in 2025, through Intel's AVX10.2 vector extensions, for swapping the whole shelf of float formats for one tapered-precision design called takum. Takum promises the exactness where values cluster and reach where they spread, under a single consistent rule set.
Rebuilding the extension on takum, he finds, yields a cleaner, more readable instruction set with room for honest eight- and sixteen-bit general arithmetic, not just deep learning niches. The case study invites a rethink of how processors should count.
Catalog record
| CREATOR | Laslo Hunhold |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-14067
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Streamlining SIMD ISA Extensions with Takum Arithmetic: A Case Study on Intel AVX10.2 Laslo Hunhold Abstract Modern microprocessors extend their instruction set architecture (ISA) with Single Instruction, Multiple Data (SIMD) operations to improve performance. The Intel Advanced Vector Extensions (AVX) enhance the x86 ISA and are widely supported in Intel and AMD processors. The latest version, AVX10.2, places a strong emphasis on low-precision, non-standard floating-point formats, including bfloat16 and E4M3/E5M2 float8 (OCP 8-bit Floating Point, OFP8), primarily catering to deep learning applications rather than general-purpose arithmetic. However, as these formats remain within the IEEE 754 framework, they inherit its limitations, introducing inconsistencies and added complexity into the ISA. This paper examines the recently proposed tapered-precision takum floating-point format, which has been shown to offer significant advantages over IEEE 754 and its derivatives as a general-purpose number format. Using AVX10.2 as a case study, the paper explores the potential benefits of replacing the multitude of floating-point formats with takum as a uniform basis. The results indicate a more consistent instruction set, improving readability and flexibility while offering potential for 8- and 16-bit general-purpose SIMD arithmetic. I Introduction sign exponent fraction S D R C F 1 1 3 r p Fig. 1: The n -bit takum representation, comprising a sign bit {\color[rgb]{0.6914,0.1641,0.1758}S} , a direction bit {\color[rgb]{0,0.4727,0}D} , three regime bits {\color[rgb]{0.5508,0.2227,0.6211}R} , r\in\{0,\dots,7\} characteristic bits {\color[rgb]{0.1211,0.3633,0.7617}C} , and p\in\{n-12,\dots,n-5\} fraction bits {\color[rgb]{0.3867,0.3867,0.3867}F} . Since takums are invariant under zero-extension, bit strings with n<12 are zero-extended to 12 bits for decoding. 8 16 32 64 10^{-77} 10^{-55} 10^{-45} 10^{-20} 10^{0} 10^{20} 10^{38} 10^{55} 10^{77} bit string length n dynamic range Takum IEEE 754 normal IEEE 754 subnormal OFP8 E4M3 OFP8 E5M2 bfloat16 Posit Fig. 2: Dynamic range relative to the bit string length n for linear takum, posit and a selection of floating-point formats. The bit-string lengths relevant to AVX10.2 are indicated on the x-axis To maximise the utilisation of pipelined architectures in modern microprocessors, specialised instructions that operate on multiple data points within a single instruction—referred to as Single Instruction, Multiple Data (SIMD)—are integral to performance-oriented software. A prominent example of such an instruction set is Intel’s Advanced Vector Extensions (AVX) for x86. First introduced in 2008 and expanded as AVX2 in 2013, Intel proposed AVX-512 as a vector instruction set architecture (ISA) in the same year. Over the following years, AVX-512 was progressively extended (and fragmented) with more than 20 optional feature flags. This fragmentation, along with the desire for greater cross-platform consistency, motivated the development of a unified vector ISA known as AVX10 [ 1 ] . The first version, AVX10.1, introduced in 2023, is functionally equivalent to AVX-512 and only explicitly enumerates AVX-512 instructions at 128, 256, and 512 bits [ 2 ] . The specification was further extended as AVX10.2 in 2024, most notably introducing support for 8-bit floating-point arithmetic [ 3 ] by implementing the OCP 8-Bit Floating Point Specification (OFP8) [ 4 ] , which defines the two formats E4M3 (four exponent bits, three significand bits) and E5M2 (five exponent bits, two significand bits). While, at the time of writing, no AMD processor supports AVX10, the relevant registers have already been reserved for future use [ 5 , Figure 3.4, registers %xmm16–%xmm31] . Shortcomings in IEEE 754 floating-point arithmetic have led to the emergence of derivative number formats such as bfloat16 [ 6 ] and the aforementioned OFP8 types, as well as alternative formats such as posit arithmetic [ 7 ] and, more recently, takum arithmetic [ 8 ] (see Figure 1 ). A key innovation in posits and takums, both of which are uniformly defined for arbitrary bit-string lengths, is their ‘tapered precision’ . This property ensures a higher density of representable values near 1—where values are more frequently encountered in computations—at the expense of reduced density for values further from 1, which are used less frequently. Other advantages include a unique unsigned zero representation (in contrast to the signed zero in IEEE 754), a natural two’s complement ordering and negation, and simpler, more power-efficient hardware implementations [ 9 , 10 , 11 ] . Takum arithmetic additionally features a consistently large dynamic range, which is nearly fully realised even at 8 bits, as illustrated in Figure 2 . This design choice reflects the observation that low-precision arithmetic typically involves a trade-off between precision and dynamic range, whereas ideally, only the former should be variable. Counterintuitively, takums demonstrate superior overall numerical performance despite their high dynamic range compared to IEEE 754 floating-point numbers and their derivatives [ 12 , 13 , 14 ] . From a hardware perspective, takum arithmetic exhibits the distinctive property that all precision levels share a common decoder, which is required to process at most the 12 most significant bits (see Figure 1 ), as the remaining bits are guaranteed to be fraction bits. This stands in contrast to posits, where the encoded exponent may extend across the entire bit string. The takum design ensures highly consistent performance across varying precisions and surpasses that of state-of-the-art posit hardware codecs, which necessitate separate decoders for each precision [ 11 ] . A further notable advantage over posits is that 64-bit takums possess at least as many fraction bits as 64-bit IEEE 754 floating-point numbers, thereby achieving at least equivalent machine precision. This paper first examines the viability of takum arithmetic as a potential replacement for the diverse arithmetic formats present in AVX10.2. To this end, we devise a benchmark to assess the representational capabilities of these formats using a large, diverse set of sparse matrices across different precisions. Based on these findings, we then propose a set of guidelines for streamlining AVX10.2 and apply them to the instruction set. The remainder of this paper is structured as follows. Section II discusses the viability of takum arithmetic as a foundational arithmetic format for AVX10.2. Section III details the methodology for grouping, modifying, and optimising the AVX10.2 instruction set. Section IV presents an evaluation of the results, while Section V summarises our findings and provides concluding remarks. II Viability of Takum Arithmetic 0 % 25 % 50 % 75 % 100 % -6 -4 -2 0 2 -\infty \infty \log_{10}(\text{relative error}) takum8 OFP8 E4M3 OFP8 E5M2 posit8 (a) 8 bits 0 % 25 % 50 % 75 % 100 % -10 -8 -6 -4 -2 0 2 -\infty \infty takum16 float16 bfloat16 posit16 (b) 16 bits 0 % 25 % 50 % 75 % 100 % -15 -10 -5 -\infty \infty takum32 float32 posit32 (c) 32 bits Fig. 3: Cumulative error distribution of the relative 2-norm errors of the matrices after conversion to a range of machine number types. The symbol \infty denotes where the dynamic range of the matrix entries exceeded the target number type. The variety of formats available in AVX10.2 ( bfloat16 , OFP8 E4M3, OFP8 E5M2, alongside standard formats) reflects the absence of a general-purpose low-precision format in the current ecosystem. Ultimately, E4M3 and E5M2 at 8 bits, as well as float16 and bfloat16 at 16 bits, represent different parameterisations that balance precision and dynamic range. As discussed earlier, takum arithmetic may serve as a viable alternative, as its tapered precision enables a high dynamic range while maintaining