XL-HD : Extended Learning in Hyperdimensional Computing via Deterministic Projections for In-Memory Accelerators

Sabrina Hassan Moon, Abu Kaisar Mohammad Masum, Sercan Aygun, Dayane Reis · 2026

Read XL-HD : Extended Learning in Hyperdimensional Computing via Deterministic Projections for In-Memory Accelerators by Sabrina Hassan Moon, Abu Kaisar Mohammad Masum, Sercan Aygun, Dayane Reis (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-24788.txt.

Introduction

Sabrina Hassan Moon and others introduce XL-HD, a hyperdimensional computing framework for in-memory accelerators. Older methods use symbolic binding with pseudo-random vectors, demanding large dimensionality and heuristic updates for edge accuracy. XL-HD projects binary inputs with a fixed Sobol sequence, extending learning. Class prototypes optimize in real-valued space and later binarize, giving a binary dot-product inference path for ReRAM crossbars. It reaches strong accuracy on MNIST, UCIHAR, and ISOLET with a compact engine using 0.40 microjoules per inference.

Catalog record

CREATORSabrina Hassan Moon, Abu Kaisar Mohammad Masum, Sercan Aygun, Dayane Reis
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32780
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.24788

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

XL-HD : Extended Learning in Hyperdimensional Computing via Deterministic Projections for In-Memory Accelerators Sabrina Hassan Moon, Abu Kaisar Mohammad Masum, Sercan Aygun, Dayane Reis Abstract . Hyperdimensional computing (HDC) is a promising approach for energy-efficient edge machine learning (ML), where low latency, low power, and tight memory budgets are essential. However, traditional HDC relies on symbolic binding and pseudo-random high-dimensional vectors, which require large dimensionality and heuristic updates to reach competitive accuracy, limiting deployment on edge hardware. We introduce XL-HD , a deterministic, projection-based, fully learnable HDC framework tailored for in-memory acceleration within edge computing systems. The method uses a fixed Sobol sequence to project binary inputs, extending learning beyond conventional HDC. During training, class prototypes are optimized in real-valued space and later binarized, enabling an entirely binary dot-product inference pipeline ideal for IMC hardware such as ReRAM crossbars. XL-HD achieves competitive accuracy on MNIST, UCIHAR, and ISOLET while maintaining a compact IMC-based inference engine with 0.395 ​ mm 2 0.395\ \text{mm}^{2} area and only 0.40 ​ μ ​ J 0.40\ \mu\text{J} per single-cycle inference. \AtEveryCite 1. Introduction With edge devices rapidly proliferating, machine learning (ML) frameworks require lightweight, fast, and energy-efficient processing to satisfy strict latency, bandwidth, and power limits. However, deploying conventional deep learning models remains challenging due to their high computational and memory demands, motivating the use of in-memory computing (IMC) for massively parallel, energy-efficient processing directly within memory arrays Roy et al. 2020 . Hyperdimensional computing (HDC) has emerged as a promising alternative to computationally-intensive ML algorithms Kleyko et al. 2023 ; Aygun et al. 2023 . HDC encodes scalar and symbolic data using high-dimensional vectors called hypervectors (HVs). However, generating these HVs – either on the fly or by fetching them from memory – incurs substantial energy and latency costs, especially in resource-limited environments Masum et al. 2025 . Improving vector generation and memory access, therefore, directly enhances baseline HDC performance. Once generated, simple operations (e.g., logic XOR , shifting, and population count ( POP+ )) complete the encoding Rahimi et al. 2016 . The resulting HVs are naturally noise-robust, fault-tolerant, and effective in low-precision settings, making HDC well suited for edge AI. Figure 1. Trade-offs in bit precision, dimensionality, robustness, and parallelism (vs. OnlineHD Hernández-Cano et al. 2021 and LeHDC Duan et al. 2022 ). A figure showing trade-offs in bit precision, dimensionality, robustness, and parallelism for different HDC methods. Despite its potential, HDC faces key limitations for practical edge deployment, as summarized in Fig. 1 . The top row highlights the core trade-off: when moving from full-precision to 1-bit encodings, conventional HDC must greatly increase dimensionality (D, from 0.5 – 1 K to 4 – 8 K) to maintain accuracy. The bottom plots confirm this trend, with LeHDC Duan et al. 2022 and OnlineHD Hernández-Cano et al. 2021 showing accuracy drops for D \leq 1 K. Since storage and compute scale with D, this dimensionality inflation directly raises hardware cost. The platform comparison in Fig. 1 shows that IMC offers the highest parallelism, making it ideal for low-precision HDC. A second challenge is the use of pseudo-random HVs, which scatter irregularly in the vector space and require large D for separability. In contrast, quasi-random sequences distribute points more uniformly, enabling comparable discriminability at much lower dimensionality. Together, these observations motivate our deterministic, hardware-efficient design that preserves HDC’s robustness and 1-bit parallelism while avoiding the high-D overhead of conventional methods. In this work, we present XL-HD 1 1 1 https://github.com/ACEDLab/XL-HD , an algorithm-hardware co-designed HDC framework with extended learning capabilities and hardware-efficient edge inference tailored for in-memory accelerators, such as Resistive RAM (ReRAM) crossbars, offering substantial gains in speed, area, and energy efficiency. The main contributions of this work are as follows: (1) We propose XL-HD , a deterministic HDC pipeline that uses Sobol-based binary mappings to streamline encoding and eliminate the overhead of traditional symbolic binding; (2) we introduce in-situ binarization of the encoded query HV and design ReRAM-based IMC hardware that performs inference entirely within crossbar arrays; and (3) we realize a complete end-to-end in-memory inference flow on ReRAM crossbars, achieving single-cycle throughput, sub- \mu J inference energy, and a compact 0.395\ mm^{2} area. 2. Background and Related Work Table 1. Comparison of existing HDC and XL-HD accelerators. Approach Encoding Method Efficiency Hardware Mapping E2E Pseudo Symbolic Deterministic Low-D Binary IMC ReRAM IMC Random Binding LD Encoding Inference Support Crossbar Pipeline OnlineHD Hernández-Cano et al. 2021 ✓ ✓ ✗ ✗ ✓ ✗ ✗ ✗ LeHDC Duan et al. 2022 ✓ ✓ ✗ ✗ ✓ ✗ ✗ ✗ FSL-HD Xu et al. 2023 ✓ ✓ ✗ ✗ ✗ ✓ ✓ ✗ ReHDC Liu et al. 2024 ✓ ✓ ✗ ✗ ✗ ✓ ✓ ✗ ReX-HD Moon et al. 2025 ✓ ✓ ✓ ✗ ✗ ✓ ✓ ✗ Ours ( XL-HD ) ✗ ✗ ✓ ✓ ✓ ✓ ✓ ✓ In this section, we provide an overview of the principles of HDC and IMC and discuss prior works that integrate HDC into IMC. 2.1. HDC Principles and Properties HDC represents each data point ( symbolic , scalar , or temporal ) by nearly orthogonal HVs that consist of hundreds or even thousands of binary (0,1) or bipolar ( \pm 1 ) elements. To generate the symbolic HVs, a random number in [0,1] is drawn for each of the D dimensions and compared to 0.5 , producing a binary vector with roughly half 1s and half 0s. In contrast, scalar values are encoded by comparing the scalar to the same set of random numbers, resulting in correlated HVs for similar scalar values and dissimilar HVs for distant ones. Thus, random numbers play a central role in encoding both symbolic and scalar information, and the quality and characteristics of the randomness source are equally critical Thomas et al. 2021 . After generating HVs, HDC encoding applies the key operations: ① binding , ② bundling , and ③ shifting , depending on the application Kazemi et al. 2022 . Binding combines two HVs into a new composite HV; using element-wise multiplication or XOR operation for bipolar or binary vectors, respectively. Bundling merges multiple HVs into a single robust and holistic representation. Shifting maintains orthogonality and positional information of symbols by bit-shuffling the HV Rahimi et al. 2016 . Traditional HDC typically generates HVs using pseudo-random sources, which produce near-orthogonal vectors due to random fluctuations and offer limited control over the similarity structure, requiring a larger D to average out the randomness. In contrast, low-discrepancy (LD) sequences such as Sobol are deterministic mathematical constructions that distribute samples more uniformly and recurrently over the space, avoiding repeated random process while providing regular and reproducible deterministic HV patterns. This property can preserve accuracy even at significantly smaller D Moghadam et al. 2023 . 2.2. IMC Primitives and Application in HDC IMC architectures leverage device-level properties to perform in-situ Vector-Matrix Multiplication (VMM) and Boolean operations (e.g., AND , NOR , XOR ), enabling efficient acceleration of different algorithms Roy et al. 2020 ; Reis et al. 2018 ; Sebastian et al. 2020 . IMC designs can be broadly grouped into three forms: general-purpose IMC arrays, crossbar-based VMM engines, and Content-Addressable Memories (CAMs) for parallel associative search Chi et al. 2016 ;

Read the complete text