Primitive-Driven Acceleration of Hyperdimensional Computing for Real-Time Image Classification
Dhruv Parikh, Jebacyril Arockiaraj, and Viktor Prasanna · 2026
Read Primitive-Driven Acceleration of Hyperdimensional Computing for Real-Time Image Classification by Dhruv Parikh, Jebacyril Arockiaraj, and Viktor Prasanna (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20061.txt.
Introduction
Dhruv Parikh, Jebacyril Arockiaraj, and Viktor Prasanna accelerate an unusual computing paradigm. Hyperdimensional computing represents data as very long, low-precision vectors called hypervectors. Learning and inference use light, noise-tolerant operations on those vectors. The catch is the dimensionality itself: huge, sparse vectors mean heavy data movement that conventional processors handle badly.
The authors build acceleration from primitive operations tailored to the paradigm. Their target is real-time image classification. If hyperdimensional methods run fast enough, they suit edge devices that need robust, low-power learning. The work treats hardware and algorithm as one design problem. It is part of a broader search for post-neural computing models. The chips are small and cheap to run. Speed is the test that counts most. A fast score here opens real use. The aim is not raw size but smart use of size. Less heat and less cost come with it.
Catalog record
| CREATOR | Dhruv Parikh, Jebacyril Arockiaraj, and Viktor Prasanna |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-20061
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Primitive-Driven Acceleration of Hyperdimensional Computing for Real-Time Image Classification Dhruv Parikh, Jebacyril Arockiaraj, and Viktor Prasanna Abstract Hyperdimensional Computing (HDC) represents data using extremely high-dimensional, low-precision vectors—termed hypervectors (HVs)—and performs learning and inference through lightweight, noise-tolerant operations. However, the high dimensionality, sparsity, and repeated data movement involved in HDC make these computations difficult to accelerate efficiently on conventional processors. As a result, executing core HDC operations—binding, permutation, bundling, and similarity search—on CPUs or GPUs often leads to suboptimal utilization, memory bottlenecks, and limits on real-time performance. In this paper, our contributions are two-fold. First, we develop an image-encoding algorithm that, similar in spirit to convolutional neural networks, maps local image patches to hypervectors enriched with spatial information. These patch-level hypervectors are then merged into a global representation using the fundamental HDC operations, enabling spatially sensitive and robust image encoding. This encoder achieves 95.67% accuracy on MNIST and 85.14% on Fashion-MNIST, outperforming prior HDC-based image encoders. Second, we design an end-to-end accelerator that implements these compute operations on an FPGA through a pipelined architecture that exploits parallelism both across the hypervector dimensionality and across the set of image patches. Our Alveo U280 implementation delivers 0.09 ms inference latency, achieving up to 1300 × \times and 60 × \times speedup over state-of-the-art CPU and GPU baselines, respectively. I Introduction Hyperdimensional Computing (HDC) represents data using high-dimensional, low-precision hypervectors and manipulates them with a small set of algebraic primitives such as bundling, binding, and permutation [ 19 , 24 , 25 , 10 ] . These operations enable robust, noise-tolerant learning and lend themselves naturally to bit-level and word-level parallelism, making HDC attractive for edge and resource-constrained platforms [ 4 ] . HDC has been successfully applied to biosignals, speech, DNA analytics, and human activity recognition [ 30 , 31 , 15 , 16 , 14 , 6 ] , often achieving competitive accuracy with significantly lower computational cost. Recent work has focused on improving hypervector design and encoding strategies to bridge the accuracy gap with deep learning while preserving HDC’s efficiency. This includes hardware-aware hypervector construction [ 3 ] , encoding for binarized images [ 33 ] , static optimization of HDC computations [ 35 ] , and ultra-efficient engines tailored to IoT workloads [ 21 ] . In parallel, trainable and adaptive encoders [ 23 , 22 , 36 ] and algorithm–hardware co-design techniques [ 28 ] have demonstrated that modest learning capacity and task-aware encodings can substantially improve classification accuracy without abandoning HDC’s lightweight primitives. However, image-specific HDC methods remain comparatively underexplored. Existing work on image classification with HDC often treats images as unordered collections of pixels or handcrafted descriptors, or emphasizes privacy and energy efficiency rather than spatially structured representations [ 26 , 27 , 2 , 33 ] . These approaches typically lack an explicit notion of patch-level receptive fields and spatial permutation analogous to convolutional neural networks, and they seldom study how such encoders map to concrete hardware implementations for real-time deployment. As a result, there is a gap between the algorithmic potential of HDC for image data and its realization as a low-latency, hardware-efficient pipeline. On the hardware side, a growing body of work accelerates generic HDC workloads on CPUs, GPUs, FPGAs, and processing-in-memory (PIM) substrates [ 1 , 32 , 20 , 18 , 9 , 4 ] . CPU and GPU frameworks exploit wide SIMD units and multi-core parallelism, but they are typically optimized for large batches and struggle to deliver ultra-low latency when processing a continuous stream of small images in real time. FPGAs, in contrast, can implement custom, streaming dataflow architectures that fuse binding, bundling, permutation, and similarity search into deeply pipelined engines with fine-grained control over memory bandwidth and on-chip parallelism [ 18 ] . Yet prior FPGA designs generally target 1D or tabular workloads and do not co-design the HDC encoder and hardware around image patches and hypervector structure. In this work, we bridge these gaps by co-designing a patch-based HDC image encoder and a primitive-driven FPGA accelerator for real-time image classification. Our key contributions are: • We propose a spatially aware, patch-based HDC encoder that maps local image regions to hypervectors using position- and intensity-dependent banks, aggregates them via permutation and bundling, and refines class hypervectors using similarity-guided online updates. This design achieves higher accuracy than prior HDC image encoders on MNIST and Fashion-MNIST while preserving simple, composable primitives. • We design an end-to-end FPGA accelerator that realizes the complete HDC inference pipeline—patch encoding, global accumulation, and similarity search—as a streaming dataflow architecture. The accelerator exploits parallelism both along the hypervector dimension and across image patches using a patch processor array, a global adder tree, and a similarity engine mapped to an Alveo U280 FPGA. • We provide a comprehensive evaluation across CPU, GPU, and FPGA platforms, showing that our FPGA design delivers orders-of-magnitude lower single-image latency and higher throughput than optimized PyTorch baselines, while maintaining competitive accuracy. Ablation studies on patch size and hypervector dimension further quantify the trade-offs between accuracy and hardware efficiency. II Related Work HDC fundamentals and learning frameworks. Hyperdimensional Computing (HDC) has been widely studied as a robust, compact alternative to conventional machine learning, grounded in high-dimensional random representations and simple algebraic primitives [ 19 , 24 , 25 ] . A variety of methods improve HDC’s encoding and learning capabilities through quantization [ 13 ] , stochastic and memory-centric training [ 17 ] , federated or dynamic updates [ 12 , 5 ] , and trainable encoders [ 23 , 22 ] . Recent work such as LaplaceHDC [ 29 ] refines the geometric interpretation of binary hypervectors, while LeHDC [ 8 ] introduces learning-based prototype construction for improved accuracy. These methods demonstrate that modest learning capacity can substantially enhance HDC performance while retaining lightweight, interpretable operations. HDC for image classification. Although numerous HDC encoders exist for biosignals, text, and tabular data [ 30 , 31 , 14 ] , image-specific HDC remains comparatively limited. Prior work has proposed binarized or static image encodings [ 33 ] , descriptor aggregation frameworks [ 27 ] , and privacy-preserving image representations [ 2 ] , but these approaches typically lack explicit spatial structure, patch semantics, or principled permutation-based aggregation. More advanced methods such as ManiHD [ 36 ] and QuantHD [ 13 ] introduce trainable or quantized pipelines but do not target spatially coherent image encoding comparable to convolutional receptive fields. Hardware acceleration of HDC. HDC has been accelerated on CPUs, GPUs, FPGAs, and PIM architectures using vectorization, parallel training, or custom logic [ 32 , 20 , 18 , 9 , 1 ] . GPU-centric designs typically rely on large batches to exploit data parallelism via SIMT, while FPGA implementations leverage dataflow pipelines for low-latency streaming inference. Existing FPGA accelerators, however, primarily target 1D or tabular HDC workloads rather than spatially structured image encoders [ 17 , 8 , 12 , 5 , 29 ] . Our work differs by co-designing a patch-based HDC algorithm with an FPGA-friendly architecture, enabling fine-grained patch-level and hypervector-level parallelism tailored for real-time image classification. III Preliminaries III-A Hyperdimensional Computing Hyperdimensional Computing (HDC) represents data using high-dimensional hypervectors (HVs) of dimension D , typically D\!\sim\!10^{3} – 10^{5} . We