Improved Data Encoding for Emerging Computing Paradigms: From Stochastic to Hyperdimensional Computing
Mehran Shoushtari Moghadam ID, Sercan Aygun ID, M. Hassan Najafi ID · 2025
Read Improved Data Encoding for Emerging Computing Paradigms: From Stochastic to Hyperdimensional Computing by Mehran Shoushtari Moghadam ID, Sercan Aygun ID, M. Hassan Najafi ID (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-02715.txt.
Introduction
Mehran Shoushtari Moghadam, Sercan Aygun, and Hassan Najafi improve data encoding in twenty twenty-five. Encoding is a basic step in new computing styles such as stochastic and hyperdimensional computing. It strongly shapes both accuracy and hardware cost. Randomness is the weak point, since poor random sources degrade results.
Their strategy uses a hardware-friendly class of low-discrepancy sequences. These come from powers-of-two bases of Van der Corput sequences and serve as random number sources. The approach improves correlation properties and cuts hardware complexity at once. Experiments showed clear gains in accuracy and energy savings for both computing styles. Readers get a sturdier base for systems that compute with streams and high-dimensional vectors.
Catalog record
| CREATOR | Mehran Shoushtari Moghadam ID, Sercan Aygun ID, M. Hassan Najafi ID |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-02715
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Improved Data Encoding for Emerging Computing Paradigms: From Stochastic to Hyperdimensional Computing Mehran Shoushtari Moghadam ID, Sercan Aygun ID, M. Hassan Najafi ID Abstract Data encoding is a fundamental step in emerging computing paradigms, particularly in stochastic computing (SC) and hyperdimensional computing (HDC), where it plays a crucial role in determining the overall system performance and hardware cost efficiency. This study presents an advanced encoding strategy that leverages a hardware-friendly class of low-discrepancy (LD) sequences, specifically powers-of-2 bases of Van der Corput (VDC) sequences ( VDC-2 n n ), as sources for random number generation. Our approach significantly enhances the accuracy and efficiency of SC and HDC systems by addressing challenges associated with randomness. By employing LD sequences, we improve correlation properties and reduce hardware complexity. Experimental results demonstrate significant improvements in accuracy and energy savings for SC and HDC systems. Our solution provides a robust framework for integrating SC and HDC in resource-constrained environments, paving the way for efficient and scalable AI implementations. I Introduction Proper data encoding has always been a challenging task as the fundamental step in emerging computing models. Stochastic computing (SC) and hyperdimensional computing (HDC) have emerged as two promising paradigms for the efficient hardware design of machine learning systems. Both SC and HDC utilize long streams of ‘0’s and ‘1’s, rather than conventional binary values (with positional encoding or bit-significance) as their basic computational elements. Bit-streams ( \mathcal{BS} s) and hypervectors ( \mathcal{HV} s) serve as the primitive components, acting as atomic data elements in SC and HDC, respectively. These atomic data elements are generated using a proper source of randomness. The state-of-the-art (SOTA) approaches typically employ pseudo-random number generators as the source of randomness to generate \mathcal{BS} s [ 1 , 2 ] or \mathcal{HV} s [ 3 , 4 , 5 , 6 ] . Fig. 1: Pseudo-randomness vs. Quasi-randomness in random sequences. (a),(b) Points Distribution plots, (c),(d) Value Spread plots, (e),(f) Correlation/Orthogonality plots, and (g), (h) Design Implementation . Ensuring high-quality randomness through an appropriate random number generator (RNG) is essential in achieving the desired accuracy and hardware efficiency for both SC and HDC systems. In number theory, pseudo-randomness and quasi-randomness are two well-established concepts. Pseudo-randomness refers to sequences or processes that appear statistically random but are generated by deterministic algorithms. Pseudo-random sequences exhibit key randomness characteristics, such as uniform distribution and unpredictability over short intervals, yet they remain reproducible if the generator’s initial conditions or seed are known [ 7 ] . These sequences are often referred to as high-discrepancy sequences, where the discrepancy denotes the deviation of the sequence points from the uniformity [ 8 , 9 ] . Linear Feedback Shift Registers (LFSRs) are a well-known source for generating pseudo-random sequences. Conversely, quasi-random sequences, such as Sobol and Halton sequences, offer a more even and uniform distribution. These sequences are generated by a special class of deterministic algorithms designed to fill a space (such as a hypercube for multidimensional sequences) more uniformly than pseudo-randomness sequences. Quasi-random sequences possess a low-discrepancy (LD) property, where lower discrepancy leads to enhanced uniformity. Figs. 1 (a) and (b) illustrate the point distribution for pseudo-random and quasi-random sequences, respectively, highlighting the equal distribution of sequence points in quasi-random sequences. Figs. 1 (c) and (d) compare the value spread of points in these sequences, with quasi-random sequences demonstrating a more uniform distribution. Another important factor that signifies proper randomness is the degree of correlation between pairs of \mathcal{BS} or \mathcal{HV} as illustrated in Figs. 1 (e) and (f). The level of correlation plays a critical role in the quality of results. For instance, SC multiplication using bit-wise AND requires independent (or uncorrelated) \mathcal{BS} s whereas SC minimum using the same bitwise operation demands highly correlated input \mathcal{BS} s [ 10 ] . In HDC systems also, symbolic data (e.g., pixel positions, letter, signal time stamp, etc.) requires orthogonal (uncorrelated) \mathcal{HV} s in the encoding stage of the learning model [ 11 , 12 ] . Adopting pseudo-randomness for encoding data into \mathcal{BS} s or \mathcal{HV} s can lead to model performance degradation and increased hardware costs. Achieving the desired level of accuracy often requires running the model iteratively, which results in increased computational overhead, longer system runtime, energy inefficiency, and reduced performance. Previous studies have shown that pseudo-random sequences perform suboptimally in cascaded circuit architectures, where mid-level correlation among \mathcal{BS} s is crucial [ 13 ] . To mitigate these challenges, we suggest a novel encoding method based on quasi-randomness, aimed at enhancing the overall performance of SC and HDC systems. Fig. 2: Applying our Deterministic approach to the encoding part of SC and HDC models. (a) Implementing non-linear functions and division operation using the proposed VDC-2 n sequence generator in SC and (b) Improving HDC performance by generating high-quality \mathcal{HV} s using deterministic sequences. II Background and Related Work In SC, any data value is represented by a sequence of random bits (‘0’s and ‘1’s) [ 14 , 15 ] . The probability of ‘1’s appearing in the \mathcal{BS} corresponds to the data value. A data value x with n -bit precision is represented by a \mathcal{BS} , denoted as X , with the probability ‘1’s occurring over the entire \mathcal{BS} ( Pr(X=1)/2\textsuperscript{$n$} ). A common method to generate \mathcal{BS} s involves comparing the given data with random values from an RNG source. While most SOTA works employ LFSRs (Fig. 1 (g)) as RNGs, the authors in [ 16 , 17 ] proposed using Sobol sequences as a deterministic approach for SC, significantly improving the model accuracy. Another deterministic approach in SC, known as Unary Computing (UC) [ 18 , 19 ] , utilizes unary \mathcal{BS} s where all the ‘1’s are aligned together. UC is free from the random fluctuations of the ‘0’ and ‘1’ bits, which is an important source of error in SC. Similarly, in HDC, any atomic data unit, called a hypervector ( \mathcal{HV} ), is represented in high dimensionality and comprises elements of ‘-1’s (or ‘0’s) and ‘1’s. In HDC, symbolic data– such as letters, numbers, sensor data, and temporal and spatial information– can be represented by distinct and orthogonal \mathcal{HV} s. This structured information encoding is also known as holographic representation [ 20 ] . Orthogonality is achieved through randomness , which generates independent \mathcal{HV} s. Ideally, an \mathcal{HV} consists of an equal number of ‘1’s and ‘0’s, with each constituting 50% of the vector [ 21 , 22 , 23 ] . III Proposed Framework Given the inefficiencies associated with using pseudo-randomness in SC and HDC, we propose an efficient, lightweight, and highly accurate deterministic bit-stream generator by utilizing Van der Corput (VDC) sequences [ 13 , 24 ] . VDC sequences are another example of low discrepancy (LD) sequences that exhibit deterministic yet quasi-random characteristics. In our approach, VDC sequences serve as the primary source of randomness and are ideal candidates for lightweight RNG hardware designs. Generally, VDC sequences are identified by their bases, denoted as \mathcal{B} . A VDC- \mathcal{B} sequence number is generated by reversing the digits in the base- \mathcal{B} numeral system, resulting in a value within the [0,1) interval. Our proposal employs Powers-of-2 bases for the VDC sequences ( VDC-2 n