EP-HDC: Hyperdimensional Computing with Encrypted Parameters for High-Throughput Privacy-Preserving Inference

Jaewoo Park 1 , Chenghao Quan 2 and Jongeun Lee 2 3 · 2025

Read EP-HDC: Hyperdimensional Computing with Encrypted Parameters for High-Throughput Privacy-Preserving Inference by Jaewoo Park 1 , Chenghao Quan 2 and Jongeun Lee 2 3 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-00737.txt.

Introduction

Jaewoo Park, Chenghao Quan, and Jongeun Lee make privacy-preserving inference fast by flipping where the encryption sits. Homomorphic encryption lets computation run on sealed data, but its cost has confined it to simple tasks, and coupling it with hyperdimensional computing still left batch inference slow with heavy transmission overhead. Their EP-HDC instead encrypts the model itself and runs inference on the client.

Client-side encryption slashes the overhead of sealing and shipping data, and the design scales across many clients while protecting both user data and model parameters. Design space exploration covers quantization, architecture, and encryption settings. On face and emotion datasets with the BFV encryption scheme, throughput and latency for batch inference improved by orders of magnitude over previous privacy-preserving methods, with accuracy loss under one percent.

Catalog record

CREATORJaewoo Park 1 , Chenghao Quan 2 and Jongeun Lee 2 3
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-00737

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

EP-HDC: Hyperdimensional Computing with Encrypted Parameters for High-Throughput Privacy-Preserving Inference Thanks: ‡ J. Lee is the corresponding author. Thanks: This work was partly supported by the NRF Grant through National R&D Program (RS-2024-00360300, 50%), by the IITP Grant through Artificial Intelligence Graduate School Program (UNIST, RS-2020-II201336, 10%), and by the IITP-ITRC grant (IITP-2025-RS-2025-II211817, 40%), all funded by the Korea government. The EDA tool was supported by the IC Design Education Center (IDEC), Korea. Jaewoo Park 1 , Chenghao Quan 2 and Jongeun Lee 2 3 Abstract While homomorphic encryption (HE) provides strong privacy protection, its high computational cost has restricted its application to simple tasks. Recently, hyperdimensional computing (HDC) applied to HE has shown promising performance for privacy-preserving machine learning (PPML). However, when applied to more realistic scenarios such as batch inference, the HDC-based HE has still very high compute time as well as high encryption and data transmission overheads. To address this problem, we propose HDC with encrypted parameters (EP-HDC) , which is a novel PPML approach featuring client-side HE , i.e., inference is performed on a client using a homomorphically encrypted model. Our EP-HDC can effectively mitigate the encryption and data transmission overhead, as well as providing high scalability with many clients while providing strong protection for user data and model parameters. In addition to application examples for our client-side PPML, we also present design space exploration involving quantization, architecture, and HE-related parameters. Our experimental results using the BFV scheme and the Face/Emotion datasets demonstrate that our method can improve throughput and latency of batch inference by orders of magnitude over previous PPML methods (36.52 ∼ \sim 1068 × \times and 6.45 ∼ \sim 733 × \times , respectively) with < < 1% accuracy degradation. I Introduction As artificial intelligence gains popularity, there is an increasing demand to ensure privacy of user data. Homomorphic Encryption (HE) offers a robust solution by enabling arithmetic operations on ciphertext without ever revealing the encryption key or plaintext. However, HE-based privacy preserving machine learning (PPML) has been restricted to very small networks and simple tasks due to the high computational cost and the limitation on the supported operations in HE [ 1 , 2 ] . Recently, a promising alternative based on hyperdimensional computing (HDC) has emerged [ 3 ] . HDC performs inference in two steps, and the latter (i.e., similarity search) involves only a few simple arithmetic operations that can be very efficiently mapped to HE. Consequently, HE-evaluated HDC, or HE-HDC for short, has been shown to deliver orders of magnitude faster performance than Deep Neural Network (DNN)-based PPML methods [ 3 ] . However, in batch inference scenarios (i.e., when multiple input queries are available for processing), the previous HE-HDC approach suffers from relatively high encryption and data transmission overhead as well as high HE compute time, limiting its efficiency significantly. To overcome this problem, we propose hyperdimensional computing with encrypted parameters (EP-HDC) , which is a novel PPML approach featuring client-side HE , meaning that it runs inference on a client using a homomorphically encrypted model. The key insight is that while PPML requires either a model or input data to be encrypted, a model may be much smaller than input data, and therefore much cheaper to protect, which is indeed the case with HDC-based PPML. Our EP-HDC dramatically reduces the encryption and data transmission overhead, is significantly more efficient on batch inference with no downside in inference accuracy compared to HE-HDC, and provides high scalability with many clients, while still providing strong protection for user data and model parameters. We present application examples for EP-HDC as well as parameter optimization through extensive design space exploration involving quantization, architecture, and HE parameters. Our experimental results using the MNIST, Face [ 4 ] , and Emotion [ 5 ] datasets demonstrate that our EP-HDC can achieve 612 \times higher throughput compared with the previous best HDC-based PPML (HE-HDC) [ 3 ] without compromising inference accuracy. Compared with DNN-based PPML methods, our EP-HDC achieves 36.52 \sim 1068 \times higher throughput and 6.45 \sim 733 \times lower latency with < 1% accuracy degradation. Our proposed method is based on HDC. Though presently HDC is restricted to simpler tasks, current DNN-based PPML also faces scalability issues due to excessive runtime and the polynomial approximation of nonlinear operations (e.g., ReLU approximated to square [ 2 , 1 ] ). Thus, HDC-based PPML can offer a viable alternative solution for applications where both privacy and performance are crucial. We make the following contributions in this paper: • We propose a client-side PPML method, EP-HDC, with a security analysis and application examples. • We perform extensive design space exploration of EP-HDC involving quantization, architecture, and HE parameters. • We evaluate the performance of EP-HDC on commodity hardware, demonstrating its efficiency over previous PPML methods. Fig. 1 : HE-HDC vs. the proposed EP-HDC for batch HDC inference. HV stands for hypervector. II Preliminary II-A Hyperdimensional Computing HDC is a brain-inspired machine learning paradigm based on high-dimensional vector representation called hypervector [ 6 ] . The HDC approach has many advantages over DNNs including more efficient training (not based on back-propagation), higher robustness against noise, and superior generalization performance [ 7 , 8 , 9 , 10 ] . HDC Encoding . The goal of HDC encoding is to discover a well-defined hypervector representation for input data. Though there are multiple existing encoding schemes [ 10 , 11 , 12 , 13 ] , they all satisfy the common-sense principle: different data points in the original space should have orthogonal hypervectors in the HDC space. For example, random projection encoding [ 13 ] transforms a flattened image vector into hypervectors by multiplying a random base hypervector. Single-pass Training . Once input hypervectors are generated, the hypervectors belonging to the same class are averaged to obtain a class hypervector. Inference . The classification of a query data is performed by first encoding the query data into a query hypervector \vec{\mathcal{H}}_{q} , and then computing the similarity of \vec{\mathcal{H}}_{q} with each class hypervector. The class with the highest similarity score is returned as the classification result. For the similarity measure, cosine similarity is widely used. II-B Homomorphic Encryption Homomorphic encryption allows arithmetic operations such as multiplication and addition to be evaluated on encrypted data. The majority of HE schemes are based on the ring learning with errors (LWE) problem, where the underlying operations are performed over polynomials of degree N . In HE, a message is first encoded into a plaintext (c_{0},c_{1}) , which is a pair of polynomials of degree N , and then the plaintext is encrypted into a ciphertext using a given secret key. Homomorphic operations can be performed between two ciphertexts or between a ciphertext and a plaintext, resulting in a ciphertext encrypted with the same secret key. HE schemes such as CKKS [ 14 ] , BGV [ 15 ] , and BFV [ 16 ] can encode a vector of N integers into a single plaintext ( N/2 fixed-points for CKKS), which is referred to as packing . When packing is used, homomorphic multiplication and addition are evaluated as element-wise operations between two message vectors. However, the individual elements of a ciphertext message

Read the complete text