FLASH-FHE : A Heterogeneous Architecture for Fully Homomorphic Encryption Acceleration
Junxue Zhang, Xiaodian Cheng, Gang Cao, Meng Dai, Yijun Sun, Han Tian, Dian Shen, Yong Wang, Kai Chen · 2025
Read FLASH-FHE : A Heterogeneous Architecture for Fully Homomorphic Encryption Acceleration by Junxue Zhang, Xiaodian Cheng, Gang Cao, Meng Dai, Yijun Sun, Han Tian, Dian Shen, Yong Wang, Kai Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-18371.txt.
Introduction
Junxue Zhang and co-authors design a chip that speeds up fully homomorphic encryption, math that computes on locked data, in a 2025 paper. Real workloads mix shallow and deep computations, and past chips, all built one way, serve one kind badly. Their design, FLASH-FHE, runs two cluster types: one built for deep jobs needing a costly refresh step, one lean and swift for shallow jobs.
A scheduler spreads deep jobs across all clusters and gives each shallow job its own group. The deep cluster can even split into extra swift pipelines on demand. Both cluster types share memory, saving silicon. Built and simulated in modern processes, the chip beat two leading accelerators on deep work and ran shallow jobs up to eight times faster.
Catalog record
| CREATOR | Junxue Zhang, Xiaodian Cheng, Gang Cao, Meng Dai, Yijun Sun, Han Tian, Dian Shen, Yong Wang, Kai Chen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-18371
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FLASH-FHE : A Heterogeneous Architecture for Fully Homomorphic Encryption Acceleration Junxue Zhang, Xiaodian Cheng, Gang Cao, Meng Dai, Yijun Sun, Han Tian, Dian Shen, Yong Wang, Kai Chen Abstract While many hardware accelerators have recently been proposed to address the inefficiency problem of fully homomorphic encryption (FHE) schemes, none of them is able to deliver optimal performance when facing real-world FHE workloads consisting of a mixture of shallow and deep computations, due primarily to their homogeneous design principle. This paper presents FLASH-FHE , the first FHE accelerator with a heterogeneous architecture for mixed workloads. At its heart, FLASH-FHE designs two types of computation clusters, i.e . , bootstrappable and swift, to optimize for deep and shallow workloads respectively in terms of cryptographic parameters and hardware pipelines. We organize one bootstrappable and two swift clusters into one cluster affiliation, and present a scheduling scheme that provides sufficient acceleration for deep FHE workloads by utilizing all the affiliations, while improving parallelism for shallow FHE workloads by assigning one shallow workload per affiliation and dynamically decomposing the bootstrappable cluster into multiple swift pipelines to accelerate the assigned workload. We further show that these two types of clusters can share valuable on-chip memory, improving performance without significant resource consumption. We implement FLASH-FHE with RTL and synthesize it using both 7nm and 14/12nm technology nodes, and our experiment results demonstrate that FLASH-FHE achieves an average performance improvement of 1.4 × 1.4\times and 11.2 × 11.2\times compared to state-of-the-art FHE accelerators CraterLake and F1 for deep workloads, while delivering up to 8.0 × 8.0\times speedup for shallow workloads due to its heterogeneous architecture. 1 Introduction Fully Homomorphic Encryption (FHE) has emerged as a promising technology for enabling privacy-preserving computation. It allows rich computation directly over encrypted data without the need for decryption. However, FHE suffers from a significant drawback—inefficiency. Compared to cleartext computation, FHE is approximately 5-6 orders of magnitude slower. To address this challenge and make FHE a practical solution, researchers have proposed FHE accelerators. FHE accelerators employ increasingly advanced hardware platforms, ranging from CPUs [ 9 ] to GPUs [ 27 , 20 ] , FPGAs [ 3 , 39 , 7 ] , and ASICs [ 40 , 41 , 30 , 29 , 28 ] , in pursuit of high acceleration performance. However, in this paper, we observe that existing FHE accelerators all ignore one crucial feature of real-world FHE workloads: they are highly mixed, thus failing to achieve optimal overall performance for mixed workloads. The mixed FHE workloads pose different design goals and choices for FHE accelerators. Specifically, some FHE workloads, referred to as shallow workloads, do not require bootstrapping, such as matrix computation and database queries [ 1 ] . They require a relatively small multiplication level L and polynomial degree N . Therefore, a potential acceleration method for shallow workloads is to provide adequate parallelism for them. On the other hand, deep workloads, including neural network inference [ 36 , 33 ] and big data analytics [ 26 ] , necessitate bootstrapping, along with requiring a larger N and L . Moreover, the overall performance of deep workloads is largely decided by the performance of bootstrapping, which usually requires one dedicated accelerator to be fully accelerated. Consequently, using FHE accelerators designed for shallow workloads, such as F1, to support mixed FHE workloads results in either the inability to handle deep workloads or over a 10\times performance degradation due to naïve extension ( e.g . , F1+ in [ 41 ] ). Conversely, utilizing FHE accelerators built for deep workloads, such as CraterLake, results in inadequate parallelism for shallow workloads. Increasing parallelism by allocating more computation clusters leads to overwhelming chip area and poses commercial drawbacks for FHE accelerators. Furthermore, the non-continuous nature of cryptographic parameters for shallow and deep workloads eliminates the possibility of achieving good average performance through parameter averaging. A potential solution to handling both shallow and deep workloads is to use two distinct architectures. However, Using two separate architectures for shallow and deep workloads nearly doubles production costs, while relying on CPU/GPU/FPGA for shallow workloads results in poor performance and additional costs. This also introduces deployment challenges, such as increased PCIe usage and failure rates. To this end, we ask: can we design a FHE accelerator that achieves consistently high performance for mixed workloads? To answer the question, we observe that existing FHE accelerators adopt a homogeneous design, where the cryptographic parameter, hardware pipeline design and scheduling mechanism are purely optimized for either shallow or deep workloads only, precluding simultaneous optimization for both shallow and deep workloads. Based on this observation, we propose FLASH-FHE , the FHE accelerator with a heterogeneous architecture for mixed FHE workloads. At its core, FLASH-FHE employs two types of computation clusters: bootstrappable and swift computation clusters, optimized for deep and shallow workloads, respectively. FLASH-FHE organizes one bootstrappable and two swift clusters as one cluster affiliation and has eight affiliations in total. Besides conventional scheduling policy for deep workloads by using all affiliations, FLASH-FHE further incorporates a scheduling mechanism that targets at improving parallelism by assigning one shallow workload to only one cluster affiliation, where the bootstrappable cluster is dynamically decomposed into multiple separate swift pipelines to adequately accelerate the assigned workload. Last but not least, FLASH-FHE integrates a hierarchical data cache, which allows different clusters to share valuable on-chip memory resources. Therefore, we can improve the overall performance of FLASH-FHE without dramatically increasing the chip area. To the best of our knowledge, FLASH-FHE is among the first to introduce a heterogeneous architecture for FHE accelerators. We implement FLASH-FHE using RTL and synthesize it with two technology nodes, i.e . , 7nm and 14/12nm, respectively. We further evaluate FLASH-FHE with seven real-world FHE workloads, comprising three shallow and four deep workloads. Evaluation results demonstrate that compared to CraterLake and F1, which are two representative FHE accelerators with 14/12nm technology node, FLASH-FHE can achieve 1.4\times and 11.2\times average performance improvement for deep workloads, respectively. For shallow workloads, FLASH-FHE can achieve up to 8.0\times speedup since it can accelerate multiple shallow workloads in parallel. Moreover, the significant performance improvement for shallow workloads is achieved at the cost of <7\% extra hardware resources. Finally, we summarize the contributions of this paper as follows: \bullet We thoroughly analyze representative shallow and deep FHE workloads and identify their optimal parameter settings, highlighting the polarization between these workloads. \bullet Based on our observations, we are among the first to introduce a heterogeneous acceleration architecture for FHE, inspired by the big.LITTLE design philosophy. This includes heterogeneous (i)NTT pipelines, a multi-level transpose module, and a hierarchical caching structure to fully implement the big.LITTLE concept. \bullet Leveraging our heterogeneous architecture, we propose the first multi-job scheduler for FHE workloads, optimizing both parallelization and cache hit ratios. We believe our contributions provide valuable insights for the FHE community by demonstrating how the concept of heterogeneity can be seamlessly integrated into existing FHE accelerators, such as CraterLake [ 41 ] , ARK [ 29 ] , SHARP [ 28 ] , etc . While these accelerators are primarily optimized for deep FHE workloads, our approach enables them to retain their current deep computation engines while incorporating key components such as multi-exit (i)NTT pipelines,