The Future of Fully Homomorphic Encryption System: from a Storage I/O Perspective
Lei Chen, Erci Xu, Yiming Sun, Shengyu Fan, Xianglong Deng, Guiming Shi, Guang Fan, Liang Kong, Yilan Zhu, Shoumeng Yan, Mingzhe Zhang ∗ · 2025
Read The Future of Fully Homomorphic Encryption System: from a Storage I/O Perspective by Lei Chen, Erci Xu, Yiming Sun, Shengyu Fan, Xianglong Deng, Guiming Shi, Guang Fan, Liang Kong, Yilan Zhu, Shoumeng Yan, Mingzhe Zhang ∗ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-04946.txt.
Introduction
Lei Chen and co-authors look at fully homomorphic encryption from the side of storage input and output. This form of encryption lets a machine compute on locked data, which guards user privacy, but its real-world speed has a less studied weak point.
The team tests how storage traffic slows such systems in practice. They report that slow storage can cut the speed of special chips by a very large factor, and can slow graphics chips by a large factor too. Their lessons show where builders must fix data flow, not just math.
Catalog record
| CREATOR | Lei Chen, Erci Xu, Yiming Sun, Shengyu Fan, Xianglong Deng, Guiming Shi, Guang Fan, Liang Kong, Yilan Zhu, Shoumeng Yan, Mingzhe Zhang ∗ |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-04946
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Future of Fully Homomorphic Encryption System: from a Storage I/O Perspective Lei Chen, Erci Xu, Yiming Sun, Shengyu Fan, Xianglong Deng, Guiming Shi, Guang Fan, Liang Kong, Yilan Zhu, Shoumeng Yan, Mingzhe Zhang ∗ Abstract Fully Homomorphic Encryption (FHE) allows computations to be performed on encrypted data, significantly enhancing user privacy. However, the I/O challenges associated with deploying FHE applications remains understudied. We analyze the impact of storage I/O on the performance of FHE applications and summarize key lessons from the status quo. Key results include that storage I/O can degrade the performance of ASICs by as much as 357 × \times and reduce GPUs performance by up to 22 × \times . 1 1 footnotetext: Corresponding author. Email: [email protected] 1 Introduction Security is always pivotal, especially for users who run applications with sensitive data on third-party platforms such as the cloud. Fully Homomorphic Encryption (FHE) provides a promising solution by enabling operations to directly perform on encrypted data. The user can decrypt the results which would be the same as if operations were conducted on plain text (i.e., unencrypted data). This allows users to offload computation on confidential data to public clouds for better performance without security concerns. However, the lunch is not free. Previous research reveals that achieving FHE can take a heavy toll on computation. Due to cryptographic security requirements, FHE computation on CPUs is more than 10^{5}\times slower than performing on plain text [ 10 ] . Thus, a spate of works has been focusing on speeding up the computation by using co-processing units such as GPU [ 17 , 39 , 24 ] and ASIC [ 1 , 27 , 26 , 25 , 38 , 37 , 45 , 14 ] . Fig. 1 shows the performance speedups of different FHE accelerators compared to computing FHE on the CPU. Latest prototypes [ 25 , 14 ] have shown that the gap is quickly diminishing with only a 3\times difference in processing. Moreover, more advanced solutions that can combine multiple FHE schemes to improve the performance further are looming on the horizon [ 2 ] . Figure 1: Speedup of FHE accelerators. Now, the future of FHE seems bright except for one aspect, storage I/O, left overlooked. Prior works often are based on two assumptions of I/O accessing: (1) all data is stored in the high-bandwidth device memory; and (2) the overhead associated with fetching data from the device memory to on-chip cache can be eliminated. Unfortunately, these two may not hold, especially under the multi-user environment like the cloud. First, each user has their own ciphertexts and evaluation keys (see Section 2 ), and these data themselves may exceed the size of the device memory. Second, a server may provide services for multiple users, and it is impossible to keep all the data of all users in the device memory. To quantitatively evaluate the potential impacts of I/O on deploying FHE in the cloud, we conduct an extensive set of experiments using SimGrid [ 9 ] . By testing representative FHE applications including Resnet-20 [ 30 ] and HELR [ 20 ] with varying storage devices and networks, the results motivate us to gather three important lessons: • I/O accessing significantly degrades the performance of FHE applications. • The use of multiple servers for distributed computing can not solve the problem and may even hurt application performance. • The impact of I/O overhead can differ not only across various applications but also within the same application when different FHE parameters are used. We end this paper with a short summary and reflect on the possible future work if we intend to deploy FHE in the wild. We hope this paper can motivate interesting parties to further study storage in FHE, and thus commit to release the traces and software to the public. Figure 2: FHE workflow. 2 FHE Workflow Fully Homomorphic Encryption (FHE) is an emerging cryptographic technique that allows users to send encrypted data to a third party, like the public cloud, to perform operations. Afterwards, the users can locally decrypt the returned results as if the operations were performed on plain text. This technique helps users achieve efficient computation offloading and high data confidentiality at the same time. Currently, there are several FHE schemes that support different types of data, including BGV [ 7 ] , BFV [ 8 , 16 ] , TFHE [ 12 ] , FHEW [ 15 ] and CKKS [ 11 ] . In this paper, we use the CKKS scheme because it supports floating-point numbers and has a wider application range [ 11 , 10 ] . In FHE, the end-to-end workflow consists of 5 steps: Encode , Encrypt , Compute , Decrypt and Decode . Fig. 2 shows the workflow, and we use classifying an image with Resnet-20 (i.e., inference) to showcase the procedures of FHE with an emphasis on I/O. In this case, the user uploads an image to the server and the server return the classification result after computation. Encode. First, FHE encodes the input (the image, a length- n vector of pixels) as a polynomial with N coefficients, satisfying N/2\geq n . The goal is to associate computations on polynomial rings with plain text computations. Then, the multiplication and addition of polynomials correspond to the element-wise multiplication and element-wise addition of the message vectors, respectively. Each coefficient of the encoded polynomial is an integer within the field modulo Q, where the modulus Q is a large integer typically exceeding 1000 bits in size [ 10 , 25 ] . To reduce the high complexity of arithmetic computations between large integers, Chinese Remainder Theorem (CRT) is used to decompose a large integer in the modulo Q domain into several small integers in the modulo q_{i} domains, where the product of all q_{i} is equal to Q , and each q_{i} is a prime number that can be fit into the machine’s word size. Thus, a large-coefficient polynomial can be represented as a series of small-coefficient polynomials, and each small-coefficient polynomial is called a limb . In our case, the polynomial has 2^{16} coefficients. After encoding, an image of size 3KiB (dimensions 32 \times 32 \times 3) is transformed into a polynomial exceeding 8MiB in size. Encrypt. Then, the user uses the public key to encrypt the plaintext version polynomial into a ciphertext, which consists of two polynomials and each has the same size as the plaintext polynomial. During the encryption process, the coefficients of the plaintext polynomial are combined with a random-generated error polynomial that guarantees the RLWE security [ 31 ] . In our case, after encryption, the 8MiB plaintext is converted into a 16MiB ciphertext. Compute. In the Compute step, the computation is composed of a series of primitive FHE operations over ciphertexts, including PAdd , HAdd , PMult , HMult and HRot . Table 1 shows the primitive operations supported by the CKKS FHE scheme. Complex computations including deep neural networks [ 21 , 23 ] and large language models [ 44 , 43 ] , can be constructed by combining these primitive operations. The PAdd operation performs the addition of a ciphertext and a plaintext, while the HAdd