Outsourced Privacy-Preserving Feature Selection Based on Fully Homomorphic Encryption

Koki Wakiyama, Tomohiro I, Hiroshi Sakamoto · 2025

Read Outsourced Privacy-Preserving Feature Selection Based on Fully Homomorphic Encryption by Koki Wakiyama, Tomohiro I, Hiroshi Sakamoto (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-12869.txt.

Introduction

Koki Wakiyama and co-authors design a private way to pick key data traits on an outside server in a 2025 paper. Picking a lean trait set speeds learning and clarifies models, but owners may not trust the server with raw data. Past private methods needed two or more computing parties.

Their method runs the whole task under full encryption, so the server never sees plain values. It also beats a prior two-party method on time and space cost as data grow. A working build tested against a plain baseline confirmed the speed gains, even on small data sets. Lone-server private analytics is the wider aim.

Catalog record

CREATORKoki Wakiyama, Tomohiro I, Hiroshi Sakamoto
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-12869

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Outsourced Privacy-Preserving Feature Selection Based on Fully Homomorphic Encryption Koki Wakiyama, Tomohiro I, Hiroshi Sakamoto Abstract Feature selection is a technique that extracts a meaningful subset from a set of features in training data. When the training data is large-scale, appropriate feature selection enables the removal of redundant features, which can improve generalization performance, accelerate the training process, and enhance the interpretability of the model. This study proposes a privacy-preserving computation model for feature selection. Generally, when the data owner and analyst are the same, there is no need to conceal the private information. However, when they are different parties or when multiple owners exist, an appropriate privacy-preserving framework is required. Although various private feature selection algorithms, they all require two or more computing parties and do not guarantee security in environments where no external party can be fully trusted. To address this issue, we propose the first outsourcing algorithm for feature selection using fully homomorphic encryption. Compared to a prior two-party algorithm, our result improves the time and space complexity O ⁡ ( k ​ n 2 ) O(kn^{2}) to O ⁡ ( k ​ n ​ log 3 ⁡ n ) O(kn\log^{3}n) and O ⁡ ( k ​ n ) O(kn) , where k k and n n denote the number of features and data samples, respectively. We also implemented the proposed algorithm and conducted comparative experiments with the naive one. The experimental result shows the efficiency of our method even with small datasets. 1 Introduction Feature selection is the process of identifying and selecting useful features (variables or attributes) from a dataset with the aim of improving the performance of predictive models and optimizing learning efficiency [ 1 ] . Consider a scenario in which a target variable is to be predicted using a large number of potential explanatory variables, with the goal of building a simple yet effective predictive model from a vast set of observations. For instance, in semiconductor manufacturing, more than tens of thousands of external factors can influence the production process from silicon material to the final product. If it is possible to identify in advance which of these factors are critical to product quality, then it is sufficient to construct a classification model based only on those selected features—offering a range of benefits. In practice, such preprocessing can lead to improvements in model accuracy, reductions in training time, and enhanced interpretability of the model. Many feature selection algorithms based on various criteria have been proposed to date [ 2 , 3 , 4 , 5 , 6 , 7 , 8 ] . In this study, we consider the feature selection in situations where the training data contains privacy-sensitive information. When the data owner who needs a reasonable learning model and the analyst required to construct the model are the same, privacy is generally not a concern as long as there is no data leakage. However, our focus is on privacy-preserving computation in cases where these two parties are separate. Existing frameworks to address this issue include techniques such as secret sharing [ 9 ] and differential privacy [ 10 ] . In this work, from the perspective of outsourcing, we focus on an approach based on fully homomorphic encryption (FHE) [ 11 ] , which is a form of public-key cryptosystem. In secret sharing schemes, data is split and distributed among parties, which introduces a risk of data leakage if those parties colludes maliciously. Differential privacy, on the other hand, prevents leakage by injecting random noise into the data. However, there exists a trade-off between the amount of noise added and the quality of the learning results, and it cannot guarantee complete protection against data leakage. By contrast, FHE enables all arithmetic and comparison operations to be performed directly on encrypted data. Since only the data owner possessing the secret key can decrypt the final result, the privacy guarantees are as strong as the underlying public-key encryption. The primary limitations of FHE have been computational inefficiency and the challenge of outsourcing computation in scenarios involving multiple data owners. However, recent advancements such as TFHE [ 12 ] and multi-key homomorphic encryption schemes [ 13 ] are steadily overcoming these obstacles. Therefore, we consider a simplified privacy-preserving problem for feature selection: The data owner retains the training data along with a pair of generated public and private keys. Then, the analyst receives the encrypted training data and performs feature selection using FHE scheme. The result of the computation is then returned to the data owner, who decrypts it using the private key. Note that the proposed method constitutes a fully outsourced computation [ 14 , 15 ] with only a single round of communication between the data owner and the analyst. This aspect significantly strengthens privacy protection. In non-fully outsourced scenarios, multiple interactions or queries from a party may be required. During such interactions, partial decryption of maliciously crafted messages from untrusted analyst could lead to unintentional leakage of the data owner’s private information. To prevent this, conventional approaches typically rely on assumptions that constrain the behavior of the analysts. For example, the semi-honest model assumes that the analyst follows the protocol faithfully but may attempt to extract as much information as possible from the data he receives. However, imposing such assumptions compromises practical applicability. In contrast, our algorithm requires only single round communication without decryption and ensures that the risk of data leakage depends solely on the strength of the cryptosystem. The TFHE [ 12 ] used in this study is proven to be at least secure against chosen-plaintext attacks (IND-CPA secure). Consequently, it offers a significant advantage in terms of both security and practical usability compared to existing methods. 2 Related Works and Our Contributions Feature selection is broadly categorized into filter method [ 16 ] , wrapper method [ 17 ] , and embedded method [ 18 ] . Among these, the filter method evaluates the importance of features based on information theory, making it faster than other methods and highly generalizable due to its independence from specific models. While evaluation metrics such as mutual information are commonly used in filter methods [ 19 ] , this study focuses on feature selection based on a recently proposed consistency measure [ 20 ] . Feature selection algorithms using consistency measures have been shown to achieve both high computational efficiency and high classification accuracy on large-scale real-world datasets [ 7 , 8 ] . In contrast, feature selection algorithms based on wrapper or embedded methods are generally impractical for secure computation due to the high computational cost associated with searching for optimal feature subsets or training models. Therefore, this study proposes a consistency measure-based secure feature selection. Homomorphic encryption (HE) is a framework for secure computation that leverages the homomorphic properties of public-key cryptosystems. Specifically, if encrypted integers can be added without decryption, the cryptosystem is said to be additive . Furthermore, if it supports both operations, it is called FHE, e.g., RSA [ 21 ] , the first public-key cryptosystem, is multiplicative but not additive. Additionally, RSA is not a probabilistic encryption scheme—i.e., it does not produce different ciphertexts for the same plaintext in each execution—making it vulnerable to chosen-plaintext

Read the complete text