Quantum Feature Selection with Higher-Order Binary Optimization on Trapped-Ion Hardware
Carlos Flores-Garrigós 1,2 , Anton Simen 1,3 , Qi Zhang 1 , Enrique Solano 1 , Narendra N. Hegade 1,2, Sayonee Ray 5 , Claudio Girotto 5 , Jason Iaconis 5 , Martin Roetteler 5 · 2026
Read Quantum Feature Selection with Higher-Order Binary Optimization on Trapped-Ion Hardware by Carlos Flores-Garrigós 1,2 , Anton Simen 1,3 , Qi Zhang 1 , Enrique Solano 1 , Narendra N. Hegade 1,2, Sayonee Ray 5 , Claudio Girotto 5 , Jason Iaconis 5 , Martin Roetteler 5 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-26834.txt.
Introduction
Flores-Garrigós and eight colleagues present a quantum method for picking telling features, using higher-order binary optimization that captures links among one, two, and three features at once. Mutual-information scores rate relevance, overlap, and joint structure, while penalties keep the picked set sparse. Run with digitized counterdiabatic optimization on IonQ Forte hardware and tested on gallstone and spam data, the method matches noiseless simulation and rivals classical baselines. Its picked sets stay small while sorting data well.
Catalog record
| CREATOR | Carlos Flores-Garrigós 1,2 , Anton Simen 1,3 , Qi Zhang 1 , Enrique Solano 1 , Narendra N. Hegade 1,2, Sayonee Ray 5 , Claudio Girotto 5 , Jason Iaconis 5 , Martin Roetteler 5 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25893 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.26834
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Quantum Feature Selection with Higher-Order Binary Optimization on Trapped-Ion Hardware Carlos Flores-Garrigós 1,2 , Anton Simen 1,3 , Qi Zhang 1 , Enrique Solano 1 , Narendra N. Hegade 1,2, Sayonee Ray 5 , Claudio Girotto 5 , Jason Iaconis 5 , Martin Roetteler 5 Abstract We present a quantum feature-selection framework based on a higher-order unconstrained binary optimization (HUBO) formulation that explicitly incorporates multivariate dependencies beyond standard quadratic encodings. In contrast to QUBO-based approaches, the proposed model includes one-, two-, and three-body interaction terms derived from mutual-information measures, enabling the objective function to capture feature relevance, pairwise redundancy, and higher-order statistical structure within a unified energy model. To suppress trivial all-selected solutions, we further include structured linear penalties that promote sparsity while preserving informative variables. The resulting HUBO instances are optimized with digitized counterdiabatic quantum optimization on IonQ Forte and compared against noiseless quantum simulation as well as two classical dimensionality-reduction baselines: SelectKBest based on mutual information and principal component analysis (PCA). We evaluate the proposed workflow on two benchmark classification datasets, namely the Gallstone dataset and the Spambase dataset, and analyze both predictive performance and selected-subset structure. The results show good qualitative agreement between hardware executions and noiseless simulations, supporting the feasibility of implementing higher-order feature-selection Hamiltonians on current trapped-ion processors. In addition, the quantum approach yields competitive classification performance while producing compact and informative feature subsets, highlighting the potential of higher-order quantum optimization for machine-learning preprocessing tasks. I Introduction Feature selection (FS) is a central problem in modern artificial intelligence (AI), with critical applications spanning machine learning, computer vision, natural language processing, and biomedical data analysis [ 8 , 4 , 1 , 13 ] . By identifying the subset of features that contributes most to a model’s predictive performance, FS enhances interpretability, reduces overfitting, and improves computational efficiency. In high-dimensional datasets—common in genomics [ 22 ] , finance [ 14 ] , and medicine [ 20 ] —irrelevant or redundant variables can obscure the underlying signal and degrade generalization performance. Effective feature selection is therefore essential not only for building compact and interpretable models but also for ensuring stable performance across tasks and domains. Classical FS techniques are typically model-dependent, iterative, and computationally demanding. Wrapper methods [ 2 ] repeatedly train a learning model to evaluate subsets of features, which becomes prohibitive as dimensionality increases. Filter-based methods [ 19 ] , such as mutual information [ 23 ] or correlation-based criteria [ 9 ] , provide faster alternatives but often disregard feature interactions. Embedded methods, such as LASSO [ 16 ] or tree-based approaches [ 24 ] , intertwine feature selection and model training but remain sensitive to model hyperparameters and bias toward linear or hierarchical dependencies. State-of-the-art approaches combine relevance and redundancy measures but still require repeated training cycles or heuristic scoring, limiting their scalability and robustness in complex and high-dimensional feature spaces. Quantum computing offers a fundamentally different route to optimization by exploiting quantum superposition and entanglement to explore exponentially large configuration spaces. Several recent studies have formulated combinatorial optimization problems, including feature selection, as Quadratic Unconstrained Binary Optimization (QUBO) problems [ 15 , 6 , 17 ] . In such formulations, each feature corresponds to a binary variable x_{i}\in\{0,1\} , and the optimization objective is represented by a quadratic Hamiltonian whose ground state encodes the optimal feature subset. Quantum annealers and variational quantum algorithms can then approximate this ground state by evolving the system under the corresponding Hamiltonian. Standard QUBO formulations are restricted to explicit one- and two-body terms. They naturally encode individual feature relevance and pairwise redundancy, but higher-order dependencies must either be neglected, approximated, or introduced through additional variables and quadratization overheads. This can be restrictive in settings where groups of features carry information that is not visible from individual or pairwise scores alone. Such multivariate dependencies are common in real-world data but remain inaccessible to quadratic models. To address this limitation, we formulate feature selection directly as a Higher-Order Unconstrained Binary Optimization (HUBO) problem. The resulting Hamiltonian contains explicit three-body terms, allowing the cost function to represent higher-order dependencies among features without first reducing the objective to a quadratic form. Although this increases the complexity of the optimization landscape, it also provides a more expressive energy model for balancing relevance, redundancy, and multivariate feature structure. We solve the resulting HUBO instances using DCQO on trapped-ion hardware and compare the selected feature subsets against noiseless quantum simulation and classical reference methods. The remainder of this paper is organized as follows. Section II introduces the theoretical background and notation for Ising variables and the HUBO formulation of feature selection and details the computation of mutual-information-based coefficients. Section III describes the IonQ hardware implementation, together with the optimization procedure and the low-energy post-selection rule for identifying stable features. Section IV presents experimental results on two benchmark datasets, namely the Gallstone and Spambase datasets, and compares the proposed approach against classical baselines including SelectKBest based on mutual information and principal component analysis (PCA). Finally, Section VI discusses implications, limitations, and future directions toward scalable quantum feature selection frameworks. II Methodology II-A Ising and HUBO Formulation We formulate feature selection as a Higher-Order Unconstrained Binary Optimization (HUBO) problem in the Ising convention, where each feature is associated with a spin variable Z_{i}\in\{-1,+1\} . We adopt the convention Z_{i}=-1 if feature i is selected and Z_{i}=+1 otherwise. Equivalently, in binary notation, x_{i}=\frac{1-Z_{i}}{2}\in\{0,1\}, (1) so that x_{i}=1 denotes inclusion and x_{i}=0 exclusion. The feature-selection problem is encoded in the Hamiltonian H(Z)=\sum_{i}h_{i}Z_{i}+\sum_{i<j}J_{ij}Z_{i}Z_{j}+\sum_{i<j<k}K_{ijk}Z_{i}Z_{j}Z_{k}+\mathrm{C}, (2) where h_{i} , J_{ij} , and K_{ijk} are the one-, two-, and three-body coefficients, respectively, and \mathrm{C} is a constant offset. The one-body terms encode individual feature relevance, the two-body terms capture pairwise redundancy, and the three-body terms account for higher-order dependencies beyond quadratic encodings. With this convention, positive h_{i} favors selecting informative features since h_{i}Z_{i}=-h_{i} when Z_{i}=-1 . Positive J_{ij} discourages the simultaneous selection of strongly correlated features, while negative K_{ijk} penalizes configurations in which all three features are selected simultaneously, helping prevent trivial dense solutions. The ground state of Eq. ( 2 ) therefore defines the feature subset that optimally balances relevance, redundancy, and higher-order structure. An illustration of the procedure can be seen in Fig. 1 Fig. 1: Schematics of the quantum feature selection procedure. (a) illustrates a training dataset with n variables and N samples used to compute (b) the coefficients of a higher-order spin Hamiltonian—based on classical statistics from the dataset—whose low-energy configurations encode solutions of the feature selection problem. A (c) digitized counterdiabatic (CD) protocol is implemented in order to obtain a distribution of low-energy states, and (d) local magnetizations that capture the importance of the features are calculated. Based on a importance threshold, (e) features are selected. II-B Mutual-Information-Derived Coefficients The coefficients (h_{i},J_{ij},K_{ijk}) are constructed from mutual-information (MI) quantities that quantify both feature-target relevance and statistical dependencies among features. To place all interaction orders on a common scale, the values \mathrm{MI}(X_{i},y) , \mathrm{MI}(X_{i},X_{j}) , and \mathrm{MI}([X_{i},X_{j}],X_{k}) are jointly normalized using a single global min–max transformation. The one-body coefficients are defined as h_{i}=w_{1}\,\frac{\mathrm{MI}(X_{i},y)-\min(\mathrm{MI})}{\max(\mathrm{MI})-\min(\mathrm{MI})}, (3) where w_{1}>0 controls the contribution of feature relevance. The two-body coefficients are defined as J_{ij}=w_{2}\,\frac{\mathrm{MI}(X_{i},X_{j})-\min(\mathrm{MI})}{\max(\mathrm{MI})-\min(\mathrm{MI})},\qquad i<j, (4) where w_{2}>0 sets the strength of pairwise redundancy