QIBONN: A Quantum-Inspired Bilevel Optimizer for Neural Networks on Tabular Classification * Equal Contribution.

Pedro Chumpitaz-Flores *, My Duong *, Ying Mao, Kaixun Hua · 2025

Read QIBONN: A Quantum-Inspired Bilevel Optimizer for Neural Networks on Tabular Classification * Equal Contribution. by Pedro Chumpitaz-Flores *, My Duong *, Ying Mao, Kaixun Hua (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08940.txt.

Introduction

Pedro Chumpitaz-Flores and three co-authors tune neural networks for tabular data with an optimizer that borrows its moves from quantum computing. Hyperparameter search over features, architecture, and regularization is a huge non-convex space. Exhaustive tuning is unaffordable. Their bilevel optimizer therefore encodes the whole configuration in qubits.

Deterministic quantum-inspired rotations explore the space while stochastic qubit mutations, pulled toward a global attractor, keep the search from stalling, all under a fixed evaluation budget. Experiments even run under emulated single-qubit bit-flip noise on an IBM quantum backend, at error rates up to one percent. Across thirteen real-world datasets the method stays competitive with classical tree-based tuners and with other classical and quantum-inspired optimizers given the same budget.

Catalog record

CREATORPedro Chumpitaz-Flores *, My Duong *, Ying Mao, Kaixun Hua
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-08940

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

QIBONN: A Quantum-Inspired Bilevel Optimizer for Neural Networks on Tabular Classification * Equal Contribution. Pedro Chumpitaz-Flores *, My Duong *, Ying Mao, Kaixun Hua Abstract Hyperparameter optimization (HPO) for neural networks on tabular data is critical to a wide range of applications, yet it remains challenging due to large, non-convex search spaces and the cost of exhaustive tuning. We introduce the Quantum-Inspired Bilevel Optimizer for Neural Networks (QIBONN), a bilevel framework that encodes feature selection, architectural hyperparameters, and regularization in a unified qubit-based representation. By combining deterministic quantum-inspired rotations with stochastic qubit mutations guided by a global attractor, QIBONN balances exploration and exploitation under a fixed evaluation budget. We conduct systematic experiments under single-qubit bit-flip noise (0.1%–1%) emulated by an IBM-Q backend. Results on 13 real-world datasets indicate that QIBONN is competitive with established methods, including classical tree-based methods and both classical/quantum-inspired HPO algorithms under the same tuning budget. I Introduction Hyperparameter tuning is the process of systematically selecting optimal hyperparameters settings, such as learning rate, number of hidden layers, number of neurons within layers, or regularization, that control machine learning (ML) algorithms’ learning processes. It is a common and crucial practice that directly impacts models’ ability to generalize from training data to unseen data accurately and efficiently. Proper hyperparameter optimization (HPO) can transform algorithms into robust, high-performing models that often outperform other enhancements, which is important for tabular datasets [ 10 , 17 ] , as common ML models, especially Neural Network (NN) variants are sensitive to different hyperparameter settings [ 13 ] . Aside from popular HPO algorithms like Grid Search and Random Search [ 3 ] , Bayes-based optimization methods [ 2 , 22 ] , evolutionary algorithms [ 8 ] , and population-based metaheuristic optimization [ 9 , 14 ] , quantum-inspired techniques for NN hyperparameter tuning have gained attention over the past few years [ 25 , 11 , 7 ] due to their physics-based dynamics that allow for broader exploration of the search space. In this context, quantum-inspired (QI) refers to classical algorithms that adopt mathematical formalism from quantum mechanics , but do not require quantum hardware or quantum simulators; they are explicitly designed for execution on conventional digital machines [ 26 , 7 ] . Recently, numerous QI algorithms such as Quantum Particle Swarm Optimization (QPSO) [ 25 ] , Quantum-Inspired Boltzmann Machine (QIBM) [ 1 ] , and Quantum-Inspired Evolutionary Algorithms (QIEA) [ 12 ] have emerged as prominent candidates for HPO, combining quantum-mechanics-inspired exploration with classical global heuristics to search more effectively in rugged, mixed discrete–continuous spaces and without requiring quantum hardware. Although QI approaches are theoretically applicable to NN hyperparameter tuning [ 21 , 24 , 16 ] , usage for joint feature selection and neural hyperparameter search in tabular classification remains limited. Motivated by this, we introduce Quantum-Inspired Bilevel Optimizer for Neural Networks (QIBONN) , a framework that enhances the HPO process by integrating QI concepts to increase exploration diversity and reduce the risk of premature convergence of the hyperparameter search across both shallow and deep neural architectures. We formalize the qubit update scheme (Section II and III ), benchmark against classical and tabular baselines, and test the robustness of QIBONN to simulation noise (Section IV ). Fig. 1: QIBONN pipeline II Quantum-Inspired Optimization The use of quantum principles has led to optimization approaches that simulate quantum dynamics at an algorithmic level without requiring real quantum hardware. Each candidate solution can be encoded as a hyperparameter vector in a qubit representation. Each qubit is defined as: |\psi\rangle=\alpha|0\rangle+\beta|1\rangle\hskip 10.00002pt\text{with}\hskip 10.00002pt|\alpha|^{2}+|\beta|^{2}=1, where \alpha and \beta are complex amplitudes denoting the probabilities of the basis states. Superposition allows each qubit to represent multiple states simultaneously, providing a compact representation of potential solutions in high-dimensional spaces. Measurement collapses the qubit into one of the basis states with probabilities determined by the amplitudes: P(|0\rangle)=|\alpha|^{2},\hskip 10.00002ptP(|1\rangle)=|\beta|^{2}. Unitary operators U satisfying U^{\dagger}U=I are used to manipulate the qubit amplitudes. A fundamental unitary operator is the rotation, defined by: R(\Delta\theta)=\begin{pmatrix}\cos(\Delta\theta)&-\sin(\Delta\theta)\\ \sin(\Delta\theta)&\cos(\Delta\theta)\end{pmatrix}. Applying R(\Delta\theta) to |\psi\rangle yields: |\psi^{\prime}\rangle=\begin{pmatrix}\alpha\cos(\Delta\theta)-\beta\sin(\Delta\theta)\\ \alpha\sin(\Delta\theta)+\beta\cos(\Delta\theta)\end{pmatrix}. This rotation changes the amplitudes and, consequently, the probabilities of the basis states. The rotation angle \Delta\theta is determined by the best solutions found, thereby guiding the search toward promising regions. In addition to the deterministic rotation, quantum mutation is applied as a stochastic operator \theta_{\text{mut}}\sim U(-\theta_{\max},\theta_{\max}), where \theta_{\max} is the maximum allowed rotation angle. This mutation introduces diversity into the search process. Consider an initial qubit state |\psi\rangle that undergoes a deterministic rotation R_{y}(\Delta\theta) , followed by a stochastic rotation R_{y}(\theta_{\text{mut}}) applied with probability P_{\text{mut}} ; the qubit is then measured to yield a classical bit. Each particle is represented by a register of qubits, with one qubit per dimension of the search space. Thus, for a problem with N particles and dimensionality D , the total number of qubits is N\times D . III Quantum-Inspired Bilevel Optimizer Optimizing hyperparameters of neural networks for tabular data can be effectively formulated as a bilevel optimization problem. At the upper level, the goal is to identify the combination that best minimize the validation loss. At the lower level, given a set of hyperparameters, model weights are trained via standard gradient optimization. Importantly, this selection is illustrative and can include other hyperparameters like epochs, dropout rates, batch size, or any configuration relevant to the training and architecture of neural networks. Quantum-Inspired Bilevel Optimizer for Neural Networks (QIBONN) maintains a population of qubit-encoded candidates, each endowed with its own best attractor, contributing to a shared global best attractor. These mechanisms, inherited from swarm intelligence [ 18 , 4 ] , guide deterministic rotations and stochastic mutations of the qubits to balance exploration and exploitation. In each iteration, (i) a population of qubit-encoded candidates is generated and decoded for evaluation via a training loop; (ii) personal and global best configurations are updated; and (iii) qubit amplitudes are modified using the update operators. The details of each step are provided below. Definition 1 (Hyperparameter Space) . Define the hyperparameter space for n hyperparameters as: H=\left\{\mathbf{x}\in\mathbb{R}^{n}\;\middle|\;h_{i,\min}\leq x_{i}\leq h_{i,\max}\;\;\text{for all }i=1,\dots,n\right\}. Each h=(x_{1},x_{2},\dots,x_{n})\in H specifies a network configuration through a set of hyperparameters depending on the specific task and model architecture. Definition 2 (Candidate Encoding and Decoding) . Let bpp denote the number of bits per hyperparameter. A candidate solution is represented by a bitstring: b\in\{0,1\}^{n\cdot\texttt{bpp}}. The decoding function D partitions b into n segments, converting each segment to an integer v_{i}\in\{0,\dots,2^{\texttt{bpp}}-1\} , and maps it linearly onto the corresponding hyperparameter range: D(b)_{i}=h_{i,\min}+\frac{v_{i}}{2^{\texttt{bpp}}-1}(h_{i,\max}-h_{i,\min}),\hskip 10.00002pt\forall i=1,\dots,n. Definition 3 (Evaluation Function) . Let \theta denote network weights. For hyperparameters h\in H , let J\colon H\to\mathbb{R},\ J(h)=-\mathcal{M}(h), where \mathcal{M}(h) is a performance metric. A network f(x;\theta) is built with architecture h , weights \theta^{*}(h) are obtained via training, and \mathcal{M}(h) is evaluated on a validation set. The optimal hyperparameters satisfy h^{*}=\arg\min_{h\in H}J(h). Definition 4 (Training Phase) . After h^{*} is found, final weights solve \theta^{*}=\arg\min_{\theta}L(\theta;h^{*}), where L(\theta;h^{*}) is the train loss. Proposition 1 (Decoupling of Hyperparameter Tuning and Weight Optimization) . For each h\in H , the inner problem \theta^{*}(h)=\arg\min_{\theta}L(\theta;h) is solved independently, and the outer problem \min_{h\in H}J(h) depends solely on validation performance J(h) . Proposition 2 (Quantum-Inspired Update in the Encoded Space) . Candidates b\in\{0,1\}^{n\cdot\texttt{bpp}} are updated

Read the complete text