Quantum-Informed Contrastive Learning with Dynamic Mixup Augmentation for Class-Imbalanced Expert Systems
Md Abrar Jahin, Adiba Abid, M. F. Mridha · 2025
Read Quantum-Informed Contrastive Learning with Dynamic Mixup Augmentation for Class-Imbalanced Expert Systems by Md Abrar Jahin, Adiba Abid, M. F. Mridha (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-13987.txt.
Introduction
Abrar Jahin, Adiba Abid, and Mridha present a 2025 paper on classifying lopsided data, where the rare cases matter most. Expert systems in safety-critical fields face this problem in table data. Standard fixes, such as copying rare rows or weighting errors, tend to overfit or add noise.
Their framework blends three ideas. A layer inspired by quantum entanglement models tangled links between features. A mixing strategy blends each sample with near neighbors of its own kind, tuned per sample, to enrich the rare class. A combined loss joins focal weighting, contrastive learning, a triplet term, and a spread penalty. The aim is steadier detection of rare but critical cases.
Catalog record
| CREATOR | Md Abrar Jahin, Adiba Abid, M. F. Mridha |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 97 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-13987
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Quantum-Informed Contrastive Learning with Dynamic Mixup Augmentation for Class-Imbalanced Expert Systems Md Abrar Jahin, Adiba Abid, M. F. Mridha Abstract Expert systems often operate in domains characterized by class-imbalanced tabular data, where detecting rare but critical instances is essential for safety and reliability. While conventional approaches, such as cost-sensitive learning, oversampling, and graph neural networks, provide partial solutions, they suffer from drawbacks like overfitting, label noise, and poor generalization in low-density regions. To address these challenges, we propose QCL-MixNet, a novel Quantum-Informed Contrastive Learning framework augmented with k-nearest neighbor (kNN) guided dynamic mixup for robust classification under imbalance. QCL-MixNet integrates three core innovations: (i) a Quantum Entanglement-inspired layer that models complex feature interactions through sinusoidal transformations and gated attention, (ii) a sample-aware mixup strategy that adaptively interpolates feature representations of semantically similar instances to enhance minority class representation, and (iii) a hybrid loss function that unifies focal reweighting, supervised contrastive learning, triplet margin loss, and variance regularization to improve both intra-class compactness and inter-class separability. Extensive experiments on 18 real-world imbalanced datasets (binary and multi-class) demonstrate that QCL-MixNet consistently outperforms 20 state-of-the-art machine learning, deep learning, and GNN-based baselines in macro-F1 and recall, often by substantial margins. Ablation studies further validate the critical role of each architectural component. Our results establish QCL-MixNet as a new benchmark for tabular imbalance handling in expert systems. Theoretical analyses reinforce its expressiveness, generalization, and optimization robustness. [orcid=0000-0002-1623-3859] [orcid=0009-0004-7443-4669] [orcid=0000-0001-5738-1631] keywords Quantum-Inspired Neural Networks ,Contrastive Learning ,Class Imbalance ,Dynamic Mixup Augmentation ,Expert Systems ,Tabular Data Classification † † credit: Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Software, Writing – original draft, Visualization † † credit: Data curation, Formal analysis, Methodology, Software, Writing – original draft, Visualization † † credit: Supervision, Validation, Writing – review & editing † † corresponding: Corresponding author(s) 1 Introduction Expert systems (ES), AI-based decision-making frameworks, are widely used in critical areas such as medical diagnosis, fraud detection, manufacturing, cyber security, and risk analysis, where decisions must be accurate for safety and reliability ( Shu-Hsien Liao, 2005 ) . A major challenge in ES for critical applications is that the data are naturally highly imbalanced ( Yang and Xu, 2020 ; Wei et al., 2013 ; Rao et al., 2006 ) . This is a common and challenging issue to solve ( Branco et al., 2016 ) . In addition to binary classification, class imbalance becomes more severe in multi-class classification problems ( Krawczyk, 2016 ) . Though traditional deep learning (DL) has recently advanced machine learning (ML) by partly overcoming the knowledge bottleneck that limited ML and AI for decades, it remains highly sensitive to imbalanced data distribution ( Ghosh et al., 2024 ; Huang et al., 2020 ; Bugnon et al., 2020 ; Yang et al., 2019 ; He et al., 2016 ; Collobert and Weston, 2008 ; Ando and Huang, 2017 ; Buda et al., 2018 ) . In addition, performance worsens significantly with the increasing imbalance ratio ( Pulgar et al., 2017 ) . Moreover, failing to detect or predict rare but critical cases can cause higher costs, serious consequences, or sometimes irreparable damage. For example, failure to detect rare invalid transactions can result in significant financial loss and loss of customer trust. Missing early-stage cancer in a few patients (false negatives) may reduce survival chances. Missing signs of rare machine faults, like a turbine blade crack, can cause equipment failure or downtime. These issues suggest to suggest to handle the class imbalance issue carefully. While established data-level techniques ( Batista et al., 2004 ; Barandela et al., 2003 ) , including oversampling and undersampling, along with algorithm-level methods such as cost-sensitive learning (CSL), offer foundational strategies for addressing class imbalance, each comes with trade-offs. Data-level techniques are flexible and widely used since they do not depend on the choice of classifier ( López et al., 2013 ) . Undersampling ( Devi et al., 2020 ) helps reduce bias toward the majority class but may not be suitable for small datasets. On the other hand, oversampling ( Sharma et al., 2022 ) increases the risk of overfitting. Similarly, CSL ( Araf et al., 2024 ) is conceptually powerful but often faces practical hurdles in accurately defining misclassification costs, which is difficult for complex real-world datasets. This highlights that simply modifying data distributions or loss functions may be inadequate for effectively addressing severe imbalance in challenging tabular settings ( Krawczyk et al., 2014 ) . These challenges have motivated the exploration of methods that can inherently learn more discriminative features. Graph Neural Networks (GNNs) ( Scarselli et al., 2009 ; Gori et al., 2005 ) offer a strong approach for modeling tabular data by capturing complex dependencies often overlooked by traditional models. However, applying GNNs to tabular data can be computationally intensive and face scalability limitations, especially when large datasets or instance-wise graph construction are involved ( Villaizán-Vallelado et al., 2024 ; Lee et al., 2024 ) . Beyond graph-based representation learning, contrastive learning (CL) has recently shown notable success in improving generalization by structuring feature representations based on underlying patterns ( Hu et al., 2024 ) . A notable advancement was proposed by Tao et al. ( Tao et al., 2024 ) , who combined Supervised Contrastive Learning (SCL) with automatic tuning of the temperature parameter \tau , a key factor influencing performance. While this approach marks great progress, it presents challenges that limit its generalizability. Specifically, it requires dataset-specific tuning of architecture (e.g., layer size, batch size), making its application less practical across diverse scenarios. Moreover, this study did not report precision and recall separately; these metrics are critical in expert systems where the costs of false positives and false negatives differ significantly. The method also depends on complex hyperparameter tuning via Tree-structured Parzen Estimator (TPE), which increases model complexity. Additionally, their use of basic augmentation, especially Gaussian blur, leaves room for more effective techniques. In fact, CL’s success in image domains is largely driven by augmentation techniques, which do not translate well to tabular data due to the lack of spatial or structural properties. Basic mixing of tabular samples can generate unrealistic data points, particularly harming rare class representations. Thus, more adaptive and smarter augmentation strategies are needed to generate meaningful and diverse samples without introducing much noise. Concurrently, researchers have explored new computational approaches to build neural networks that can learn complex patterns effectively, even with limited or complex data. One such direction is Quantum-inspired (QI) DL, which uses ideas from quantum mechanics to improve classical models’ learning ability. However, these QI methods are still developing, especially in handling imbalanced and complex datasets ( Shi et al., 2023 ; Hong et al., 2024 ; Konar et al., 2020 ) . To address these key challenges in handling imbalanced tabular data, we propose Q uantum-informed C ontrastive L earning with Dynamic Mix up Augmentation Net work (QCL-MixNet), a novel framework that combines three core innovations. Firstly, we introduce novel Quantum Entanglement-inspired Modules within our neural network architecture, which is built with the idea of quantum mechanics without directly using the quantum computing hardware. This module is used to improve the model’s capacity to capture complex, non-linear feature interactions often missed by standard layers, thereby improving feature