Class-Dependent Hybrid Data Augmentation for Multiclass Migraine Classification under Severe Class Imbalance

Elvin Somón Sánchez, Miguel A. Gutiérrez-Naranjo · 2026

Read Class-Dependent Hybrid Data Augmentation for Multiclass Migraine Classification under Severe Class Imbalance by Elvin Somón Sánchez, Miguel A. Gutiérrez-Naranjo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-23453.txt.

Introduction

Elvin Somón Sánchez and Miguel Gutiérrez-Naranjo revisit migraine classification work and repair leaked data and skewed scoring. They combine two hemiplegic subtypes under ICHD-3 guidance and pick synthetic data methods per class size, capping growth in proportion instead of forcing full balance. On 400 patients across seven subtypes, their approach beats synthetic data methods across eight classifiers, peaking at 0.914 with FT-Transformer.

Catalog record

CREATORElvin Somón Sánchez, Miguel A. Gutiérrez-Naranjo
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE75995
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.23453

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Class-Dependent Hybrid Data Augmentation for Multiclass Migraine Classification under Severe Class Imbalance Elvin Somón Sánchez, Miguel A. Gutiérrez-Naranjo Abstract Background and Objective: Multiclass migraine classification from clinical data is hindered by severe class imbalance, limited sample sizes, and methodological biases such as data leakage and inappropriate evaluation metrics, while the impact of data augmentation design remains insufficiently understood. This study investigates how augmentation strategies affect model reliability and proposes a class-dependent framework for imbalanced clinical classification. Methods: We conducted a reproducibility-oriented reevaluation of prior migraine classification studies, correcting for data leakage and metric bias, and introduced (i) a clinically motivated aggregation of two hemiplegic subtypes following ICHD-3 §1.2.3, (ii) a class-dependent hybrid augmentation strategy that assigns generators by per-class sample size, and (iii) the concept of fidelity asymmetry , motivating proportionally constrained growth as an alternative to full class balance. Experiments used 400 patients across seven subtypes under a two-stage protocol, evaluated with stratified 5-fold cross-validation and macro-averaged F1. Results: Correcting these flaws collapsed previously inflated accuracies (up to 99.7% under leakage) onto a leakage-free macro-F1 scale, on which the best prior model reaches only 0.803 (seven classes). Averaged across the eight classifiers, the framework outperformed individual augmenters (0.862 vs. 0.836 Copula, 0.815 CTGAN, 0.801 no augmentation), peaking at 0.914 ± \pm 0.047 (FT-Transformer, proportional augmentation). Clinically motivated class aggregation (FT-Transformer, 0.896 ± \pm 0.038) accounts for most of the gain; the framework’s principal contribution is improved average robustness across classifiers. Conclusions: Augmentation design is a critical and underexplored factor in medical machine learning. Class-dependent and proportionally constrained augmentation improves reliability under severe imbalance, while label design remains the primary determinant of performance. 1 Introduction Migraine is one of the most prevalent and disabling neurological disorders worldwide, affecting approximately 14% of the adult population and representing a leading cause of years lived with disability [ 35 ] . From a clinical perspective, migraine is a complex neurovascular disorder involving multiple pathophysiological mechanisms, including cortical spreading depression, trigeminovascular activation, and altered sensory processing [ 3 ] . These mechanisms contribute to substantial heterogeneity in symptom presentation, disease progression, and treatment response, complicating accurate diagnosis and subtype differentiation in routine clinical practice. This heterogeneity has direct implications for treatment selection and prognosis, making reliable subtype classification a clinically relevant objective. Despite advances in clinical understanding, migraine diagnosis remains challenging due to overlapping symptom profiles across the subtypes defined in ICHD-3, which distinguishes over a dozen migraine variants with partially shared clinical criteria [ 16 ] . In this context, machine learning (ML) approaches have been increasingly explored to support automated classification and clinical decision-making. Several studies have reported promising results using clinical, questionnaire-based, and imaging-derived features [ 24 , 20 , 36 ] . However, recent reviews consistently highlight substantial methodological limitations, including poor reproducibility, limited external validation, and frequent deviations from reporting standards [ 24 , 20 , 36 , 7 ] . A central challenge in migraine classification is the reliance on small and highly imbalanced clinical datasets, particularly in multiclass settings where rare but clinically relevant subtypes may be represented by only a few samples [ 19 , 27 ] . This imbalance reflects real-world clinical registries but introduces significant difficulties for model training, evaluation, and reproducibility [ 13 ] . When not properly addressed, models tend to favour majority classes, leading to inflated performance estimates that do not reflect true clinical utility. This issue is compounded by the use of inadequate evaluation metrics. Accuracy and micro-averaged scores are dominated by majority-class predictions and can obscure poor performance on minority subtypes. In contrast, macro-averaged F1 assigns equal importance to all classes and provides a more reliable assessment under severe imbalance [ 26 , 30 ] . For this reason, we adopt macro-F1 as the primary evaluation metric, as it better reflects the need for consistent performance across all clinically relevant subtypes. Beyond class imbalance, an additional and underexplored limitation lies in the design of data augmentation strategies. Classical oversampling methods such as SMOTE, as well as more recent generative approaches, are typically applied uniformly across all classes [ 6 , 4 , 38 ] . However, this uniform treatment ignores subtype-specific data characteristics and may generate implausible samples, amplify dataset biases, and inflate performance estimates. This effect compounds the distortion introduced by class imbalance and can lead to overly optimistic conclusions. In this study, we address these limitations through five interrelated contributions, summarised below and presented in detail in the remainder of the paper. We conduct a reproducibility-oriented reevaluation of prior migraine classification studies [ 27 , 19 ] , quantifying the impact of augmentation design and evaluation protocols on reported performance. On this corrected baseline, we propose a class-dependent hybrid augmentation framework that adaptively assigns augmentation strategies to each subtype based on its sample size, in contrast to conventional uniform augmentation. The framework, summarised in Fig. 1 , partitions classes by a sample-size threshold, assigns a generator to each tier, and controls the absolute volume of synthetic data through a discrete growth mode. The proposed framework is evaluated on a clinical dataset comprising 400 patients described by 22 features across seven migraine subtypes with highly skewed class distributions. Although moderate in size, this dataset reflects the intrinsic imbalance of specialised clinical registries. To ensure robust evaluation, we adopt a two-stage experimental design, considering both the full seven-class setting and a refined six-class configuration in which the two hemiplegic migraine subtypes (sporadic and familial), clinically defined by ICHD-3 §1.2.3 as variants of the same syndrome, are merged into a single class. The clinical and statistical rationale for this aggregation is presented in Section 5.2 . The main contributions of this work are: 1. A reproducibility-oriented reevaluation of migraine classification studies, identifying data leakage and reevaluating every prior-art classifier under a leakage-free per-classifier protocol; the strongest prior model reaches only macro-F1 0.803, far below the inflated accuracies originally reported (full per-model results in A.6 ). 2. A systematic benchmark of classifiers and augmentation methods under leakage-free stratified 5-fold cross-validation. 3. A clinically and statistically justified aggregation of the two hemiplegic migraine subtypes (sporadic and familial) into a single ICHD-3-grounded category, which addresses the structural performance ceiling observed in the seven-class formulation. 4. A class-dependent hybrid augmentation framework that adapts generation strategies to per-class data characteristics. 5. The introduction of fidelity asymmetry and the demonstration that proportional augmentation improves stability in low-data multiclass settings. The remainder of this paper is structured as follows. Section 2 reviews related work. Section 3 describes the dataset and methods. Section 4 presents the results. Section 5 analyses and discusses the findings, and Section 6 concludes the paper. 2 Related Work 2.1 Machine Learning for Migraine Classification The application of machine learning (ML) to migraine diagnosis and subtype classification has grown substantially in recent years, driven by the increasing availability of clinical, questionnaire-based, and neuroimaging datasets. Early work in this domain primarily relied on classical supervised learning algorithms, including Support Vector Machines (SVM), k-Nearest Neighbors (KNN), Random Forests (RF), and gradient boosting methods, often combined with feature selection techniques and synthetic oversampling to mitigate class imbalance [ 19 , 27 ] . More recently, deep learning and transformer-based architectures originally proposed for general-purpose tabular data have

Read the complete text