AxelSMOTE: An Agent-Based Oversampling Algorithm for Imbalanced Classification

Sukumar Kishanthan, Asela Hevapathige · 2025

Read AxelSMOTE: An Agent-Based Oversampling Algorithm for Imbalanced Classification by Sukumar Kishanthan, Asela Hevapathige (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-06875.txt.

Introduction

Made-up examples for rare classes are grown by interacting agents in a 2025 machine learning paper by Sukumar Kishanthan and one co-author. Lopsided datasets, where one class vastly outnumbers another, bias classifiers against the minority. Classic oversampling makes copies or blends with drawbacks: features are treated on their own and variety is hard to control.

Their method, AxelSMOTE, borrows Axelrod's model of cultural spread, treating data points as agents that exchange traits. Features are grouped so links between them survive, exchanges are guided by likeness, blending uses a beta distribution for realistic mixes, and a dose of variety fights overfitting. On eight lopsided datasets, the method beat leading sampling approaches while staying cheap to run. The agent picture is more than decoration: the rules for how agents interact are what generate the new minority examples.

Catalog record

CREATORSukumar Kishanthan, Asela Hevapathige
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-06875

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AxelSMOTE: An Agent-Based Oversampling Algorithm for Imbalanced Classification Sukumar Kishanthan, Asela Hevapathige Abstract Abstract Class imbalance in machine learning poses a significant challenge, as skewed datasets often hinder performance on minority classes. Traditional oversampling techniques, which are commonly used to alleviate class imbalance, have several drawbacks: they treat features independently, lack similarity-based controls, limit sample diversity, and fail to manage synthetic variety effectively. To overcome these issues, we introduce AxelSMOTE, an innovative agent-based approach that views data instances as autonomous agents engaging in complex interactions. Based on Axelrod’s cultural dissemination model, AxelSMOTE implements four key innovations: (1) trait-based feature grouping to preserve correlations; (2) a similarity-based probabilistic exchange mechanism for meaningful interactions; (3) Beta distribution blending for realistic interpolation; and (4) controlled diversity injection to avoid overfitting. Experiments on eight imbalanced datasets demonstrate that AxelSMOTE outperforms state-of-the-art sampling methods while maintaining computational efficiency. Keywords: class imbalance, agent-based interactions, oversampling, statistical physics, algorithms 1 Introduction Class imbalance refers to the phenomenon where the distribution of classes in a dataset is biased towards specific classes ( Leevy et al., 2018 ; Aguiar et al., 2024 ) . It is identified as a challenging problem in data mining and machine learning, as machine learning and deep learning classifiers tend to perform suboptimally under imbalanced data, specifically towards minority class instances ( Altalhan et al., 2025 ; Ghosh et al., 2024 ) . This problem cannot be ignored as many real-world and engineering datasets naturally have imbalanced class distributions due to their real-world characteristics ( Kishanthan and Hevapathige, 2025 ; Chen et al., 2024 ) . Researchers have explored various mechanisms to alleviate class imbalance issues for decades, leading to the development of diverse techniques to improve classifier performance on minority classes. These techniques include data resampling, where sampling is performed to balance class distributions ( Carvalho et al., 2025 ; Zhao et al., 2024 ) , algorithm-level approaches that modify the learning model to be more sensitive to minority classes ( Araf et al., 2024 ; Farhadpour et al., 2024 ) , and hybrid approaches that combine both techniques ( Shin et al., 2024 ; Goswami and Singh, 2024 ) . Among these methods, data resampling is commonly preferred due to its model-agnostic nature, simplicity, and effectiveness in practice. Specifically, data oversampling, which increases the number of minority samples, has been empirically shown to work better for real-world datasets. Unlike undersampling, which reduces the total amount of training data by discarding instances from the majority class, oversampling increases the dataset size by maintaining all original instances and adding more examples. This approach allows the model to learn more accurate decision boundaries with enhanced generalizability. Additionally, compared to hybrid sampling methods, oversampling is simpler and easier to interpret, as it avoids the complexities and additional hyperparameters associated with balancing multiple sampling techniques. Commonly used oversampling techniques include diverse methods such as SMOTE Chawla et al., 2002 , SVMSMOTE Tang et al., 2008 , BorderlineSMOTE Han et al., 2005 , and ADASYN He et al., 2008 , which focus on generating synthetic minority data instances by fusing the existing minority data. Nonetheless, these existing oversampling methods suffer from several limitations. • Feature Independence Assumption: Traditional oversampling methods treat features independently during synthetic sample generation, potentially breaking important feature correlations and semantic relationships that exist within the original data. • Lack of Similarity-Based Generation Control: Most existing oversampling approaches employ simple interpolation between samples without adequately considering whether the selected samples are sufficiently similar for meaningful synthetic generation, which can result in unrealistic synthetic instances. • Deterministic Generation Processes: The generation processes in these methods tend to be relatively deterministic, following predictable patterns that may limit the diversity of the generated samples and reduce the robustness of the approach. • Limited Diversity Control Mechanisms: Traditional approaches generally lack sophisticated mechanisms for controlling diversity in synthetic samples, which can lead to overfitting to the training data and reduced generalization capability of the resulting models. In this work, we aim to address these limitations. We propose a novel oversampling approach that reconceptualises data instances as autonomous agents capable of complex interactions during synthetic sample generation. We observe that modelling data instances as agents enables the capture of sophisticated relationships and dependencies that traditional methods overlook. Specifically, we adopt Axelrod’s cultural dissemination model ( Axelrod, 1997 ) as the theoretical foundation for our method, as it offers several key advantages: it naturally handles multi-dimensional feature interactions through the concept of cultural traits, incorporates similarity-based exchange mechanisms that ensure meaningful interactions between compatible instances, introduces probabilistic elements that add controlled randomness to the generation process, and provides explicit parameters for managing diversity and interaction patterns. Axelrod’s model is particularly well-suited for oversampling because it was originally designed to explain how similar entities influence each other while maintaining diversity, which directly parallels the challenge of generating realistic synthetic samples that are similar to existing minority instances while avoiding exact replication. By leveraging this agent-based cultural exchange paradigm, our approach systematically addresses each of the identified gaps while providing a theoretically grounded and interpretable framework for synthetic sample generation. We call our oversampling method AxelSMOTE ( Axel ord S ynthetic M inority O versampling TE chnique). The main contributions of our work are as follows: • A Novel Agent-Based Perspective on Oversampling : We propose reconceptualizing data instances as autonomous agents capable of complex interactions, introducing Axelrod’s dissemination model as a theoretical foundation for synthetic sample generation in imbalanced datasets. • Trait-Based Feature Grouping for Correlation Preservation : We develop the concept of feature traits that partition features into semantically related groups, ensuring that correlated features are modified collectively during synthetic generation, thereby preserving important intra-trait relationships that traditional methods often break. • Similarity-Based Probabilistic Exchange Mechanism : We introduce a control mechanism that combines similarity thresholds with probabilistic influence rates to ensure meaningful trait exchange occurs only between sufficiently compatible instances, preventing unrealistic synthetic sample generation. • Empirical Performance : Extensive experiments demonstrate that AxelSMOTE consistently outperforms state-of-the-art sampling methods across multiple imbalanced datasets. 2 Related Work There has been a plethora of works targeting alleviating class imbalance. These works can be divided into three categories: resampling methods, algorithmic methods, and hybrid approaches. Data resampling techniques aim to decrease the imbalance in class distribution using various sampling methods ( Gurcan and Soylu, 2024 ) . On the other hand, algorithmic methods focus on enhancing the classifier through modifying the loss function or model architecture to increase its sensitivity to minority classes, where hybrid methods combine both data reassembly and algorithmic methods ( Krawczyk, 2016 ) . Data Resampling: Data resampling can be done either through minority oversampling, majority undersampling, or a combination of both these approaches. Minority oversampling increases the number of instances in the minority class, while majority undersampling reduces majority data instances to match the distribution of the minority class. Hybrid sampling strategically combines both minority oversampling and majority undersampling. Our research focuses on data resampling techniques by proposing an oversampling method to address class imbalance. Table 1 : Comparison of AxelSMOTE with existing oversampling methods Method Feature Similarity-based Probabilistic Diversity Theoretical Computational Stability Correlation Generation Generation Control Foundation Efficiency Preservation Control Traditional Methods SMOTE None None None None

Read the complete text