Finding the Sweet Spot: Optimal Data Augmentation Ratio for Imbalanced Credit Scoring Using ADASYN
Luis H. Chia · 2025
Read Finding the Sweet Spot: Optimal Data Augmentation Ratio for Imbalanced Credit Scoring Using ADASYN by Luis H. Chia (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-18252.txt.
Introduction
Luis H Chia asks how much synthetic data credit scoring should add, in a sole-authored 2025 study. Credit scoring predicts which borrowers may fail to repay a loan. Defaults are rare, under ten percent in his data, so models struggle to learn from few examples.
Chia tested ten setups on a dataset with over ninety-seven thousand records. He compared three oversampling methods, which copy or invent extra minority cases, at three growth levels. Doubling the minority group with ADASYN, one such method, worked best in his tests. Larger additions hurt results, suggesting a sweet spot well below full balance between the groups.
Catalog record
| CREATOR | Luis H. Chia |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-18252
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Finding the Sweet Spot: Optimal Data Augmentation Ratio for Imbalanced Credit Scoring Using ADASYN Luis H. Chia Abstract Credit scoring models face a critical challenge: severe class imbalance, with default rates typically below 10%, which hampers model learning and predictive performance. While synthetic data augmentation techniques such as SMOTE and ADASYN have been proposed to address this issue, the optimal augmentation ratio remains unclear, with practitioners often defaulting to full balancing (1:1 ratio) without empirical justification. This study systematically evaluates 10 data augmentation scenarios using the Give Me Some Credit dataset (97,243 observations, 7% default rate), comparing SMOTE, BorderlineSMOTE, and ADASYN at different multiplication factors (1 × \times , 2 × \times , 3 × \times ). All models were trained using XGBoost and evaluated on a held-out test set of 29,173 real observations. Statistical significance was assessed using bootstrap testing with 1,000 iterations. Key findings reveal that ADASYN with 1 × \times multiplication (doubling the minority class) achieved optimal performance with AUC of 0.6778 and Gini coefficient of 0.3557, representing statistically significant improvements of +0.77% and +3.00% respectively ( p = 0.017 p=0.017 , bootstrap test). Higher multiplication factors (2 × \times and 3 × \times ) resulted in performance degradation, with 3 × \times showing a − 0.48 % -0.48\% decrease in AUC, suggesting a “law of diminishing returns” for synthetic oversampling. The optimal class imbalance ratio was found to be 6.6:1 (majority:minority), contradicting the common practice of balancing to 1:1. This work provides the first empirical evidence of an optimal “sweet spot” for data augmentation in credit scoring, with practical guidelines for industry practitioners and researchers working with imbalanced datasets. While demonstrated on a single representative dataset, the methodology provides a reproducible framework for determining optimal augmentation ratios in other imbalanced domains. Keywords: Credit scoring, ADASYN, data augmentation, imbalanced learning, synthetic oversampling, class imbalance Keywords: Credit Scoring, Imbalanced Learning, ADASYN, SMOTE, Data Augmentation, Machine Learning, XGBoost, Financial Risk Assessment 1 Introduction 1.1 Motivation and Context Credit scoring plays a fundamental role in modern financial decision-making, enabling lenders to assess the creditworthiness of loan applicants and manage portfolio risk effectively ( Thomas et al., 2002 ) . Machine learning models have become the industry standard for credit scoring, demonstrating superior predictive performance compared to traditional statistical methods ( Lessmann et al., 2015 ) . However, these models face a persistent challenge: severe class imbalance, where defaulting customers typically represent less than 10% of the population ( Brown and Mues, 2012 ) . This imbalance poses significant difficulties for model training. Standard machine learning algorithms, optimized for balanced datasets, tend to bias predictions toward the majority class, resulting in poor detection of the minority class—the very defaults that lenders need to identify ( He and Garcia, 2009 ) . The cost of misclassification is asymmetric: failing to identify a default (false negative) is far more costly than incorrectly rejecting a good customer (false positive), making accurate minority class prediction critical for business profitability. Synthetic data augmentation techniques, particularly SMOTE (Synthetic Minority Over-sampling Technique) ( Chawla et al., 2002 ) and its variants, have emerged as promising solutions to address class imbalance. These methods generate synthetic observations in the feature space of the minority class, artificially increasing its representation during model training. ADASYN (Adaptive Synthetic Sampling) ( He et al., 2008 ) , an advanced variant, adaptively generates more synthetic samples in regions where the minority class is harder to learn, theoretically providing superior performance. Despite widespread adoption in research, a critical question remains unanswered: How much augmentation is optimal? Practitioners often apply aggressive oversampling to achieve a balanced 1:1 class ratio, based on the intuition that ”more data is better.” However, this practice lacks empirical validation and may introduce risks such as overfitting to synthetic patterns, distribution drift, and computational inefficiency. 1.2 Research Gap While the effectiveness of SMOTE and its variants has been demonstrated across various domains ( Fernández et al., 2018 ) , existing literature exhibits three critical gaps: Gap 1: Lack of systematic evaluation of augmentation ratios. Most studies compare augmented versus non-augmented datasets but fail to investigate the optimal degree of augmentation. The implicit assumption that ”more synthetic data yields better performance” has not been rigorously tested across different multiplication factors. Gap 2: Absence of statistical significance testing. Many papers report marginal performance improvements (e.g., +0.5% AUC) without formal statistical validation. Without significance tests such as bootstrap resampling, it remains unclear whether observed improvements represent genuine model enhancement or random variation. Gap 3: Limited comparison of adaptive versus uniform techniques. While ADASYN’s theoretical advantages are well-documented ( He et al., 2008 ) , empirical head-to-head comparisons with SMOTE and BorderlineSMOTE under controlled conditions (same multiplication factor, same algorithm) are scarce in the credit scoring literature. These gaps leave practitioners without clear guidance: Should they duplicate the minority class once (1 \times ), twice (2 \times ), or achieve full balance? Should they use SMOTE’s uniform interpolation or ADASYN’s adaptive approach? The absence of evidence-based recommendations may lead to suboptimal model configurations in production systems. 1.3 Research Contributions This study addresses the identified gaps through a systematic empirical investigation of data augmentation strategies for credit scoring. Our contributions are fourfold: Contribution 1: Identification of the ”sweet spot” in data augmentation. We provide the first empirical evidence that optimal performance occurs at 1 \times multiplication (doubling the minority class), with higher factors (2 \times and 3 \times ) exhibiting diminishing returns and eventual performance degradation. This finding challenges the common practice of aggressive oversampling to achieve 1:1 balance. Contribution 2: Rigorous statistical validation. All performance comparisons are validated using bootstrap hypothesis testing (1,000 iterations) with explicit p -values and 95% confidence intervals. We demonstrate that ADASYN 1 \times achieves statistically significant improvements ( p=0.017 ) over baseline, establishing a robust methodological standard for future research. Contribution 3: Controlled technique comparison. We conduct the first systematic comparison of SMOTE, BorderlineSMOTE, and ADASYN at identical multiplication factors, isolating the effect of the generation strategy. Results show that adaptive approaches (ADASYN) outperform uniform interpolation (SMOTE), with BorderlineSMOTE occupying an intermediate position. Contribution 4: Practical guidelines for practitioners. Based on our findings, we provide actionable recommendations: (i) use ADASYN with 1 \times multiplication for credit scoring tasks with \sim 7% default rates, (ii) target a class ratio of approximately 6-7:1 rather than 1:1, and (iii) avoid excessive hyperparameter tuning, which we demonstrate leads to overfitting (grid search degraded test AUC by -0.10 ). 1.4 Paper Organization The remainder of this paper is organized as follows. Section 2 reviews related work on credit scoring, imbalanced learning, and synthetic data augmentation techniques. Section 3 describes our methodology, including dataset characteristics, experimental design, and evaluation metrics. Section 4 presents results from all 10 experimental scenarios, including statistical significance tests and synthetic data quality assessments. Section 5 discusses the implications of our findings, addresses limitations, and suggests future research directions. Section 6 concludes with practical recommendations for industry practitioners and researchers. 2 Related Work 2.1 Credit Scoring Models Credit scoring has evolved significantly over the past decades, transitioning from expert-based systems to sophisticated statistical and machine learning approaches ( Thomas et al., 2002 ) . Traditional methods such as logistic regression and discriminant analysis dominated