An Explainable Ensemble Learning Framework for Crop Classification with Optimized Feature Pyramids and Deep Networks
Syed Rayhan Masud 1 , SK Muktadir Hossain 1,2 , Md. Ridoy Sarkar 1 , Mohammad Sakib Mahmood 2 Md. Kishor Morol 2 , Rakib Hossain Sajib 3 · 2026
Read An Explainable Ensemble Learning Framework for Crop Classification with Optimized Feature Pyramids and Deep Networks by Syed Rayhan Masud 1 , SK Muktadir Hossain 1,2 , Md. Ridoy Sarkar 1 , Mohammad Sakib Mahmood 2 Md. Kishor Morol 2 , Rakib Hossain Sajib 3 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25070.txt.
Introduction
Masud and co-authors build an explainable ensemble that sorts crops by soil and weather fit. The data holds 3,867 cases with 29 traits from Ethiopian and NASA sources. Traits cover soil pH, nitrogen, and rainfall, among others. The team cleans the data, balances the classes, and compares many models. Their stacked final ensemble reaches top scores near 99 percent on accuracy and F1. Explanation tools then rank which traits drive each call. Soil pH, nitrogen, and zinc stand out, which helps farmers trust the advice.
Catalog record
| CREATOR | Syed Rayhan Masud 1 , SK Muktadir Hossain 1,2 , Md. Ridoy Sarkar 1 , Mohammad Sakib Mahmood 2 Md. Kishor Morol 2 , Rakib Hossain Sajib 3 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28249 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.25070
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
An Explainable Ensemble Learning Framework for Crop Classification with Optimized Feature Pyramids and Deep Networks Syed Rayhan Masud 1 , SK Muktadir Hossain 1,2 , Md. Ridoy Sarkar 1 , Mohammad Sakib Mahmood 2 Md. Kishor Morol 2 , Rakib Hossain Sajib 3 Abstract Agriculture is increasingly challenged by climate change, soil degradation, and resource depletion, and hence requires advanced data-driven crop classification and recommendation solutions. This work presents an explainable ensemble learning paradigm that fuses optimized feature pyramids, deep networks, self-attention mechanisms, and residual networks for bolstering crop suitability predictions based on soil characteristics (e.g., pH, nitrogen, potassium) and climatic conditions (e.g., temperature, rainfall). With a dataset comprising 3,867 instances and 29 features from the Ethiopian Agricultural Transformation Agency and NASA, the paradigm leverages preprocessing methods such as label encoding, outlier removal using IQR, normalization through StandardScaler, and SMOTE for balancing classes. A range of machine learning models such as Logistic Regression, K-Nearest Neighbors, Support Vector Machines, Decision Trees, Random Forest, Gradient Boosting, and a new Relative Error Support Vector Machine are compared, with hyperparameter tuning through Grid Search and cross-validation. The suggested ”Final Ensemble” meta-ensemble design outperforms with 98.80% accuracy, precision, recall, and F1-score, compared to individual models such as K-Nearest Neighbors (95.56% accuracy). Explainable AI methods, such as SHAP and permutation importance, offer actionable insights, highlighting critical features such as soil pH, nitrogen, and zinc. The paradigm addresses the gap between intricate ML models and actionable agricultural decision-making, fostering sustainability and trust in AI-powered recommendations I Introduction Agriculture remains the backbone of global food security and economic stability, especially in developing nations. It supports billions of livelihoods and feeds a population projected to reach 9.7 billion by 2050, thereby ensuring that global food needs are met and economic stability is ensured [ 14 ] . Tradition-based manual procedures to select a crop are insufficient for identifying subtle interactions among soil properties, weather parameters, and crop requirements. They require sophisticated analytic tools and data-driven answers for such global issues as climate change, water scarcity, and sustainability. Precision agriculture has transformed farming by leveraging advanced technologies to enhance crop yields by 15-20% and reduce input costs by 30-50% [ 12 , 22 ] , with Machine Learning (ML) playing a crucial role in crop selection, yield prediction, and resource optimization through models such as Logistic Regression, K-Nearest Neighbors, Support Vector Machines, Decision Trees, Random Forest, Gradient Boosting, and our novel Relative Error Support Vector Machine. However, the ”black box” nature of most ML modelswhere predictions lack transparent rationale creates significant adoption barriers for farmers, extension agents, and policymakers who require interpretable, actionable insights to make informed decisions and trust AI-driven agricultural recommendations [ 7 ] . Explainable Artificial Intelligence (XAI) addresses to mitigate these problems by providing models with greater transparency and interpretability. XAI methods provide systematic ways to unveil the internal logic of intricate models, assign a hierarchy of priority to the model’s features, and generate human-interpretable explanations for the indicative reasons behind automated decisions. Methods such as SHAP give us values for the contribution of features, whereas permutation feature importance methods provide us values for the impact of the features by calculating the deterioration of the model performance [ 9 , 21 ] . XAI in agriculture helps farmers to understand recommendations, building trust and enabling practical solutions. These revelations improve the adoption of ML-based technologies by bridging the gap between sophisticated analytics and real-world farming. Class imbalance in agricultural ML datasets affects predictions by under representing specific crops. The Synthetic Minority Over-sampling Technique (SMOTE) provides an effective solution to this problem. It provides synthetic examples in the minority class feature space, ensuring fair representation across all crop types while avoiding bias toward majority classes [ 10 , 8 ] . Ensemble learning is a revolutionary approach that systematically combines several algorithms by addressing the shortcomings of individual models to produce reliable, high-performing prediction systems. Ensemble approaches reduce individual model mistakes and capture a variety of patterns by merging multiple models. This makes them particularly appropriate for complicated agricultural applications where non-linear and several environmental elements interact [ 3 ] . Feature Pyramid Networks achieve hierarchical feature representation through multi-scale pattern recognition, Deep Networks model complex non-linear relationships between soil properties and crop suitability, Self-Attention mechanisms provide adaptive feature weighting for dynamic environmental conditions, and Residual Networks facilitate enhanced gradient flow for deep feature learning. The proposed framework introduces a novel architecture ”Final Ensemble” methodology that integrates Feature Pyramid, Deep Network, Self-Attention, and Residual Network models in a meta-ensemble. Using performance- and confidence-based weighting, the Final Ensemble achieves superior results, reaching 98.80% accuracy, precision, recall, and F1-score, significantly outperforming individual ensemble methods. The major contributions of this work are as follows: 1. High-Performance Meta-Ensemble Framework: We propose a novel design of meta-ensembles which combines Feature Pyramid Networks with Deep Networks, Self-Attention mechanisms, and Residual Networks using the performance-based weighted fusion. The Final Ensemble, resulting in an exceptionally good performance of all martices. 2. Comprehensive XAI Integration: We embedded Explainable Artificial Intelligence (XAI) methods and SHAP and permutation importance to provide transparent, multi-level explanations, highlighting the global impact of soil and climate features on crop suitability prediction. 3. Agronomically Validated Insights with Practical Utility: Feature importance analysis showed that soil pH, nitrogen, zinc, and other key nutrients are the main factors driving crop classification. These results are consistent with agronomic knowledge and convert complex model outputs into practical, data-driven guidance for sustainable crop selection in various environments. These contributions collectively establish a novel explainable ensemble paradigm that not only delivers state-of-the-art performance but also ensures transparency and actionable insights for practical agricultural deployment. II Literature Review Talero-Sarmiento et al. [ 18 ] built an ensemble model of k-means clustering and specific Random Forest classifiers to predict suitable places for cocoa cultivation within Colombia. Their two-stage process consists of a location clustering step and a Random Forest classification step using 57658 Colombian database and NASA POWER 81 meteorological, soil and elevation variables. The clustered-trained model obtained an accuracy overall of 94.11%, including the performances 94.61%–96.91% scored in cluster-specifics. Umera et al. [ 12 ] proposed a smart crop recommendation system based on ensemble learning using voting method, where Artificial Neural Network (ANN) achieved encouraging results . Their method pitted Logistic Regression, SVM, Decision Tree, KNN, and XGBoost against each other on a Kaggle dataset of 22 types of crops having six features: phosphorous, potassium, nitrogen, humidity, rainfall and pH. The ANN model had the highest performances for all metrics (accuracy, precision, recall, and F 1 -score) of 98%, topped by XGBooster with the highest recall performance. Cherukuri et al. [ 22 ] proposed the EEE algorithm (Ensembled Enabled Edge computing model) to provide precision crop recommendation, through a two-stage evaluation procedure for evaluating crop growth conditions and suitable month of sowing. The method used an ensemble method with majority voting with a Naïve Bayes and SVM classifier with 5,315 Kaggle records of nitrogen, phosphorus, potassium, temperature, humidity, pH, and rainfall which are listed as variables for rice, maize and chickpea. The EEE method reached the highest accuracy of 95% and performed strongly for all metrics (93.99-94.31%). Hosain et al. proposed a hybrid self-attentive transformer-based RNN for financial sentence analysis,