A Multi-level Analysis of Factors Associated with Student Performance: A Machine Learning Approach to the SAEB Microdata

Rodrigo Tertulino, Ricardo Almeida · 2025

Read A Multi-level Analysis of Factors Associated with Student Performance: A Machine Learning Approach to the SAEB Microdata by Rodrigo Tertulino, Ricardo Almeida (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-22266.txt.

Introduction

Rodrigo Tertulino and Laércio Alencar turn machine learning on a policy question: what actually moves student achievement in Brazilian basic education. Using microdata from the national SAEB assessment system, they classify the proficiency of ninth graders and high school students while joining four sources that are usually studied apart. Student background, teacher profiles, school indicators, and principals' management profiles.

Four ensemble algorithms competed, and a Random Forest won, scoring just over ninety percent accuracy with a very strong ranking measure. Opening the model with SHAP explanations delivered the headline: the school's average socioeconomic level dominates every other predictor, outweighing individual traits on their own. The authors conclude that performance is a systemic phenomenon, shaped by the context a student is schooled in, which points policy toward schools and communities rather than isolated student fixes.

Catalog record

CREATORRodrigo Tertulino, Ricardo Almeida
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-22266

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Multi-level Analysis of Factors Associated with Student Performance: A Machine Learning Approach to the SAEB Microdata Rodrigo Tertulino, Ricardo Almeida Abstract Identifying the factors that influence student performance in basic education is a central challenge for formulating effective public policies in Brazil. This study introduces a multi-level machine learning approach to classify the proficiency of 9th-grade and high school students using microdata from the System of Assessment of Basic Education (SAEB). Our model uniquely integrates four data sources: student socioeconomic characteristics, teacher professional profiles, school indicators, and director management profiles. A comparative analysis of four ensemble algorithms confirmed the superiority of a Random Forest model, which achieved 90.2% accuracy and an Area Under the Curve (AUC) of 96.7%. To move beyond prediction, we applied Explainable AI (XAI) using SHAP, which revealed that the school’s average socioeconomic level is the most dominant predictor, demonstrating that systemic factors have a greater impact than individual characteristics in isolation. The primary conclusion is that academic performance is a systemic phenomenon deeply tied to the school’s ecosystem. This study provides a data-driven, interpretable tool to inform policies aimed at promoting educational equity by addressing disparities between schools. keywords Student Performance Prediction, Machine Learning, Educational Data Mining, SAEB, Multi-level Analysis, Socioeconomic Factors, Brazilian Basic Education. 1 Introduction Identifying the determinants of academic success in basic education represents a central challenge for educational research and policymaking, particularly in a country with Brazil’s vast dimensions and socioeconomic heterogeneity ( Issah et al. 2023 ) . A systemic approach is crucial, as student performance is influenced by a complex interplay of factors spanning individual, academic, socioeconomic, and institutional domains ( Barragán Moreno and Guzmán Rincón 2025 ) . The System of Assessment of Basic Education (SAEB), conducted by the National Institute for Educational Studies and Research Anísio Teixeira (INEP) ( INEP 2025 ) , provides a rich, multi-level dataset uniquely suited for such an analysis ( Bonamino et al. 2010 ) . The public availability of its anonymized microdata enables the research community to investigate the intricate relationships between student proficiency and a wide array of contextual factors, from socioeconomic backgrounds to school infrastructure and teacher profiles. Consequently, the SAEB microdata is an essential resource for data-driven research aimed at informing and evaluating educational policies in the country ( Lundberg and Lee 2017b ; Mazoni and Oliveira 2023 ) . While traditional statistical methods are common, the Educational Data Mining (EDM) paradigm offers powerful tools for uncovering complex, non-linear patterns from such data ( Romero and Ventura 2010 ) . Furthermore, we demonstrate that by interpreting the model’s classification results with XAI techniques, our method provides data-driven insights for educators and policymakers ( Idrizi 2024 ) . The primary objective of this research is thus to develop and evaluate a multi-level machine learning model to identify the key systemic factors associated with the academic performance of 9th-grade and high school students, using the SAEB microdata. Building upon this perspective, the study shifts its analytical focus from purely individual student interventions toward addressing the systemic determinants that shape educational outcomes in Brazilian basic education. To guide this investigation, the following research questions (RQs) were formulated: [label= RQ ] • RQ1: How effectively can machine learning models analyze the vast, multi-level SAEB microdata to identify the most significant predictors of student academic performance? • RQ2: What is the relative importance of individual and academic characteristics compared to systemic, socioeconomic, and institutional factors in explaining student achievement? • RQ3: What data-driven insights can be inferred from the final predictive model to help educators and policymakers address the primary factors influencing educational outcomes in Brazil? To address these research questions, this study employs and compares four powerful, tree-based ensemble models, Random Forest ( Breiman 2001 ) , XGBoost ( Chen and Guestrin 2016 ) , LightGBM ( Ke et al. 2017 ) , and CatBoost ( Dorogush et al. 2018 ) , selected for their high performance on tabular data. Moreover, the article makes the following contributions to the field of Educational Data Mining and public policy analysis: [label= RQ ] 1. We design and implement a novel multi-level predictive model by systematically integrating four distinct data sources from the national SAEB assessment: student socioeconomic profiles, teacher professional data, consolidated school indicators, and director management profiles. 2. We conduct a rigorous comparative evaluation of powerful tree-based ensemble models, demonstrating that our final Random Forest model achieves a high predictive accuracy of 90.2% and an Area Under the Curve (AUC) of 96.7%. 3. We provide a data-driven feature importance analysis that unequivocally identifies the school’s average socioeconomic level as the most dominant predictor, demonstrating that systemic, school-level factors have a greater impact on performance than isolated individual characteristics. 4. We offer actionable, evidence-based insights for educational policy, quantifying the systemic nature of academic achievement and highlighting the potential of policies to reduce socioeconomic disparities between schools, thereby fostering greater educational equity. In addition, this study makes a novel contribution by addressing these questions through the systematic integration and methodologically sound analysis of four distinct data sources. The resulting model provides a realistic measure of predictive accuracy and a nuanced, data-driven perspective on the systemic nature of student achievement, offering actionable insights for educational stakeholders in Brazil. The remainder of this study is organized as follows: Section 2 reviews related work on educational data mining and performance prediction. Section 3 delineates the theoretical foundations guiding the study. Section 4 details our methodology, from data preparation to the machine learning models used. Subsequently, Section 5 presents the empirical results of our comparative analysis, which are then interpreted through the application of SHAP. Section 6 discusses the broader implications of our findings in both theoretical and practical contexts. Finally, Section 7 concludes the paper, summarizing its contributions and outlining directions for future research. 2 Related Work Analyzing large-scale educational assessment data has become a cornerstone of educational research. Educational Data Mining (EDM) focuses on developing and applying computational methods to explore data from educational settings, with the overarching goal of understanding and improving student learning processes ( Papadogiannis et al. 2024 ) . A primary focus within EDM has been predicting student outcomes, such as academic performance and dropout risk, to enable timely and targeted interventions ( Alan et al. 2025 ; Taufikin et al. 2024 ) . In the Brazilian context, numerous studies have utilized machine learning techniques to address these challenges, primarily in the higher education sector. A significant body of work has applied classification models to predict student dropout using institutional academic records, demonstrating the viability of EDM for identifying at-risk students in the country ( Sales et al. 2015 ; Carneiro et al. 2022 ; Colpo et al. 2024 ; Melo and Souza 2023 ) . These studies establish a strong precedent for using computational models to tackle critical issues in Brazilian education. Globally, predicting student performance is a well-established area of research. Early identification of students likely to underperform enables educators to provide targeted support, laying the groundwork for adaptive and personalized learning platforms ( Martinez et al. 2024 ; Ravuri et al. 2023 ; Tang and Chen 2024 ) . A wide range of machine learning algorithms has been employed

Read the complete text