Uncovering latent territorial structure in ICFES Saber 11 performance with Bayesian multilevel spatial models
Laura Pardo, Juan Sosa, Andrés Felipe Arévalo-Arévalo · 2025
Read Uncovering latent territorial structure in ICFES Saber 11 performance with Bayesian multilevel spatial models by Laura Pardo, Juan Sosa, Andrés Felipe Arévalo-Arévalo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-17119.txt.
Introduction
Laura Pardo and coauthors map territorial gaps in Colombia Saber 11 exam scores for the second semester of 2022, using Bayesian multilevel spatial models. Scores vary by place, and the team asks which social traits track the gaps once geography is counted.
The model joins multilevel regression with spatial random effects at municipal and department levels, and compares Ridge and Lasso priors for the social covariates. Monte Carlo inference in open tools, checked on synthetic data, favored Ridge for balance of recovery, prediction, and sampling speed. Real results show strong centralization, with top scores in central departments. Living conditions, maternal schooling, learning resources, gender, and ethnic background linked most strongly to scores.
Catalog record
| CREATOR | Laura Pardo, Juan Sosa, Andrés Felipe Arévalo-Arévalo |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 95 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-17119
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Uncovering latent territorial structure in ICFES Saber 11 performance with Bayesian multilevel spatial models Laura Pardo, Juan Sosa, Andrés Felipe Arévalo-Arévalo Abstract This article develops a Bayesian hierarchical framework to analyze academic performance in the 2022 second semester Saber 11 examination in Colombia. Our approach combines multilevel regression with municipal and departmental spatial random effects, and it incorporates Ridge and Lasso regularization priors to compare the contribution of sociodemographic covariates. Inference is implemented in a fully open source workflow using Markov chain Monte Carlo methods, and model behavior is assessed through synthetic data that mirror key features of the observed data. Simulation results indicate that Ridge provides the most balanced performance in parameter recovery, predictive accuracy, and sampling efficiency, while Lasso shows weaker fit and posterior stability, with gains in predictive accuracy under stronger multicollinearity. In the application, posterior rankings show a strong centralization of performance, with higher scores in central departments and lower scores in peripheral territories, and the strongest correlates of scores are student level living conditions, maternal education, access to educational resources, gender, and ethnic background, while spatial random effects capture residual regional disparities. A hybrid Bayesian segmentation based on K means propagates posterior uncertainty into clustering at departmental, municipal, and spatial scales, revealing multiscale territorial patterns consistent with structural inequalities and informing territorial targeting in education policy. Keywords: Icfes; Saber 11; Bayesian cluster; hierarchical Bayesian models; spatial random effects; Markov chain Monte Carlo. 1 Introduction The Saber 11 test is a standardized external assessment administered by the Colombian Institute for the Evaluation of Education (ICFES, by its acronym in Spanish) and it is part of the Colombian national evaluation system. The exam monitors the development of competencies of students who are about to complete eleventh grade, it provides information on the quality of education offered by institutions across the country, and it informs public education policies at the national, territorial, and institutional levels 14 . This paper studies the global score, defined as a weighted average of the five assessed components, Mathematics, Reading, Science, Social Studies, and English. Academic performance is shaped by contextual conditions that operate beyond the classroom. Access to safe drinking water, adequate sanitation, exposure to violence, and basic living conditions can determine whether sustained learning is feasible. Colombia has experienced a prolonged internal conflict and persistent territorial inequalities, which have contributed to unequal state capacity and uneven delivery of public services across regions. Quantifying how these structural conditions relate to educational outcomes helps identify where policy and resources should be redirected, and it clarifies how territorial disparities translate into gaps in learning opportunities. Recent evidence indicates that educational outcomes in Colombia exhibit spatial dependence and regional clustering, which suggests that place based mechanisms act as structural determinants of educational quality ( 18 ) . This motivates modeling strategies that move beyond purely individual level covariates and that incorporate latent territorial structure. Bayesian hierarchical models are well suited for this goal because they borrow strength across groups, mitigate overfitting, and provide principled uncertainty quantification in complex multilevel settings ( 6 ; 20 ) . Prior work has also supported Bayesian approaches for educational outcomes, including models designed to bounded responses ( 4 ) . Recent developments in spatially varying effects and structured shrinkage further strengthen the case for flexible spatial inference in settings where spatial structure and multicollinearity can coexist ( 13 ; 19 ) . This study develops a Bayesian hierarchical framework to analyze determinants of academic performance in the 2022 second semester Saber 11 examination. The framework combines multilevel regression with departmental and municipal components, and it includes a spatial random effect that captures latent territorial structure not explained by observed covariates. The model links student scores to a design matrix and regression coefficients through a linear predictor that includes hierarchical and spatial terms, and it targets fundamental posterior summaries for uncertainty aware inference and decision support. The spatial component encodes geographic proximity and residual dependence, following standard Bayesian spatial modeling principles as in 2 , 1 , and 17 . A central methodological contribution is the integration of regularization through Ridge and Lasso priors (e.g., 22 and 7 ), which supports estimation under correlated predictors and enables a principled contrast of the relative contribution of sociodemographic covariates. The Ridge specification favors global shrinkage, while the Lasso specification induces stronger sparsity, and this comparison clarifies when shrinkage improves posterior stability, interpretability, and predictive performance. Model behavior is evaluated using synthetic data designed to reflect key features of the observed data, including increasing dependence among predictors, and the fitted models are then applied to the 2022 second semester Saber 11 data to quantify covariate effects and latent territorial structure. In the case study, the paper addresses four important questions. First, which student level living conditions and institutional characteristics are most strongly associated with the global score after accounting for hierarchical structure. Second, to what extent territorial covariates explain performance gaps once student level conditions are included. Third, how much residual territorial structure remains after conditioning on covariates, and how this structure is captured by the spatial random effects. Fourth, how the choice between Ridge and Lasso regularization affects parameter recovery, posterior stability, and predictive performance across controlled simulations and real data. The empirical results show a marked centralization of educational performance. Posterior rankings place the highest scores in central departments, including Bogotá, Boyacá, and Cundinamarca, and the lowest scores in peripheral territories, including Chocó, Vaupés, and Vichada. Student level living conditions exhibit the strongest associations with performance, particularly mother education and access to educational resources, and the results also show systematic gaps associated with gender and ethnic background. Territorial covariates have smaller marginal effects, yet spatial random effects capture persistent regional disparities not explained by observed covariates, which supports the conclusion that unequal opportunities remain even after adjusting for measured conditions. A second methodological contribution is a hybrid Bayesian segmentation strategy that propagates posterior uncertainty into clustering. We develop a K means based procedure to produce multiscale territorial clusters at the departmental and municipal levels, and from the spatial random effects, which yields a latent segmentation aligned with structural inequalities and reveals heterogeneity within low performing departments. In practical terms, this segmentation complements posterior rankings by identifying territorially coherent groups that may benefit from differentiated policy targeting and resource allocation. Finally, this work provides a fully open source theoretical and computational implementation, with custom Markov chain Monte Carlo algorithms that embed Metropolis–Hastings updates within a Gibbs sampler, and with model comparison based on posterior predictive checks and information criteria ( 6 ) . This end to end workflow is designed to be adapted to future educational cohorts and to related applications where outcomes are shaped by multilevel organization and latent spatial structure. The remainder of the document is organized as follows. Section 2 describes the Saber 11 dataset, the student, municipal, and departmental covariates, and their spatial distribution. Section 3 presents the Bayesian multilevel spatial regression specifications, prior choices, and posterior computation. Section 4 reports posterior inference, territorial rankings and segmentation, model comparison, and out of sample prediction. Section 5 presents the simulation design and results. Section 6 summarizes the main findings and outlines directions for future research. (a) Departmental level mean.