StanBKT: Rethinking Parameter Estimation in Bayesian Knowledge Tracing
2026
Read StanBKT: Rethinking Parameter Estimation in Bayesian Knowledge Tracing (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-23048.txt.
Introduction
Pradhan and five coauthors offer StanBKT, an open-source Python package for Bayesian Knowledge Tracing in tutoring systems. Most tools use EM and yield only point values. That limits uncertainty estimates and fair comparisons. StanBKT uses Bayesian methods in Stan. It supports Hamiltonian Monte Carlo, variational methods, Pathfinder, and optimization, while keeping the hidden Markov structure. On ASSISTments 2020, its methods match on prediction while differing in speed and posterior fidelity. Posteriors enable fair comparisons of learning, forgetting, guessing, and slipping parameters.
Catalog record
| YEAR | 2026 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70340 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.23048
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
StanBKT: Rethinking Parameter Estimation in Bayesian Knowledge Tracing Abstract Bayesian Knowledge Tracing (BKT) remains one of the most widely used and interpretable student modeling approaches in intelligent tutoring systems and educational data mining. However, most existing BKT implementations rely on expectation-maximization or related optimization procedures that provide only point estimates, limiting uncertainty quantification and principled statistical comparison across learners and conditions. To address these limitations, we introduce StanBKT, an open-source Python package for estimating BKT models using Bayesian inference in Stan. StanBKT provides a unified framework supporting multiple inference methods, including Hamiltonian Monte Carlo (HMC), variational inference, Pathfinder, and optimization-based estimation, while preserving the interpretability and hidden Markov structure of classical BKT. The package supports standard, grouped, and hierarchical BKT formulations, flexible prior specification, posterior predictive inference, and downstream analysis utilities for visualization and diagnostics. We evaluate StanBKT on both large-scale observational and controlled experimental educational datasets. Using the ASSISTments 2020 dataset, we demonstrate that the inference methods supported in StanBKT achieve comparable predictive performance while differing in their trade-offs between computational efficiency and posterior fidelity. We further demonstrate how posterior inference enables principled comparison of condition-specific BKT parameters in an educational intervention study examining perceptual cue manipulations. Results illustrate how uncertainty quantification facilitates more reliable interpretation of differences in learning, forgetting, guessing, and slipping parameters across experimental conditions. Overall, StanBKT extends BKT beyond point estimation by providing an accessible and flexible framework for probabilistic student modeling, uncertainty quantification, and hierarchical inference in educational data mining research. keywords Bayesian Knowledge Tracing, student modeling, uncertainty quantification, Bayesian estimation, hierarchical BKT StanBKT \authorsnames [1,2,3,4,4,2] Siddhartha Pradhan , Yanping Pei , Morgan Lee , Puyuan Zhang , Erin Ottmar , Adam C. Sales \authorsaffiliations Department of Data Science, Department of Mathematical Sciences, Department of Computer Science, Department of Social Science and Policy Studies Worcester Polytechnic Institute, Worcester, MA, USA \authornote Corresponding Author Siddhartha Pradhan, Worcester Polytechnic Institute, 100 Institute Road, Worcester, MA 01609. Email: [email protected]. Acknowledgments We gratefully acknowledge the Stan Development Team for their continued development and maintenance of the Stan probabilistic programming language, which provides the core inference engine underlying StanBKT. This material is based upon work supported by the National Science Foundation under Grant [2300764] awarded to Worcester Polytechnic Institute. 1 Introduction Over the past three decades, intelligent tutoring systems (ITS) have emerged through interdisciplinary collaboration across education, computer science, cognitive science, and educational psychology ( Anderson et al. 1995a ; Heffernan & Heffernan 2014a ; Wang et al. 2023a ) . In contrast to traditional classroom settings, where student understanding is typically assessed through periodic exams or assignments, ITS enable continuous assessment during learning by maintaining computational representations of student knowledge and misconceptions, commonly referred to as student models ( Baker et al. 2011a ; Siemens & Baker 2012a ) . These models support adaptive instruction by estimating a learner’s evolving mastery of underlying skills in real time. Bayesian Knowledge Tracing (BKT) is one of the most widely studied and applied student modeling approaches ( Baker et al. 2008a ; Nedungadi & Remya 2015a ; Pardos & Heffernan 2011a ; Takami et al. 2024a ; Xu et al. 2023a ; Zambrano et al. 2024a ) . It estimates a student’s probability of mastering a given skill (or knowledge component) based on their sequence of observed responses over time. Despite its conceptual simplicity, BKT has been extensively used in both research and deployed tutoring systems due to its interpretability and ability to capture learning dynamics from interaction data. Beyond prediction, BKT has also been widely used to support adaptive decision-making in educational systems. Estimating student mastery enables tutoring platforms to deliver personalized interventions targeting specific knowledge gaps. Prior work has demonstrated that BKT-based student models have been incorporated into a wide range of intelligent tutoring applications. These include adaptive language tutoring systems that select instructional content based on estimated knowledge states ( Schodde et al. 2017a ) , explanation-generation systems that leverage slip and guess parameters to personalize feedback ( Takami et al. 2021a ) , and hybrid approaches that use deep learning models, such as Transformers, to estimate BKT parameters while preserving the interpretability of the underlying student model and achieving strong predictive performance ( Badrinath & Pardos 2025a ) . Collectively, these systems demonstrate how BKT can function as a core inference component within larger educational technologies that support real-time adaptation and personalized learning. More recently, researchers have also used BKT as an interpretability tool to study how instructional interventions and learning behaviors influence student learning dynamics. As BKT parameters (i.e., learning, forgetting, guessing, and slipping) correspond to interpretable cognitive processes, they provide a structured way to quantify how different educational conditions affect both short-term performance and long-term learning. For instance, Beck et al. 2008a used BKT to analyze the impact of help interventions in a reading ITS, finding that help increased learning rates while also influencing immediate performance through changes in guessing behavior. Similarly, recent work by ( Zhang et al. 2026a ) applied BKT to an open-source arithmetic learning dataset to examine how perceptual cue manipulations (e.g., color and spacing congruency) affect student learning. By analyzing changes in guess and slip parameters across conditions, they identified instructional conditions that improved immediate performance and others that enhanced long-term learning, consistent with theories of desirable difficulty ( Bjork & Bjork 2020a ; Koedinger et al. 2008a ) . Importantly, these parameter-level findings aligned with observed behavioral patterns, demonstrating the potential of BKT as a tool for validating cognitive and educational theories using empirical data. As data-driven models become increasingly integrated into educational research and practice, there is a growing need for accessible and transparent tools that can be used by researchers beyond the educational data mining and machine learning communities. Due to its interpretable hidden Markov structure and psychologically meaningful parameters, Bayesian Knowledge Tracing (BKT) is particularly well suited for this role, enabling broader adoption across the learning sciences and related disciplines. To support this goal, several open-source implementations and platforms have been developed to lower the barrier to entry for BKT modeling, including software libraries such as pyBKT ( Badrinath et al. 2021a ; Bulut et al. 2023a ) and systems such as OATutor ( Pardos et al. 2023a ) . However, most existing implementations rely on expectation-maximization or related optimization procedures that produce only point estimates, limiting researchers’ ability to quantify uncertainty and make principled comparisons across conditions. These limitations motivate the development of more flexible and unified frameworks for probabilistic student modeling. In response, we introduce StanBKT, a Python package built on Stan that enables full Bayesian inference for BKT models, supporting prior specification, hierarchical extensions, and posterior-based analyses while preserving the interpretability of the classical BKT framework. 2 Model Description Standard (or classical) Bayesian Knowledge Tracing ( Corbett & Anderson 1994a ) is a probabilistic generative model and can be viewed as a special case of a Hidden Markov Model (HMM) in which both the latent state and observed outcomes are dichotomous. The observed outcome Y_{t}\in\{0,1\} indicates whether the student correctly answers item P_{t} . The latent state at time t , denoted L_{t} , represents whether a student has mastered a given skill k while working through a sequence of items P_{1:t} .