Improving Deep Knowledge Tracing via Gated Architectures and Adaptive Optimization
Altun Shukurlu · 2025
Read Improving Deep Knowledge Tracing via Gated Architectures and Adaptive Optimization by Altun Shukurlu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-20070.txt.
Introduction
Altun Shukurlu improves deep knowledge tracing in work from 2025. The method models student learning from past answers to predict future performance, and it supports personal learning systems.
The original model used plain recurrent networks in an old framework, which limited reuse. Shukurlu rebuilds it in PyTorch and swaps in gated units that hold long-term patterns better. Tests on two datasets show the gated models are more accurate and stable than the basic version. Among training algorithms, adaptive ones beat plain gradient descent in both early learning and final accuracy. The code is open source.
Catalog record
| CREATOR | Altun Shukurlu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-20070
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Improving Deep Knowledge Tracing via Gated Architectures and Adaptive Optimization Altun Shukurlu Abstract Deep Knowledge Tracing (DKT) [ 1 ] models student learning behavior by leveraging Recurrent Neural Networks (RNNs) to predict future performance based on historical interaction data. However, the original implementation relied on standard RNNs in the Lua-based Torch framework, limiting extensibility and reproducibility. In this paper, we revisit the DKT model from two perspectives: architectural improvements and optimization efficiency. First, we enhance the model using gated recurrent units, specifically Long Short-Term Memory (LSTM) [ 2 ] and Gated Recurrent Units (GRU) [ 3 ] , which better capture long-term dependencies and mitigate vanishing gradient issues [ 4 , 5 ] . Second, we re-implement DKT using the PyTorch framework [ 6 , 7 , 8 ] , enabling a modular and accessible infrastructure compatible with modern deep learning pipelines. Furthermore, we benchmark multiple optimization algorithms—SGD [ 9 ] , RMSProp [ 10 ] , Adagrad [ 11 ] , Adam [ 12 ] , and AdamW [ 13 ] —to evaluate their impact on convergence speed and predictive accuracy in educational modeling tasks. Experiments on the Synthetic-5 and Khan Academy datasets show that GRUs and LSTMs achieve higher accuracy and improved training stability over basic RNNs, while adaptive optimizers like Adam and AdamW outperform SGD in both early-stage learning and final model performance. Our open-source PyTorch implementation provides a reproducible and extensible foundation for future research in neural knowledge tracing and personalized learning systems. 1 Introduction Understanding how students acquire knowledge over time is a central challenge in educational data mining and intelligent tutoring systems. Accurate prediction of student performance enables adaptive learning platforms to provide timely feedback, support interventions, and personalize educational content. Traditional approaches to this task include probabilistic models such as Bayesian Knowledge Tracing (BKT) [ 14 ] and Performance Factor Analysis (PFA) [ 15 ] , which represent student knowledge as a set of latent variables that evolve over time based on observed responses. While interpretable, these models rely on handcrafted features and often make simplifying assumptions about how learning unfolds. Deep Knowledge Tracing (DKT) [ 1 ] marked a major shift by applying recurrent neural networks (RNNs), specifically Long Short-Term Memory (LSTM) networks [ 2 ] , to model student interaction sequences directly. This approach eliminated the need for feature engineering, allowing the model to learn complex temporal patterns from raw input data. DKT has since become a strong baseline in student modeling research and inspired a growing body of work exploring attention mechanisms [ 16 , 17 ] , memory networks [ 18 ] , graph structures [ 19 ] , and interpretability. Despite its influence, the original DKT pipeline exhibits two key limitations that hinder reproducibility and modern usage: 1. Model architecture : The original DKT model used standard RNNs, which are prone to vanishing gradients and struggle with long-term dependencies [ 4 ] . More advanced gated architectures—such as LSTMs and Gated Recurrent Units (GRUs) [ 3 ] —can better capture long-range temporal information via learned gating mechanisms that control memory updates over time [ 5 ] . 2. Implementation infrastructure and optimization : The original implementation used the Lua-based Torch framework, which is now deprecated and poorly supported. Additionally, the model was trained using vanilla Stochastic Gradient Descent (SGD) [ 9 ] , without systematic evaluation of modern optimization algorithms. In contrast, frameworks like PyTorch [ 6 , 7 , 8 ] support high-level abstractions (e.g., nn.LSTM ) and a wide range of adaptive optimizers, such as RMSProp [ 10 ] , Adagrad [ 11 ] , Adam [ 12 ] , and AdamW [ 13 ] , which offer improved convergence and generalization performance. In this work, we revisit the DKT framework with the goal of modernizing its core components. Our contributions are threefold: • We replace the original RNN with LSTM and GRU architectures to improve long-sequence modeling and training stability. • We re-implement the model in PyTorch with a modular and extensible codebase that supports reproducible research and future development. • We benchmark several optimization algorithms on the DKT task using the Synthetic-5 and Khan Academy datasets, showing that adaptive optimizers, particularly Adam and AdamW, outperform SGD in both convergence speed and predictive accuracy. Through these improvements, we aim to provide a clean, modern foundation for deep knowledge tracing research and encourage broader adoption of best practices in educational modeling pipelines. Our source code is publicly available at https://github.com/Altunshukurlu/Modern_DeepKnowledgeTracing and https://github.com/Altunshukurlu/Optimized_DeepKnowledgeTracing . 2 Preliminaries To contextualize our improvements to the DKT framework, this section reviews the underlying components relevant to our work. We begin with an overview of Deep Knowledge Tracing and its evolution from traditional student modeling approaches. We then introduce recurrent neural networks (RNNs) and their gated variants—LSTM and GRU—which address key limitations of standard RNNs. Finally, we discuss modern optimization algorithms that influence training stability and convergence, setting the stage for our empirical evaluations. 2.1 Deep Knowledge Tracing Knowledge Tracing (KT) is the task of modeling a student’s evolving knowledge state by analyzing their historical interactions with educational content [ 14 ] . The objective is to estimate the probability that a student will correctly answer future questions, which enables personalized feedback and adaptive learning systems. Traditional approaches like Bayesian Knowledge Tracing (BKT) [ 14 ] and Performance Factor Analysis (PFA) [ 15 ] rely on interpretable probabilistic models but often require hand-crafted features and make strong assumptions about learning dynamics. The introduction of Deep Knowledge Tracing (DKT) by Piech et al. 2015 marked a turning point. By applying recurrent neural networks to student interaction data, DKT allowed models to learn complex patterns directly from raw sequences, without the need for manual feature engineering. The success of DKT sparked a wave of research exploring ways to enhance its predictive power and interpretability. For instance, Dynamic Key-Value Memory Networks (DKVMN) [ 18 ] introduced external memory to better represent concept-level knowledge, while Self-Attentive Knowledge Tracing (SAKT) [ 16 ] and Attentive Knowledge Tracing (AKT) [ 17 ] replaced recurrence with attention mechanisms for more flexible modeling. Surveys such as those by Abdelrahman et al. 2023 and Liu et al. 2021 provide a comprehensive overview of this growing body of work, highlighting how deep learning has become integral to personalized learning systems. 2.2 Recurrent Neural Networks Figure 1: Unfolded RNN architecture Recurrent Neural Networks (RNNs) are a class of neural networks designed to process sequential data by maintaining a hidden state that evolves over time. A key feature of RNNs is the sharing of parameters across different time steps, enabling the model to capture temporal dependencies in the data. Formally, a standard RNN is defined by the following recurrence relations: h_{t}=\tanh(W_{xh}x_{t}+W_{hh}h_{t-1}+b_{h}) where h_{t} is the hidden state at time step t , x_{t} is the input at time step t , and W_{xh},W_{hh} are the weight matrices connecting the input and previous hidden state to the current hidden state. b_{h} is the bias term.The output at each time step is computed as: y_{t}=W_{hy}h_{t}+b_{y} where W_{hy} connects the hidden state to the output, and b_{y} is the output bias. This formulation allows RNNs to model sequences effectively; however, standard RNNs often struggle to capture long-range