MetaCD: A Meta Learning Framework for Cognitive Diagnosis based on Continual Learning
2025
Read MetaCD: A Meta Learning Framework for Cognitive Diagnosis based on Continual Learning (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-22904.txt.
Introduction
Jin Wu and Chanjin Zheng address cognitive diagnosis, the task of estimating which skills each student has mastered from their answers. Deep learning models capture complex links among students, questions, and skills, but real education data are long-tailed, with few records for many skills, and the data keep changing as courses evolve. Both facts drag accuracy down.
Their framework, MetaCD, pairs meta-learning with continual learning. Meta-learning finds a starting point for the model that adapts to a new task from only a little data, easing the long-tail problem. A parameter protection mechanism, borrowed from continual learning, guards important weights so the model can absorb new skills without forgetting old ones. Across five real-world datasets, MetaCD beat competing baselines on accuracy and on generalization to later tasks, balancing flexibility on new material with stability on what came before.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-22904
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MetaCD: A Meta Learning Framework for Cognitive Diagnosis based on Continual Learning Abstract Cognitive diagnosis is an essential research topic in intelligent education, aimed at assessing the level of mastery of different skills by students. So far, many research works have used deep learning models to explore the complex interactions between students, questions, and skills. However, the performance of existing method is frequently limited by the long-tailed distribution and dynamic changes in the data. To address these challenges, we propose a meta-learning framework for cognitive diagnosis based on continual learning (MetaCD). This framework can alleviate the long-tailed problem by utilizing meta-learning to learn the optimal initialization state, enabling the model to achieve good accuracy on new tasks with only a small amount of data. In addition, we utilize a continual learning method named parameter protection mechanism to give MetaCD the ability to adapt to new skills or new tasks, in order to adapt to dynamic changes in data. MetaCD can not only improve the plasticity of our model on a single task, but also ensure the stability and generalization of the model on sequential tasks. Comprehensive experiments on five real-world datasets show that MetaCD outperforms other baselines in both accuracy and generalization. 1 Introduction Cognitive diagnosis is a crucial educational measurement model in intelligent education, which aims to explore students’ cognitive processes in problem-solving through their measurement data [ 16 ] . In general, the cognitive diagnosis system can assesses students’ mastery of various skills by modeling cognitive processing. And it can provide timely feedback on students’ weak skills [ 2 ] . Unfortunately, with the explosive growth of educational data, traditional cognitive diagnostic models (such as IRT [ 6 ] and DINA [ 5 ] ) cannot mine the potential nonlinear interactive relationships between students and questions [ 9 , 17 ] , which limits models’ comprehensive understanding of students’ cognitive processes. In order to address these limitations, recent efforts has begun exploring cognitive diagnosis models based on deep learning, such as neural network-based cognitive diagnosis (NCD) [ 18 ] , self-supervised graph neural network-based cognitive diagnosis (SCD) [ 19 ] , etc. These approaches can mine the deep non-linear interaction between students-questions-skills. However, applying existing cognitive diagnostic methods to online learning systems still faces numerous challenges: (a) some questions receive very few responses from students, while others receive many, resulting in sparse data and subsequently leading to long-tailed problems [ 21 ] . (b) student data in online learning systems typically exhibit two dynamic changes: (1) students learn new skills over time, and their mastery of previously learned skills changes; (2) new learning tasks appear in the system can lead to changes in the data. Existing methods, designed for fixed datasets [ 18 , 8 , 15 , 12 ] , struggle to adapt to these dynamic conditions. They typically exhibit significant performance degradation on new, emerging data patterns due to an inability to integrate new knowledge effectively. Furthermore, they are highly susceptible to catastrophic forgetting, whereby learning new information causes a rapid and severe loss of previously acquired knowledge. In order to solve the above problems, we proposed a meta learning framework for cognitive diagnosis based on continual learning, called MetaCD. Our approach focuses more on considering the model’s plasticity and stability in adapting to the long-tailed distribution, and dynamic changes in the data and new tasks. Our key contributions are summarized as follows: (1) . We empower the knowledge base module through meta-learning methods to ensure that the model can alleviate the problem of long-tailed distribution through few data, achieving the reliability and robustness of MetaCD on sparse data. (2) . We use parameter protection mechanism (PPM) to ensure the stability and plasticity of the model, enabling MetaCD to adapt to the dynamic changes of data and achieve its continual learning ability. (3) . We use a knowledge extraction method based on Kullback-Leibler divergence to avoid fuzzy boundaries of diagnostic results, thereby improving the classification accuracy of the model. (4) . We conduct comprehensive experiments on five real-world datasets to validate the performance of MetaCD, particularly on long-tailed data and task incremental learning. 2 Our Proposed MetaCD Method Figure 1 : The overall structure of MetaCD. 2.1 Task Overview Suppose that we are given n training task units set T_{r}=\{t_{r}^{1},t_{r}^{2},...,t_{r}^{n}\} and a testing task T_{e}=\{S^{test},Q^{test},K^{test},r^{test}\} . The data of each task unit t_{r}^{i} consists of response logs of students, including student IDs S_{i} , question IDs Q_{i} , and skill IDs K_{i} , i\in[1:n] . Each student has a corresponding score s for each question, s\in\{0,1\} (1 indicates that the student answered a question correctly, otherwise 0) and s\in r_{i} , so T_{i}=\{S_{i},Q_{i},K_{i},r_{i}\} . In addition, we need to construct the \mathcal{Q} -matrix 1 1 1 The \mathcal{Q} -matrix differs from Q_{i} . Q_{i} represents the ID of the question answered by the students, while the \mathcal{Q} -matrix shows the binary relationship between questions and skills. [ 18 ] for each task unit based on the questions and their corresponding skills. Problem Definition: Given a set of students’ response data from training task units set T_{r} and \mathcal{Q} -matrix, the purpose of MetaCD is to learn a model that can predict students’ proficiency in skills and their corresponding scores by effectively transferring knowledge across tasks. The ultimate goal is to obtain the best model that can accurately predict students’ performance on the testing task T_{e} . 2.2 The Structure of MetaCD Figure 1 illustrates the overall structure of MetaCD. The training process is as follows: we first initialize the network parameters \theta_{M} and create a copy \theta_{M^{c}} . Then, response data are passed through the embedding module to obtain vectors (\tilde{S}_{ij},\tilde{Q}_{ij},\tilde{K}_{ij},r_{ij}) . MetaCD randomly samples m task units \mathcal{T}=\{\mathcal{T}_{1},\dots,\mathcal{T}_{m}\} 2 2 2 \mathcal{T}_{i}=t_{r}^{i} ; we use \mathcal{T}_{i} here for clarity. from T_{r} , and constructs their corresponding \mathcal{Q} -matrices. Using the support sets, it updates \theta_{M^{c}} to obtain \theta_{M^{c}}^{{}^{\prime}} . Next, the query sets are used to compute gradients from \theta_{M^{c}}^{{}^{\prime}} , which are then used to update \theta_{M} , resulting in \theta_{M}^{*} . This optimized \theta_{M}^{*} is used to initialize MetaCD for the test task T_{e} , and further fine-tuned using its support set. Finally, the model M^{*} is obtained. Given the query set in T_{e} , MetaCD predicts each student’s response (0 or 1). Embedding module: Let A , B , and C denote the numbers of students, questions, and skills, with embedding dimension d set to the number of skills per task. A \mathcal{Q} -matrix [ 13 ] maps questions to skills. Each response is encoded as R_{ij}=(\tilde{S}_{ij},\tilde{Q}_{ij},\tilde{K}_{ij},r_{ij}) , where \tilde{S}_{ij} , \tilde{Q}_{ij} , and \tilde{K}_{ij} are one-hot vectors, and r_{ij} is the score. Trainable embeddings estimate student proficiency, question difficulty, and discrimination. The knowledge base, initialized as \theta_{M} , is updated via task-specific copies \theta_{M^{c}} . Knowledge base module: Figure 1 illustrates the Knowledge Base (KB) module, comprising three components: KB train support, KB train query, and KB test support. The KB module uses meta-learning to accumulate and store experiential knowledge from multiple training task units. The base model f(\theta_{M}) can be any deep model, such as MLP [ 1 ] or CNN [ 14 ] . The KB supports both updates