RAG-KT: Cross-platform Explainable Knowledge Tracing with Multi-view Fusion Retrieval Generation
Zhiyi Duan, Hongyu Yuan, Rui Liu · 2026
Read RAG-KT: Cross-platform Explainable Knowledge Tracing with Multi-view Fusion Retrieval Generation by Zhiyi Duan, Hongyu Yuan, Rui Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10960.txt.
Introduction
Duan, Yuan, and Liu propose RAG-KT, a retrieval-augmented approach to knowledge tracing across platforms. Knowledge tracing infers a student's knowledge state from earlier work to predict later performance. Standard models are tied to platform-specific identifiers and transfer poorly. Language-model methods can be ungrounded or overly tied to one domain. RAG-KT aligns sources through question-group abstractions and retrieves rich, reliable context for each prediction. Tests on three public benchmarks show gains in accuracy and robustness, including cross-platform cases.
Catalog record
| CREATOR | Zhiyi Duan, Hongyu Yuan, Rui Liu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44445 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.10960
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
RAG-KT: Cross-platform Explainable Knowledge Tracing with Multi-view Fusion Retrieval Generation Zhiyi Duan, Hongyu Yuan, Rui Liu Abstract Knowledge Tracing (KT) infers a student’s knowledge state from past interactions to predict future performance. Conventional Deep Learning (DL)-based KT models are typically tied to platform-specific identifiers and latent representations, making them hard to transfer and interpret. Large Language Model (LLM)-based methods can be either ungrounded under prompting or overly domain-dependent under fine-tuning. In addition, most existing KT methods are developed and evaluated under a same-distribution assumption. In real deployments, educational data often arise from heterogeneous platforms with substantial distribution shift, which often degrades generalization. To this end, we propose RAG-KT , a retrieval-augmented paradigm that frames cross-platform KT as reliable context constrained inference with LLMs. It builds a unified multi-source structured context with cross-source alignment via Question Group abstractions and retrieves complementary rich and reliable context for each prediction, enabling grounded prediction and interpretable diagnosis. Experiments on three public KT benchmarks demonstrate consistent gains in accuracy and robustness, including strong performance under cross-platform conditions. 1 Introduction Figure 1: Comparison of KT paradigms. Traditional models struggle with cross-platform shifts, while prompt-based LLMs are prone to hallucinations. RAG-KT overcomes these by leveraging multi-view retrieval to enable reliable, grounded inference. Knowledge Tracing (KT) is a fundamental task in educational data mining that models a student’s knowledge state from historical responses to predict future performance 7 . As a cornerstone of personalized learning, KT has been extensively studied and has made notable progress 29 . Despite these advances, a critical gap remains between common KT research settings and real-world deployment. Conventional Deep Learning (DL)-based KT approaches often rely on closed, pre-defined identifiers, which limits their ability to generalize to unseen questions, new knowledge concepts, or different platforms 4 . Moreover, these models typically encode knowledge states as latent vectors, which hinders interpretability and constrains their usefulness for pedagogical decision-making 8 ; 24 . Recently, Large Language Models (LLMs) have opened new opportunities for improving interpretability and flexibility 2 ; 3 ; 21 ; 13 . With their natural language reasoning capability, LLMs can extend KT beyond numeric prediction to interpretable diagnosis by generating human-readable analytical reports 30 ; 19 . However, directly applying LLMs to KT faces a dilemma. Prompt-based methods are flexible, yet they often lack platform-specific learning signals and can therefore hallucinate or produce generic explanations that are not grounded in an individual’s learning history 17 ; 9 . In contrast, fine-tuning LLMs on interaction data can improve in-domain performance, but it typically strengthens dependence on the source platform’s distribution, sacrifices cross-platform generalization, and incurs high retraining costs whenever the data source changes 19 ; 5 ; 18 . Overall, both DL-based KT and current LLM-based solutions are commonly developed and assessed under a same-distribution assumption. This assumption is largely inherited from the fact that most benchmark datasets and training pipelines are collected under a single-platform setting. In practice, however, educational data are generated across many heterogeneous platforms. Even when these platforms cover similar knowledge concepts, their student populations, interaction patterns, and question representations can still differ substantially, resulting in non-trivial distribution shift. We argue that to handle the complexity of cross-platform data, KT must go beyond the single-distribution assumption. The key challenges lie in two aspects: (i) how to organize cross-platform data and unify heterogeneous information into a single, unified representation, and (ii) how to obtain information-rich and reliable context from it. To this end, we propose RAG-KT, a retrieval-augmented 16 ; 36 knowledge tracing paradigm. As shown in Fig. 1 , our proposed framework addresses the interpretability and cross-platform capability challenges by augmenting LLMs with structured retrieval and external knowledge integration. Specifically, RAG-KT builds a unified heterogeneous graph that integrates interaction signals across platforms. To mitigate identifier inconsistency and enable cross-source alignment, we introduce Question Group nodes as an intermediate abstraction layer that aggregates questions with similar instructional attributes. This design allows structured reasoning even when question IDs are not shared across platforms. Building on this representation, we further design a multi-dimensional retrieval mechanism to collect complementary context for the current prediction step. The retrieved context is then organized into structured, context-grounded prompts that constrain the LLM to produce the final prediction and an interpretable analysis report. Experimental results demonstrate that the retrieval-augmented structured context in RAG-KT consistently improves prediction accuracy and robustness. In summary, our main contributions are as follows: • We propose RAG-KT, the first retrieval-augmented paradigm for applying LLMs to KT, aiming to address the limitations of existing KT methods in interpretability and cross-platform generalizability. • We construct a multi-source heterogeneous knowledge base and design a multi-view fusion retrieval framework to extract task-relevant knowledge, and generate an explainable analysis report via structured reliable-context-based prompting, thereby enhancing LLM performance on KT. • We conduct comprehensive experiments on three widely used datasets, and the results show that RAG-KT achieves superior prediction accuracy, produces interpretable analytical reports, and remains robust under cross-platform scenarios. 2 Related Work 2.1 Structured Knowledge Modeling in KT Early models use binary knowledge states and predefined skill mappings 7 . Subsequent neural models encode interactions as embeddings but lack semantic structure and cross-platform generalization 27 ; 35 . To address this, recent works have introduced knowledge graphs and use GNNs 28 to capture skill dependencies 25 ; 22 . More recently, methods enhance KT by modeling temporal dynamics or phase-wise learning trajectories over evolving graph structures 6 . However, these methods typically assume fixed, well-aligned datasets and do not address the challenges of integrating heterogeneous interactions from multiple platforms. Forcing integration will only affect the quality of relation extraction, which will directly affect prediction accuracy. 2.2 LLM-Enhanced KT Methods Recent studies have explored LLMs to enhance knowledge tracing, aiming to improve interpretability and address cold-start issues 20 . Some approaches directly fine-tune LLMs on student interaction data 19 ; 14 ; 32 . Meanwhile, others use few-shot or zero-shot prompting strategies 17 ; 15 ; 9 . Despite their promise, many existing LLM-based KT methods operate in closed or shallow contexts, lacking structured grounding from educational knowledge. As a result, they may suffer from inconsistency or hallucinations, especially under sparse or out-of-distribution scenarios. In contrast, our RAG-KT framework grounds LLM inference in a structured, heterogeneous knowledge graph and retrieves personalized, multi-dimensional context. This design ensures both interpretability and generalization, especially in low-resource or unseen settings. 3 Methodology Figure 2: The RAG-KT framework, notation like S_{tgt}\textendash K_{tgt} indicates the target student’s performance on the target concept, while S_{sim}\textendash K_{tgt} represents similar students’ aggregated performance on that dimension. QG is a collection of semantically equivalent Q from different data sources. 3.1 Overall Framework The overall framework of RAG-KT is shown in Fig. 2 . It begins by constructing a Multi-source Heterogeneous Knowledge Base \mathcal{B} including Multi-source Knowledge Graph \mathcal{G} and Multi-dimensional Interaction Repository \mathcal{R} , which unify educational data from diverse platforms and align semantically equivalent entities across datasets. On top of this, a Multi-view Fusion Retrieval mechanism is applied to extract relevant contextual information for given inputs. The retrieved information is then formatted into a Structured Reliable-Context-based Prompt, allowing a frozen LLM to perform zero-shot prediction and generate interpretable reliable-context-based reports. Together, these components enable RAG-KT to achieve robust