Next Token Knowledge Tracing: Exploiting Pretrained LLM Representations to Decode Student Behaviour.
Max Norris, Kobi Gal, Sahan Bulathwela · 2025
Read Next Token Knowledge Tracing: Exploiting Pretrained LLM Representations to Decode Student Behaviour. by Max Norris, Kobi Gal, Sahan Bulathwela (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-02599.txt.
Description
Max Norris, Kobi Gal, and Sahan Bulathwela predict what a student will do next by treating their learning history as a sentence to complete. Knowledge tracing asks how well a student knows each skill, given their past answers, to personalise teaching. Standard models consume correctness, skill tags, and timestamps but throw away the actual text of the questions. That text carries real pedagogical information about what is being asked and how hard it is.
Their method rewrites both the student's history and the question content as text sequences. It lets a pretrained large language model, with all its reading ability, forecast the next response as next-token prediction. Experiments showed notable gains over leading neural knowledge tracing models. Generalisation was notably better to questions and students the system had never seen, the cold-start cases where tutoring systems are usually weakest.
Catalog record
| CREATOR | Max Norris, Kobi Gal, Sahan Bulathwela |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-02599