How Good Are Large Language Models for Course Recommendation in MOOCs?
Boxuan Ma Md Akib Zabed Khan Tianyuan Yang, Agoritsa Polyzou Shin’ichi Konomi · 2025
Read How Good Are Large Language Models for Course Recommendation in MOOCs? by Boxuan Ma Md Akib Zabed Khan Tianyuan Yang, Agoritsa Polyzou Shin’ichi Konomi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-08208.txt.
Introduction
Boxuan Ma and co-authors test how well large language models recommend online courses, in work from 2025. Course platforms hold thousands of options, and learners need guidance that fits their goals. Language models bring broad knowledge that classic recommenders lack.
Approaches ranged from plain prompting to full fine-tuning of the models. A real course platform data set supplied the test bed. Scores covered accuracy, diversity, and novelty of the picks. Language models matched classic recommenders on headline accuracy in the tests. Their edge lies in explaining picks and handling new learners. The study charts where language models help course platforms most.
Catalog record
| CREATOR | Boxuan Ma Md Akib Zabed Khan Tianyuan Yang, Agoritsa Polyzou Shin’ichi Konomi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-08208
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
How Good Are Large Language Models for Course Recommendation in MOOCs? Boxuan Ma Md Akib Zabed Khan Tianyuan Yang, Agoritsa Polyzou Shin’ichi Konomi Abstract Large Language Models (LLMs) have made significant strides in natural language processing and are increasingly being integrated into recommendation systems. However, their potential in educational recommendation systems has yet to be fully explored. This paper investigates the use of LLMs as a general-purpose recommendation model, leveraging their vast knowledge derived from large-scale corpora for course recommendation tasks. We explore a variety of approaches, ranging from prompt-based methods to more advanced fine-tuning techniques, and compare their performance against traditional recommendation models. Extensive experiments were conducted on a real-world MOOC dataset, evaluating using LLMs as course recommendation systems across key dimensions such as accuracy, diversity, and novelty. Our results demonstrate that LLMs can achieve good performance comparable to traditional models, highlighting their potential to enhance educational recommendation systems. These findings pave the way for further exploration and development of LLM-based approaches in the context of educational recommendations. keywords Course Recommendation, Large Language Models, Recommendation System 1 Introduction Course recommendation systems are increasingly used in the field of education and have become an essential tool in addressing information overload and enhancing user experience for learning [ 21 ] . These systems can offer personalized course suggestions that align with a student’s interests, career goals, or skill development needs. This personalized approach can make learning environments more adaptive and effective, enhancing the educational experience by helping students navigate the vast array of available courses and make more informed decisions about their learning journey [ 11 ] . Over the past decade, significant advancements have been made in course recommendation technologies, particularly with the rise of deep learning and large-scale data-driven models [ 22 ] . Traditional recommendation models, including collaborative filtering and content-based methods, have long been employed in practical settings. These approaches typically rely on user-item interaction data or explicit features to provide personalized recommendations [ 20 ] . While successful, traditional recommendation models face notable limitations, such as a lack of generalization and the need for task-specific data for training. On the other hand, deep learning models have demonstrated considerable potential in enhancing prediction accuracy, but they require extensive training and often suffer from a lack of explainability, making them less transparent to users [ 4 ] . In recent years, Large Language Models (LLMs), such as ChatGPT, have gained significant attention due to their great performance in a variety of natural language processing tasks, including text generation, question answering, and language comprehension [ 23 ] . These models, with their adaptability and vast knowledge derived from large-scale corpora, present an appealing opportunity for recommendation systems. Previous research has indicated LLMs can be directly used as recommendation systems with prompts, and a growing body of research has begun to explore the potential of LLMs in recommendation tasks [ 5 ] . Several studies have explored the potential of LLMs as zero-shot recommendation systems, evaluating their performance across various recommendation scenarios and datasets from different domains [ 5 , 4 , 16 ] . Their results show that LLMs are capable of adapting to different recommendation scenarios and improving system performance without the need for task-specific training data. On the other hand, many researchers have started using LLMs as part of recommendation systems to enhance their performance, such as through feature extraction, feature augmentation, or knowledge representation. In the educational domain, Yang et al. use LLMs to generate knowledge concepts from course descriptions [ 40 ] and provide course recommendations based on LLM-generated concepts [ 35 ] . Despite the rapid development of LLMs, most research on LLM-based recommendation systems has focused on domains like music, movies, and books. There has been limited research on applying LLMs specifically to course recommendations within the context of Massive Open Online Courses (MOOCs), and whether LLMs can perform well on course recommendation tasks remains an open question. Therefore, this paper aims to bridge this gap by exploring the potential of LLMs for course recommendation in MOOCs. We evaluate the effectiveness of LLMs in recommending courses based on user learning history. Our study offers a comparative analysis between LLMs and traditional recommendation models and investigates the promise of LLMs in addressing key challenges in educational recommendation systems. Figure 1: Workflow of utilizing LLMs to perform course recommendation tasks. 2 Related Work 2.1 Course Recommendation Recommending courses to students is a critical yet challenging task, as their course choices can influence future learning paths, skill development, and career decisions [ 20 ] . The rise of Massive Open Online Courses (MOOCs) and the increasing number of students have led to the widespread application of course recommendation systems. Since the introduction of the first course recommendation system based on constraint satisfaction [ 27 ] , various methods have been developed. Content-based approaches recommend courses by matching students’ interests with course descriptions and content [ 12 , 24 , 25 , 26 ] . Matrix Factorization (MF) techniques have also been applied to course recommendation, particularly for predicting future course selections based on students’ past courses and grades [ 7 , 34 ] . Other methods have explored the mining of historical course enrollment data to uncover relationships and patterns. For example, [ 1 ] employed association rule mining combined with clustering to identify course relationships, recommending courses based on historical enrollment patterns. Similarly, [ 2 ] used association rules with user ratings to enhance the recommendation results, while [ 30 ] introduced Scholars Walk, which captures sequential course relationships through a random-walk approach. As deep learning techniques have gained popularity, they have also been applied to course recommendation systems [ 10 , 42 , 29 , 28 , 11 ] . For instance, [ 29 ] modified the skip-gram model to generate course vectors from historical course enrollment data, which are then used to recommend courses similar to a student’s previously favored courses. In a similar vein, [ 28 ] proposed the course2vec model, which employs a neural network to generate course recommendations by taking multiple courses as input and predicting a probability distribution over potential course selections. While traditional models have significantly advanced recommendation performance, they often suffer from requiring extensive training. In addition, their black-box nature often complicates model interpretability [ 19 , 18 ] . 2.2 LLMs for Recommendation Large Language Models (LLMs) have demonstrated their adaptability and significant improvements in a wide range of natural language processing (NLP) tasks by leveraging the extensive knowledge from large-scale corpora. Inspired by its successes, there has been a growing interest in applying LLMs to recommendation systems. A number of recent works have leveraged prompt-based techniques to transform recommendation tasks into natural language tasks, utilizing LLMs without task-specific fine-tuning. For instance, LMRecSys [ 44 ] and P5 (Pretrain, Personalized Prompt, and Predict Paradigm) [ 9 ] focus on converting recommendation tasks into multi-token cloze tasks using prompts to tackle zero-shot and data efficiency issues. GPT4Rec [ 15 ] and M6-Rec [ 3 ] utilize LLMs to learn both item and user embeddings. Liu et al. [ 16 ] evaluated ChatGPT’s performance on five recommendation scenarios, including rating prediction, sequential recommendation, direct recommendation, explanation generation, and