YouLeQD: Decoding the Cognitive Complexity of Questions and Engagement in Online Educational Videos from Learners’ Perspectives

Anonymous Submission, Nong Ming, Sachin Sharma, Jiho Noh · 2025

Read YouLeQD: Decoding the Cognitive Complexity of Questions and Engagement in Online Educational Videos from Learners’ Perspectives by Anonymous Submission, Nong Ming, Sachin Sharma, Jiho Noh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-11712.txt.

Introduction

Nong Ming, Sachin Sharma, and Jiho Noh study learners' questions in online videos in a paper from two thousand twenty-five. Questions help teachers gauge understanding and spur critical thinking. With AI tools entering education, knowing how learners ask questions is a base for building good systems.

The team built a data set of questions that learners posted in YouTube lecture comments. Each question was tagged by cognitive level using Bloom's taxonomy, a classic scale of thinking skills. They also trained two classifier models to detect questions and grade their complexity. Findings link question complexity to interaction metrics on the videos. The data set and models may help design AI tools that support learning.

Catalog record

CREATORAnonymous Submission, Nong Ming, Sachin Sharma, Jiho Noh
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-11712

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

YouLeQD: Decoding the Cognitive Complexity of Questions and Engagement in Online Educational Videos from Learners’ Perspectives Anonymous Submission, Nong Ming, Sachin Sharma, Jiho Noh Abstract Questioning is a fundamental aspect of education, as it helps assess students’ understanding, promotes critical thinking, and encourages active engagement. With the rise of artificial intelligence in education, there is a growing interest in developing intelligent systems that can automatically generate and answer questions and facilitate interactions in both virtual and in-person education settings. However, to develop effective AI models for education, it is essential to have a fundamental understanding of questioning. In this study, we created the YouTube Learners’ Questions on Bloom’s Taxonomy Dataset (YouLeQD), which contains learner-posed questions from YouTube lecture video comments. Along with the dataset, we developed two RoBERTa-based classification models leveraging Large Language Models to detect questions and analyze their cognitive complexity using Bloom’s Taxonomy. This dataset and our findings provide valuable insights into the cognitive complexity of learner-posed questions in educational videos and their relationship with interaction metrics. This can aid in the development of more effective AI models for education and improve the overall learning experience for students. I Introduction Questioning is a fundamental aspect of education, as it plays a crucial role in learning. Instructors use questions to assess students’ understanding, promote critical thinking, and encourage active engagement in the classroom. An effective question can initiate a thought-provoking discussion, stimulate curiosity, and enhance comprehension among peer students, resulting in improved learning performance in educational settings [ 1 , 2 , 3 ] . In recent years, there has been a growing interest in developing generative artificial intelligence (GenAI) models and conversational agents for educational purposes. These models aim to provide personalized learning experiences [ 4 ] , answer students’ questions [ 5 ] , and facilitate interactions between students and instructors [ 6 ] . In the pursuit of creating intelligent systems for education, it is essential to have a comprehensive understanding of the questioning practice. In the field of education, the study of questioning has been an active research topic for a long time. Various studies have examined the types of questions posed by students and instructors, the cognitive complexity of these questions [ 7 , 8 ] , and the impact of questioning strategies on learning outcomes [ 9 ] . A diverse range of questioning strategies have been devised, incorporating instructional designs such as Gagne’s nine events of instruction [ 10 ] , Kolb’s experiential learning [ 11 ] , and Merrill’s first principles of instruction [ 12 ] . Furthermore, researchers have developed question-answering systems, chatbots, and educational tools to foster student engagement and enhance learning experiences [ 13 , 14 ] . The application of GenAI models in the field of education shows significant potential, particularly in the automated generation of questions for pedagogical purposes. Recently, the development of Large Language Models (LLMs) has significantly strengthened Automatic Question Generation (AQG) capabilities. Studies have shown that LLMs are capable of producing high-quality questions with clear language for various subjects [ 15 ] and generating questions aligned with Bloom’s Taxonomy levels to determine the learner’s cognitive level [ 16 ] . The efficacy of AI-generated questions has been assessed through both manual evaluation by subject matter experts and automated evaluation by other LLMs, as demonstrated in previous research [ 17 , 18 ] . In the field of Artificial Intelligence (AI), however, the applications of questioning strategies often lack a comprehensive grasp of instructional design principles. This can lead to ineffective or even harmful use of AI in educational environments. As such, it is crucial to bridge the gap between AI and instructional design, in order to ensure that AI-driven questioning strategies are thoughtfully crafted and executed to facilitate effective learning outcomes. This research aims to explore the intersection of AI and pedagogical strategies in the context of questioning. By examining questions from online educational videos and their alignment with instructional design principles, we have developed the YouTube Learners’ Question Dataset (YouLeQD) , which consists of transcripts and learner-posed questions extracted from comments of 1,762 lecture videos. Although YouTube is not primarily an educational platform, it has become a popular source of educational content and an interface for learners’ engagement through the comments section. We collected transcripts and comments from lecture videos in five STEM subjects (i.e., biology, computer science, mathematics, chemistry, and physics) and extracted 57,242 questions. We analyzed these questions based on their cognitive levels of learning outcomes using Bloom’s taxonomy. Our study delves further into the relationship between the cognitive levels of questions and the engagement levels of comments. The following questions are the main focus of our study: • RQ1: How do the learner-posed questions in the YouTube educational video comments align with Bloom’s Taxonomy cognitive complexity levels? • RQ2: Is there a relationship between the cognitive levels of questions and the interaction rates, specifically the number of likes and replies to the comments? • RQ3: Are there differences in question type distributions by cognitive complexity across five subjects? The findings of this study will provide valuable insights into the cognitive complexity of learner-posed questions in online educational videos and their relationship with engagement metrics. This research will contribute to the development of effective AI models for education. The main contributions of this study are as follows: 1. We introduce a publicly accessible dataset containing transcripts from YouTube educational videos, along with questions posted by online learners. 2. We propose question detection and classification methods based on Bloom’s Taxonomy levels using fine-tuned RoBERTa models, leveraging large language models in the learning process. 3. We provide an in-depth analysis of the cognitive complexity of learner-posed questions and their relationship with interaction rates. The YouLeQD dataset and code of the classification models are publicly available to support further research in this area 1 1 1 https://github.com/Jiho-YesNLP/QYTL . II Related Work II-A YouTube as a Source of Educational Content YouTube offers a diverse range of educational materials, including highly regarded lecture videos from channels such as YaleCourses and MIT OpenCourseWare . Studies have demonstrated the efficacy of YouTube videos in various educational contexts, such as patient education [ 19 ] , nurse training [ 20 ] , and language learning [ 21 ] . Furthermore, YouTube has been shown to be a valuable tool for educators, as it effectively captures students’ attention and promotes their creativity [ 22 ] . The use of YouTube’s communication features, such as comments and like/dislike buttons, has been examined for its potential implementation in the field of education. Previous studies have shown that YouTube comments can support collaborative knowledge construction and deeper learning in science [ 23 ] , provide insights into how students engage with informational videos for informal learning [ 24 ] , and empower learners to engage in the content through comments [ 25 ] . These works have demonstrated the great potential of YouTube comments for pedagogical purposes. However, they mainly focus on how YouTube videos and comments can enhance learners’ experience and encourage them to engage in the learning process. Only a few studies have explored the potential of YouTube video comments as a valuable source of information [ 26 ] for

Read the complete text