Lecture Video Visual Objects (LVVO) Dataset: A Benchmark for Visual Object Detection in Educational Videos

Dipayan Biswas Shishir Shah Jaspal Subhlok · 2025

Read Lecture Video Visual Objects (LVVO) Dataset: A Benchmark for Visual Object Detection in Educational Videos by Dipayan Biswas Shishir Shah Jaspal Subhlok (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-13657.txt.

Introduction

Dipayan Biswas, Shishir Shah, and Jaspal Subhlok built a data set from 2025 to help computers find visual items in lecture videos. Slides and boards in class videos hold tables, charts, photos, and drawings. A computer that can spot them can help search and sum up the lesson. No good test set for this task had been made public before.

Their set holds four thousand frames drawn from 245 lecture videos in life science, computing, and earth science. Two people marked boxes on one thousand frames, and a third expert settled each case where they disagreed. A partly guided method then marked the rest of the frames. The full set is free for others to use to build and test their own tools.

Catalog record

CREATORDipayan Biswas Shishir Shah Jaspal Subhlok
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE14 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-13657

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Lecture Video Visual Objects (LVVO) Dataset: A Benchmark for Visual Object Detection in Educational Videos Dipayan Biswas Shishir Shah Jaspal Subhlok Abstract We introduce the Lecture Video Visual Objects (LVVO) dataset, a new benchmark for visual object detection in educational video content. The dataset consists of 4,000 frames extracted from 245 lecture videos spanning biology, computer science, and geosciences. A subset of 1,000 frames, referred to as LVVO_1k , has been manually annotated with bounding boxes for four visual categories: Table , Chart-Graph , Photographic-image , and Visual-illustration . Each frame was labeled independently by two annotators, resulting in an inter-annotator F1 score of 83.41%, indicating strong agreement. To ensure high-quality consensus annotations, a third expert reviewed and resolved all cases of disagreement through a conflict resolution process. To expand the dataset, a semi-supervised approach was employed to automatically annotate the remaining 3,000 frames, forming LVVO_3k . The complete dataset offers a valuable resource for developing and evaluating both supervised and semi-supervised methods for visual content detection in educational videos. The LVVO dataset is publicly available to support further research in this domain. 1 Introduction The Lecture Video Visual Objects (LVVO) Dataset is designed as a benchmark for object detection in lecture video frames. It includes bounding box annotations for four visual categories: Table, Chart-Graph, Photographic-Image, and Visual-Illustration. The dataset consists of 4,000 images (video frames) extracted from a diverse collection of lecture videos. Out of these, a randomly selected subset of 1,000 images has been manually annotated by expert annotators, forming the LVVO_1k labeled dataset. Each image was independently annotated by two annotators, with a third expert reviewing and resolving any disagreements to ensure high-quality consensus annotations. The following sections detail the dataset creation process and present key statistics gathered during its development. 2 Dataset Preparation To build our dataset, we collected lecture videos from videopoints.org [ 1 ] . We then extracted 4,000 visually rich and distinct frames, ensuring diversity across multiple instructors and subject areas. 2.1 Lecture Video Collection The lecture videos were sourced from videopoints.org [ 1 ] , a platform hosting screen-captured live lectures, as part of the previous work in [ 2 ] . The collection includes videos from eight different instructors, covering 13 distinct courses, with a total of 245 lecture videos. These lectures span three subject areas: biology, computer science, and geosciences. To ensure the inclusion of the most recent lectures, we selected courses from the latest semesters offered by each instructor. The lectures in the dataset were recorded between 2019 and 2024. 2.2 Unique Frame Extraction We adopted the method from [ 3 ] to identify slide transition points and extract key frames representing distinct slides from the lecture videos. However, we observed duplicate frames, often caused by instructors revisiting previous slides during lectures. To address this, we extended the algorithm to detect and remove duplicate frames within a window of key frames for each video. Additionally, we prioritized filtering out frames that contained only textual content with no significant visual elements. These refinements ensured that the final dataset retained unique video frames with significant visual content, resulting in a finalized set of 4,000 images. Each image file is named using the format: <instructor_id>_<course_id>_<video_id>_<filename> . Table 1 summarizes the distribution of instructors, courses, and extracted frames across the three subject areas. Table 1 : Distribution of Instructors, Courses, and Extracted Video Frames Across Subject Areas Subject # Instructors # Courses Total Frames Count Manually Annotated (LVVO_1k) Biology 3 6 1,932 408 Computer Science 3 4 786 245 Geosciences 2 3 1,282 347 Total 8 13 4,000 1,000 3 Manual Annotation 3.1 Annotation Workflow A randomly selected subset of 1,000 images (referred to as LVVO_1k ) was manually labeled by expert annotators with bounding box annotations for four distinct categories: Table, Chart-Graph, Photographic-Image, and Visual-Illustration. Annotating lecture slides presents unique challenges. They typically consist of artificially designed visual content where visual objects have diverse semantic meanings and weak structural boundaries—unlike well-defined objects in natural images such as chairs, tables, cats, or dogs [ 4 ] . To ensure high-quality and consistent annotations, we engaged graduate students with relevant domain expertise and provided them with unified instructions (see Section 3.2 ). The annotation was carried out using the Microsoft VoTT annotation tool [ 5 ] , which allowed annotators to draw bounding boxes and assign category labels. The process followed three phases: 1. Initial Calibration: All the annotators labeled an initial set of 50 sample frames using the provided instructions. After annotation, a group discussion was conducted to review differences and understand challenges in annotation. Subsequently, the guidelines were modified to reduce ambiguity. 2. Independent Annotation: The remaining frames were divided among the annotators, with each frame independently labeled by two annotators, following the finalized guidelines to ensure cross-verification and consistency. 3. Conflict Resolution: A third expert was involved only in cases where the initial two annotators disagreed. For each such instance, the expert resolved conflicts by selecting the most accurate bounding boxes from one or both annotators, thereby finalizing the annotation. This rigorous annotation process ensures the dataset’s reliability and consistency, making it well-suited for benchmarking object detection models on lecture video frames. 3.2 Annotation Instructions The following instructions were provided to the annotators to ensure consistency and accuracy during the manual labeling process. These guidelines define what qualifies as a visual object, outline the annotation procedure, and specify the categories used for labeling. Annotators followed these instructions while using the VoTT annotation tool [ 5 ] to perform bounding box annotations on the selected video frames. Task: To identify and categorize visual objects in video frames that are meaningful to the video content. Specifically, you will: 1. Identify and draw a bounding box around each visual object. 2. Label each identified visual object with a category selected from the provided list below. What is a Visual Object? For the purpose of this task, a visual object contains an image or multiple images that together represent meaningful semantic content in the video. • Visual objects can be photographic images, charts, tables, or illustrations. A visual object may contain text such as the content of the cells in a table or labels of components in the image. It should not include captions or descriptions that are not directly a part of the image. • Images that are not relevant to the lecture content are not considered visual objects. For example, speaker faces, logos, and other content that is part of the video frame background should not be selected as visual objects. • Your goal is to select coherent and complete visual objects, that we refer as valid objects. In some cases, a larger visual object consisting of nearby valid visual objects may also appear to be a valid visual object. In such situations, it is sufficient to select only the smaller valid visual objects. • The rectangular bounding boxes may overlap, but the visual objects themselves should not. Categories: Assign one of the following category labels to each visual object you identify: • Table: An arrangement of information or data, typically in rows and columns. • Chart-Graph: Graphical representation of data. • Photographic-Image: Pictures that are made using cameras. • Visual-Illustration: Diagrams, flowcharts,

Read the complete text