Vision Large Language Models Are Good Noise Handlers in Engagement Analysis

Alexander Vedernikov, Puneet Kumar, Haoyu Chen, Tapio Seppänen, Xiaobai Li · 2025

Read Vision Large Language Models Are Good Noise Handlers in Engagement Analysis by Alexander Vedernikov, Puneet Kumar, Haoyu Chen, Tapio Seppänen, Xiaobai Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-14749.txt.

Description

Alexander Vedernikov, Puneet Kumar, and three co-authors use vision-language models to clean up noisy labels in student engagement videos. Judging engagement from video is subjective, so training labels often disagree, and that noise caps how well detectors can learn. The team lets a large vision model do the first pass at quality control.

A questionnaire draws behavioral cues from each clip, and clips are split into high- and low-reliability groups. Training then follows a curriculum: clean clips first, doubtful clips later with softened labels that reflect the doubt. Classic vision models trained this way improve on the raw data. The lesson is that strong models can serve as noise handlers for weaker ones.

Catalog record

CREATORAlexander Vedernikov, Puneet Kumar, Haoyu Chen, Tapio Seppänen, Xiaobai Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-14749

Browse the full library · About the Tower of Babel