Vision Large Language Models Are Good Noise Handlers in Engagement Analysis
Alexander Vedernikov, Puneet Kumar, Haoyu Chen, Tapio Seppänen, Xiaobai Li · 2025
Read Vision Large Language Models Are Good Noise Handlers in Engagement Analysis by Alexander Vedernikov, Puneet Kumar, Haoyu Chen, Tapio Seppänen, Xiaobai Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-14749.txt.
Description
Alexander Vedernikov, Puneet Kumar, and three co-authors use vision-language models to clean up noisy labels in student engagement videos. Judging engagement from video is subjective, so training labels often disagree, and that noise caps how well detectors can learn. The team lets a large vision model do the first pass at quality control.
A questionnaire draws behavioral cues from each clip, and clips are split into high- and low-reliability groups. Training then follows a curriculum: clean clips first, doubtful clips later with softened labels that reflect the doubt. Classic vision models trained this way improve on the raw data. The lesson is that strong models can serve as noise handlers for weaker ones.
Catalog record
| CREATOR | Alexander Vedernikov, Puneet Kumar, Haoyu Chen, Tapio Seppänen, Xiaobai Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-14749