Can LLMs Reason About Attention? Towards Zero-Shot Analysis of Multimodal Classroom Behavior
Nolan Platt, Sehrish Nizamani, Alp Tural, Elif Tural, Saad Nizamani, Andrew Katz, Yoonje Lee, Nada Basit, [6pt] Virginia Tech, Blacksburg, Virginia, USA · 2026
Read Can LLMs Reason About Attention? Towards Zero-Shot Analysis of Multimodal Classroom Behavior by Nolan Platt, Sehrish Nizamani, Alp Tural, Elif Tural, Saad Nizamani, Andrew Katz, Yoonje Lee, Nada Basit, [6pt] Virginia Tech, Blacksburg, Virginia, USA (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-03401.txt.
Description
Platt and colleagues analyze classroom attention without storing identifiable video, using pose and gaze data only. Their single-GPU pipeline extracts skeletons with OpenPose and gaze with Gaze-LLE, deleting frames right after pose extraction and keeping only coordinates, which keeps the system FERPA-compliant. A reasoning model then gives zero-shot behavior analysis per lecture segment, shown through attention heatmaps and summaries.
Catalog record
| CREATOR | Nolan Platt, Sehrish Nizamani, Alp Tural, Elif Tural, Saad Nizamani, Andrew Katz, Yoonje Lee, Nada Basit, [6pt] Virginia Tech, Blacksburg, Virginia, USA |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17127 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.03401