Can LLMs Reason About Attention? Towards Zero-Shot Analysis of Multimodal Classroom Behavior

Nolan Platt, Sehrish Nizamani, Alp Tural, Elif Tural, Saad Nizamani, Andrew Katz, Yoonje Lee, Nada Basit, [6pt] Virginia Tech, Blacksburg, Virginia, USA · 2026

Read Can LLMs Reason About Attention? Towards Zero-Shot Analysis of Multimodal Classroom Behavior by Nolan Platt, Sehrish Nizamani, Alp Tural, Elif Tural, Saad Nizamani, Andrew Katz, Yoonje Lee, Nada Basit, [6pt] Virginia Tech, Blacksburg, Virginia, USA (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-03401.txt.

Description

Platt and colleagues analyze classroom attention without storing identifiable video, using pose and gaze data only. Their single-GPU pipeline extracts skeletons with OpenPose and gaze with Gaze-LLE, deleting frames right after pose extraction and keeping only coordinates, which keeps the system FERPA-compliant. A reasoning model then gives zero-shot behavior analysis per lecture segment, shown through attention heatmaps and summaries.

Catalog record

CREATORNolan Platt, Sehrish Nizamani, Alp Tural, Elif Tural, Saad Nizamani, Andrew Katz, Yoonje Lee, Nada Basit, [6pt] Virginia Tech, Blacksburg, Virginia, USA
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE17127
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.03401

Browse the full library · About the Tower of Babel