R 3 -VQA: “Read the Room” by Video Social Reasoning

Lixing Niu 1,3, Jiapeng Li 2,⋆ Xingping Yu 4 Shu Wang 6 Ruining Feng 5 Bo Wu 7 Ping Wei 2 Yisen Wang 1 Lifeng Fan 3 1 School of Intelligence Science and Technology, Peking University 2 College of Artificial Intelligence, Xi’an Jiaotong University 3 State Key Laboratory of General Artificial Intellig · 2025

Read R 3 -VQA: “Read the Room” by Video Social Reasoning by Lixing Niu 1,3, Jiapeng Li 2,⋆ Xingping Yu 4 Shu Wang 6 Ruining Feng 5 Bo Wu 7 Ping Wei 2 Yisen Wang 1 Lifeng Fan 3 1 School of Intelligence Science and Technology, Peking University 2 College of Artificial Intelligence, Xi’an Jiaotong University 3 State Key Laboratory of General Artificial Intellig (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-04147.txt.

Description

Lixing Niu and eight co-authors build a video data set that tests whether AI models can read a room the way people do. Their paper appeared in two thousand twenty-five. Reading a room means guessing what others believe, want, and feel from faint social cues. Past data sets used scenes too simple to match real social life.

Their set holds rich clips of tangled social scenes, marked in fine detail. Notes cover events plus beliefs, intents, desires, and feelings, and the causal chains that link them. Questions come from both human writers and models. Tasks span grasping events, gauging minds, and tracing social causes. Top vision-language models fell well short of human-level steadiness. A prompting trick based on theory of mind helped them do better. The set gives the field a harder, fairer yardstick.

Catalog record

CREATORLixing Niu 1,3, Jiapeng Li 2,⋆ Xingping Yu 4 Shu Wang 6 Ruining Feng 5 Bo Wu 7 Ping Wei 2 Yisen Wang 1 Lifeng Fan 3 1 School of Intelligence Science and Technology, Peking University 2 College of Artificial Intelligence, Xi’an Jiaotong University 3 State Key Laboratory of General Artificial Intellig
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-04147

Browse the full library · About the Tower of Babel