Bridging Vision Language Models and Symbolic Grounding for Video Question Answering

Haodi Ma, Vyom Pathak, Daisy Zhe Wang · 2025

Read Bridging Vision Language Models and Symbolic Grounding for Video Question Answering by Haodi Ma, Vyom Pathak, Daisy Zhe Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-11862.txt.

Description

Haodi Ma, Vyom Pathak, and Daisy Zhe Wang bolt symbolic scaffolding onto video question answering. This 2025 artificial intelligence paper treats questions about videos. Spatial, temporal, and causal reasoning are all demanded. Today's vision-language models often lean on shallow correlations. Their temporal grounding stays weak. Their reasoning is hard to inspect.

The authors study symbolic scene graphs as a middle signal. Such graphs record objects and their relations in structured form. Their framework, SG-VLM, joins frozen vision-language models with scene graph grounding. Prompting and visual localization do the joining. No retraining is required. Three benchmarks and two model families were tested. Causal and temporal reasoning improved. Gains over the strongest models were modest. The work maps what symbolic grounding can and cannot yet add.

Catalog record

CREATORHaodi Ma, Vyom Pathak, Daisy Zhe Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-11862

Browse the full library · About the Tower of Babel