GHR-VQA: Graph-guided Hierarchical Relational Reasoning for Video Question Answering

Dionysia Danai Brilli, Dimitrios Mallis, Vassilis Pitsikalis, Petros Maragos · 2025

Read GHR-VQA: Graph-guided Hierarchical Relational Reasoning for Video Question Answering by Dionysia Danai Brilli, Dimitrios Mallis, Vassilis Pitsikalis, Petros Maragos (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-20201.txt.

Description

Brilli, Mallis, Pitsikalis, and Maragos answer video questions through human-centered scene graphs. Their 2025 paper presents GHR-VQA for video question answering. Pixel-based methods struggle to reason about interactions. Videos center on humans acting on objects over time. Questions usually probe exactly those relations.

Each frame becomes a scene graph of entities and links. Human nodes across frames connect to one global root. That yields a single video-level graph for reasoning. Graph neural networks turn it into rich embeddings. Question features merge inside a hierarchical network. Different abstraction levels handle local and global clues. Tests used the AGQA dataset of action questions. Object-relation reasoning improved by 7.3 percent over the prior best. The gain beat the previous state of the art clearly. Graph steps can be inspected and explained afterward. Perception and reasoning stay cleanly separated modules.

Catalog record

CREATORDionysia Danai Brilli, Dimitrios Mallis, Vassilis Pitsikalis, Petros Maragos
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-20201

Browse the full library · About the Tower of Babel