SceneGraphVLM: Dynamic Scene Graph Generation from Video with Vision-Language Models

Vladislav Makarov, Mark Gizetdinov, Dmitry Yudin · 2026

Read SceneGraphVLM: Dynamic Scene Graph Generation from Video with Vision-Language Models by Vladislav Makarov, Mark Gizetdinov, Dmitry Yudin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13667.txt.

Description

Vladislav Makarov, Mark Gizetdinov and Dmitry Yudin offer SceneGraphVLM, a compact approach for image and video scene graph generation, plus small vision-language models. SceneGraphVLM writes graphs in a token-efficient TOON style and trains in two stages. Supervised fine-tuning comes first, then reinforcement learning with hallucination-aware rewards balancing coverage and precision. On PSG, PVSG and Action Genome, it reaches a strong quality-speed trade-off with about one-second latency.

Catalog record

CREATORVladislav Makarov, Mark Gizetdinov, Dmitry Yudin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58057
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.13667

Browse the full library · About the Tower of Babel