Towards Spatio-Temporal World Scene Graph Generation from Monocular Videos

Rohith Peddi, Saurabh, Shravan Shanmugam, Likhitha Pallapothula, Yu Xiang, Parag Singla, Vibhav Gogate · 2026

Read Towards Spatio-Temporal World Scene Graph Generation from Monocular Videos by Rohith Peddi, Saurabh, Shravan Shanmugam, Likhitha Pallapothula, Yu Xiang, Parag Singla, Vibhav Gogate (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-13185.txt.

Introduction

Rohith Peddi and co-authors move video scene graphs from frame-bound views to a persistent world frame. Older methods drop objects when they leave sight and work only in 2D. Their ActionGenome4D dataset lifts Action Genome videos into 4D scenes with boxes for hidden objects too. The new task asks for a full world graph at each time step. Three methods test unlike biases: a permanence buffer, masked completion, and temporal attention. Strong vision-language baselines are also set for the task.

Catalog record

CREATORRohith Peddi, Saurabh, Shravan Shanmugam, Likhitha Pallapothula, Yu Xiang, Parag Singla, Vibhav Gogate
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE189673
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.13185

Browse the full library · About the Tower of Babel