Towards Spatio-Temporal World Scene Graph Generation from Monocular Videos
Rohith Peddi, Saurabh, Shravan Shanmugam, Likhitha Pallapothula, Yu Xiang, Parag Singla, Vibhav Gogate · 2026
Read Towards Spatio-Temporal World Scene Graph Generation from Monocular Videos by Rohith Peddi, Saurabh, Shravan Shanmugam, Likhitha Pallapothula, Yu Xiang, Parag Singla, Vibhav Gogate (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-13185.txt.
Introduction
Rohith Peddi and co-authors move video scene graphs from frame-bound views to a persistent world frame. Older methods drop objects when they leave sight and work only in 2D. Their ActionGenome4D dataset lifts Action Genome videos into 4D scenes with boxes for hidden objects too. The new task asks for a full world graph at each time step. Three methods test unlike biases: a permanence buffer, masked completion, and temporal attention. Strong vision-language baselines are also set for the task.
Catalog record
| CREATOR | Rohith Peddi, Saurabh, Shravan Shanmugam, Likhitha Pallapothula, Yu Xiang, Parag Singla, Vibhav Gogate |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 189673 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.13185