UDVideoQA : A Traffic Video Question Answering Dataset for Multi-Object Spatio-Temporal Reasoning in Urban Dynamics

Joseph Raj Vishal, Nagasiri Poluri, Katha Naik, Rutuja Patil, Kashyap Hegde Kota, Prithvi Jai Ramesh, Mohammad Farhadi, Yezhou Yang, Bharatesh Chakravarthi · 2026

Read UDVideoQA : A Traffic Video Question Answering Dataset for Multi-Object Spatio-Temporal Reasoning in Urban Dynamics by Joseph Raj Vishal, Nagasiri Poluri, Katha Naik, Rutuja Patil, Kashyap Hegde Kota, Prithvi Jai Ramesh, Mohammad Farhadi, Yezhou Yang, Bharatesh Chakravarthi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-21137.txt.

Description

Urban traffic scenes challenge video-language models with unscripted multi-agent dynamics. Joseph Raj Vishal and nine co-authors introduce a benchmark for that challenge in this 2026 arXiv paper. UDVideoQA is built from sixteen hours of traffic footage at city intersections under varied traffic, weather, and light. An event-driven blur technique protects privacy without degrading scene fidelity.

Twenty-eight thousand question-answer pairs span eight hours of densely annotated video, about one question per second, across a hierarchy from basic understanding to counterfactual inference. Tests on ten leading video models expose a perception-reasoning gap: strong abstract reasoners still fail basic visual grounding. Fine-tuning a smaller model on the dataset closes much of that gap.

Catalog record

CREATORJoseph Raj Vishal, Nagasiri Poluri, Katha Naik, Rutuja Patil, Kashyap Hegde Kota, Prithvi Jai Ramesh, Mohammad Farhadi, Yezhou Yang, Bharatesh Chakravarthi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE105 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-21137

Browse the full library · About the Tower of Babel