VMDT: Decoding the Trustworthiness of Video Foundation Models
Yujin Potter, Zhun Wang, Nicholas Crispino, Kyle Montgomery, Alexander Xiong, Ethan Y. Chang, Francesco Pinto, Yuqi Chen, Rahul Gupta, Morteza Ziyadi, Christos Christodoulopoulos, Bo Li, Chenguang Wang, Dawn Song · 2025
Read VMDT: Decoding the Trustworthiness of Video Foundation Models by Yujin Potter, Zhun Wang, Nicholas Crispino, Kyle Montgomery, Alexander Xiong, Ethan Y. Chang, Francesco Pinto, Yuqi Chen, Rahul Gupta, Morteza Ziyadi, Christos Christodoulopoulos, Bo Li, Chenguang Wang, Dawn Song (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-05682.txt.
Introduction
Yujin Potter leads a team introducing VMDT, the first broad benchmark for trust in video foundation models. Text and image models have such benchmarks, but video models, which both make and describe video, lacked one. Their platform tests models on safety, hallucination, fairness, privacy, and resistance to attack.
The team ran seven text-to-video and nineteen video-to-text models through the suite. Every open-source video generator failed to recognize harmful requests and often produced harmful clips, with more unfairness than image models show. Among describing models, unfairness and privacy risk grew with size, while safety showed no link to size at all. The authors argue video models need far stronger trust work, and offer VMDT to track it.
Catalog record
| CREATOR | Yujin Potter, Zhun Wang, Nicholas Crispino, Kyle Montgomery, Alexander Xiong, Ethan Y. Chang, Francesco Pinto, Yuqi Chen, Rahul Gupta, Morteza Ziyadi, Christos Christodoulopoulos, Bo Li, Chenguang Wang, Dawn Song |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 274 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-05682