VMDT: Decoding the Trustworthiness of Video Foundation Models

Yujin Potter, Zhun Wang, Nicholas Crispino, Kyle Montgomery, Alexander Xiong, Ethan Y. Chang, Francesco Pinto, Yuqi Chen, Rahul Gupta, Morteza Ziyadi, Christos Christodoulopoulos, Bo Li, Chenguang Wang, Dawn Song · 2025

Read VMDT: Decoding the Trustworthiness of Video Foundation Models by Yujin Potter, Zhun Wang, Nicholas Crispino, Kyle Montgomery, Alexander Xiong, Ethan Y. Chang, Francesco Pinto, Yuqi Chen, Rahul Gupta, Morteza Ziyadi, Christos Christodoulopoulos, Bo Li, Chenguang Wang, Dawn Song (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-05682.txt.

Introduction

Yujin Potter leads a team introducing VMDT, the first broad benchmark for trust in video foundation models. Text and image models have such benchmarks, but video models, which both make and describe video, lacked one. Their platform tests models on safety, hallucination, fairness, privacy, and resistance to attack.

The team ran seven text-to-video and nineteen video-to-text models through the suite. Every open-source video generator failed to recognize harmful requests and often produced harmful clips, with more unfairness than image models show. Among describing models, unfairness and privacy risk grew with size, while safety showed no link to size at all. The authors argue video models need far stronger trust work, and offer VMDT to track it.

Catalog record

CREATORYujin Potter, Zhun Wang, Nicholas Crispino, Kyle Montgomery, Alexander Xiong, Ethan Y. Chang, Francesco Pinto, Yuqi Chen, Rahul Gupta, Morteza Ziyadi, Christos Christodoulopoulos, Bo Li, Chenguang Wang, Dawn Song
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE274 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-05682

Browse the full library · About the Tower of Babel