REVEAL: Robust Evolution of Vision-Language Models for Explainable AI-Video Detection

Yun-Yun Tsai, Qingyuan Liu, Ruijian Zha, Victoria Li, Pengyuan Shi, Chengzhi Mao, Junfeng YangColumbia University · 2025

Read REVEAL: Robust Evolution of Vision-Language Models for Explainable AI-Video Detection by Yun-Yun Tsai, Qingyuan Liu, Ruijian Zha, Victoria Li, Pengyuan Shi, Chengzhi Mao, Junfeng YangColumbia University (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-14994.txt.

Introduction

Yun-Yun Tsai and co-authors present REVEAL, a vision language framework for spotting AI generated video in a 2025 paper, based on the head byline. Fake video tools evolve fast, and detectors trained on fixed data sets fail on new tricks. Their approach lets a vision language model reason about video content and call external tools to hunt for subtle inconsistencies, much like slow human checking.

The model picks and combines tools on its own as it learns, which aids generalization and keeps decisions interpretable. A new benchmark holds over a thousand high quality fake videos from eight generators. Scores rose sharply over top baselines for several large models, though open world detection stays unsolved.

Catalog record

CREATORYun-Yun Tsai, Qingyuan Liu, Ruijian Zha, Victoria Li, Pengyuan Shi, Chengzhi Mao, Junfeng YangColumbia University
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-14994

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

REVEAL: Robust Evolution of Vision-Language Models for Explainable AI-Video Detection Yun-Yun Tsai, Qingyuan Liu, Ruijian Zha, Victoria Li, Pengyuan Shi, Chengzhi Mao, Junfeng YangColumbia University Abstract The rapid advancement of AI-generated video poses challenges to digital authenticity and security. Current detection methods, often trained on specific datasets, struggle with the ever-evolving landscape of generative techniques and unseen manipulations. We introduce a framework leveraging Vision Language Models (VLMs) for robust AI-generated video detection. Our approach equips the VLM with the ability to reason about video content and use external tools to identify subtle inconsistencies, mirroring human system 2 thinking. Our self-evolving VLM dynamically selects and composes appropriate tools, enhancing its ability to generalize to novel video generation techniques. The modular design promotes interpretability, allowing for a clearer understanding of VLM’s decision-making process. To evaluate, we establish the first benchmark VidForensic containing 1.4k+ high-quality AI generated videos across eight generative models. Experiments show that REVEAL improves F1 scores by 9.1% to 30.2% over top baselines across our datasets for VLMs, notably for GPT-4o, Gemini 1.5 pro, and QWen-VL-Max, and Llava-One-Vision-7B. While open-world AI-video detection remains an open challenge, our results indicate that existing methods fail primarily because they lack tool-enabled, higher-order reasoning. 1 Introduction Figure 1 : An example of an AI-generated video from Kling [ 25 ] where REVEAL makes a correct prediction with explicit knowledge selection and prompt self-adaptation. REVEAL facilitates VLMs for video detection by calling explicit knowledge tools to extract useful information from the original videos and by providing structure-formatted output. The realm of video creation is undergoing a significant transformation with the advent of video generation tools, such as Stable Video Diffusion [ 4 ] , SORA by OpenAI [ 6 ] , Runway Gen3 [ 40 ] , Pika [ 36 ] , and Show-1 [ 48 ] . These cutting-edge tools are revolutionizing industries, ranging from design and marketing to entertainment and education, by creating high-quality video content. While this pivotal shift is opening up a myriad of possibilities for creators everywhere, it also poses societal dangers, particularly in its widespread use for spreading disinformation, propaganda, scams, and phishing – evidenced by cases such as the Taylor Swift deepfakes [ 32 ] . These potential threats underscore the importance of detecting videos created by these generative models. Prior work often extract artifacts from collected samples and train auxiliary deep neural networks to act as detectors [ 9 ] . However, these supervised learning-based methods face fundamental generalization issues due to the high dimensionality of video data, because collecting exhaustive data in high-dimensional space is impossible. Moreover, the increasingly high quality video generated from current diffusion models [ 43 , 8 ] makes it increasingly harder to detect. Furthermore, even powerful VLMs, despite their strong contextual understanding, struggle to identify key inconsistencies in AI-generated videos when using simple, free-form prompts, highlighting the need for more structured reasoning and targeted information extraction. Figure 2 : We show the main pipeline of REVEAL for video detection. First, VLMs suggest relevant video detection tools. Next, based on the weighted accuracy, F1 , and the self-assessment score, S_{SA} , each tool provides, we assemble a customized toolkit for each video detection VLM. In Fig. 4 , we show details of the self-adaptation of the structured prompt. The prompt tuning will be based on the VLM itself. Component marked with the logo are developed with the VLM-like GPT-4o [ 33 ] . We introduce REVEAL , a self-evolving framework for AI-generated video detection using VLMs. Unlike methods relying solely on direct visual feature extraction, REVEAL empowers the VLM to actively reason about video content and dynamically select and compose a toolkit of external analysis tools (e.g., for motion analysis, artifact detection). As illustrated in Fig. 2 , this process unfolds in two key steps: (1) Self-Evolving Toolkit Selection , where the VLM, acting as a judge, autonomously evaluates and selects the most effective tools based on predefined scoring metrics and historical samples; and (2) Self-Adaptation with Structured Prompting , where the VLM refines the structure of its prompts based on output feedback, enhancing adaptability across diverse datasets. This data-driven, self-evolving approach, guided by structured prompts with a defined class structure, allows REVEAL to automatically learn optimal reasoning strategies and tool combinations, improving interpretability, reducing hallucination, and preventing overfitting through online adaptation of key prompt fields. A key advantage of our method is interpretability, which stems from its modular design and tool-extracted explicit knowledge, revealing the decision-making process. The self-evolving capabilities, using structured prompting and dynamic tool selection, achieve significant robustness and generalizability. REVEAL’s adaptability makes it less vulnerable to overfitting and more capable of handling novel generation techniques, a crucial step towards reliable open-world detection. We highlight our main contributions: • We present a novel method that enables VLMs to perform AI-generated video detection tasks precisely through an automated self-evolving framework, consisting of two main steps: (1) self-evolving to select EK Toolkit; (2) self-adaptation with structured prompt tuning. • Our pipeline is training-free and only requires a lightweight evolving process for updating model preferences of EK selection and adjusting prompt templates. • We create a new benchmark VidForensic, including 1.4k+ high-quality fake videos generated from multiple sources of video generation tools, such as Kling [ 25 ] , Runway Gen3 [ 40 ] , and OpenSORA [ 50 ] . To facilitate future research, we also provide the nine corresponding EKs extracted from each video frame in VidForensic. • Evaluation results show that REVEAL improves F1 scores by 9.1% to 30.2% over the direct prompt baselines on high-quality datasets across four state-of-the-art(SOTA) VLMs: Qwen-VL-Max [ 37 ] , Gemini-1.5-pro [ 17 ] , GPT-4o [ 33 ] , and Llava-OV-7B [ 28 ] . REVEAL also surpasses the conventional supervised learning video detection methods. 2 Related Works AI-Generated Video Detection The success in high-quality machine-generated videos has heightened concerns about security, personal privacy, and digital integrity, emphasizing the need for a robust and generalizable detector capable of distinguishing videos produced by generative models. Recently, Deepfake video, generated by GAN-based models, can perform face manipulation with high realism [ 26 ] . Agarwal et al. [ 26 ] highlighted the challenges of detecting Deepfake video, noting that traditional DNN networks or audio-visual approach based on lip sync inconsistency detection are not robust enough to detect Deepfake. David et al., [ 18 ] proposed to use convolutional neural network (CNN) + Long short-term memory (LSTM) to build Deepfake video detectors. However, these methods did not account for cross-model transferability to state-of-the-art synthetic videos, especially those generated by diffusion-based video models [ 50 , 5 , 25 , 40 , 36 ] , which have the capability to produce high-quality synthetic videos indistinguishable by human. VidProM [ 45 ] and DeMamba [ 13 ] addressed the challenge and created synthetic video datasets containing millions of samples. DIVID [ 31 ] further refined the diffusion reconstruction error (DIRE [ 46 ] ) for diffusion-generated video detection, enhancing detection performance across temporal dimensions. AIGVDet [ 3 ] proposed to use spatio-temporal CNNs to tackle synthetic video detection. DuB3D [ 21 ] developed dual-branch 3D transformers to distinguish between real and synthetic videos. Despite the inspiring in-domain

Read the complete text