PhyDetEx: Detecting and Explaining the Physical Plausibility of T2V Models
Zeqing Wang Keze Wang Lei Zhang · 2025
Read PhyDetEx: Detecting and Explaining the Physical Plausibility of T2V Models by Zeqing Wang Keze Wang Lei Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-01843.txt.
Introduction
Zeqing Wang, Keze Wang, and Lei Zhang test whether text-to-video models obey physics. Video generators have grown in quality, length, and instruction following. Whether they grasp physics is open. Implausible motion can still look smooth at a glance.
Their PhyDetEx tool detects and explains physical plausibility in generated clips. It flags where motion breaks real laws. Explanations state what went wrong in plain terms. Physics-aware scores push generators toward clips that could train robots or teach science without false cues. Explanations name the broken law, like gravity or rigidity, which gives model builders a defect list they can train against next round.
Catalog record
| CREATOR | Zeqing Wang Keze Wang Lei Zhang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-01843
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
PhyDetEx: Detecting and Explaining the Physical Plausibility of T2V Models Zeqing Wang Keze Wang Lei Zhang Abstract Driven by the growing capacity and training scale, Text-to-Video (T2V) generation models have recently achieved substantial progress in video quality, length, and instruction-following capability. However, whether these models can understand physics and generate physically plausible videos remains a question. While Vision-Language Models (VLMs) have been widely used as general-purpose evaluators in various applications, they struggle to identify the physically impossible content from generated videos. To investigate this issue, we construct a PID ( P hysical I mplausibility D etection) dataset, which consists of a test split of 500 manually annotated videos and a train split of 2,588 paired videos, where each implausible video is generated by carefully rewriting the caption of its corresponding real-world video to induce T2V models producing physically implausible content. With the constructed dataset, we introduce a lightweight fine-tuning approach, enabling VLMs to not only detect physically implausible events but also generate textual explanations on the violated physical principles. Taking the fine-tuned VLM as a physical plausibility detector and explainer, namely PhyDetEx , we benchmark a series of state-of-the-art T2V models to assess their adherence to physical laws. Our findings show that although recent T2V models have made notable progress toward generating physically plausible content, understanding and adhering to physical laws remains a challenging issue, especially for open-source models. Our dataset, training code, and checkpoints are available at https://github.com/Zeqing-Wang/PhyDetEx . $\dagger$ $\dagger$ footnotetext: Corresponding author 1 Introduction Recent advances in Text-to-Video (T2V) generation models have significantly improved the visual quality, temporal consistency, etc . , of the generated videos Google DeepMind 2025 ; Wan et al. 2025 ; Kong et al. 2024 ; Kling 2025 ; Ma et al. 2025 ; Yang et al. 2024 . With the rapid scaling of model capacity and multimodal training data, these models are increasingly viewed as promising candidates toward realising a world model Kang et al. 2024 ; Huang et al. 2025 ; Wang et al. 2025a , which can describe the dynamics and causality of the physical world. However, despite impressive progress, existing T2V models often produce physically implausible content that contradicts basic real-world principles Wang et al. 2025b ; Bansal et al. 2024 ; Bansal et al. 2025 . Detecting and explaining these violations is crucial to measure how well current T2V models can understand the physical world. Figure 1 : Illustration of the physical implausibility detection task. Given a video where water is poured into a bottle, but the water level remains static and the cup passes through the bottle, humans can easily identify the violation of physical laws. However, current powerful VLMs (e.g., QwenVL and InternVL) incorrectly judge the motion as physically plausible, highlighting their difficulty in recognising implausible dynamics that are trivial for humans. Several studies attempt to assess the physical plausibility of generated videos using either pre-defined prompts Bansal et al. 2024 ; Bansal et al. 2025 ; Xue et al. 2025 ; Meng et al. 2024 or detectors trained with extensive human annotations Wang et al. 2024 ; Bansal et al. 2024 ; Bansal et al. 2025 . However, the first kind of methods are inherently restricted by their reliance on carefully designed prompts, while the second suffer from poor transferability and limited interpretability, which often produce only coarse plausibility scores without revealing why physical laws are violated. Consequently, these approaches remain narrow in scope and generality, underscoring the need for a more generalizable and interpretable evaluation framework that can handle a wide range of generated videos. A natural approach to evaluate the physical plausibility of the generated videos with an explanation is to leverage Vision-Language Models (VLMs), which have achieved remarkable success across diverse perception and reasoning tasks Comanici et al. 2025 ; Bai et al. 2025a ; Chen et al. 2024c ; Chen et al. 2024b ; Liu et al. 2023 ; Wei et al. 2025 ; Wang et al. 2025d ; Wan et al. 2023 . VLMs are trained on massive visual–text corpora Cui et al. 2024 and possess strong generalization and interpretability through textual reasoning Jiang et al. 2025 ; Zhang et al. 2025a . It is intuitive to use them as general evaluators to identify physically implausible content in videos. However, recent evidence shows that even the most capable VLMs struggle to recognise physically implausible content generated by T2V models Bai et al. 2025b ; Wang et al. 2025b . As shown in Fig. 1 , VLMs often fail to detect implausible content that is easy for humans to perceive. This motivates us to investigate whether we can endow VLMs, which have shown strong capability in many downstream visual tasks, with the ability to detect and explain the physical implausibility in generated videos. To answer the above question, we first conduct a preliminary experiment by prompting several state-of-the-art VLMs to detect the physical pausibility in videos with varying degrees of prior information, without any additional training. We observe that their detection accuracy changes substantially depending on the given priors, suggesting that VLMs may possess certain physical knowledge, yet they struggle to apply this knowledge to unseen implausible cases without proper training. Therefore, we first construct a P hysical I mplausibility D etection ( PID ) dataset, which includes a train split and a test split . The train split consists of 2,588 paired videos, where each pair consists of a physically plausible (positive) video and an implausible (negative) counterpart. The implausible videos are generated by carefully rewriting captions to induce T2V models to produce physically impossible videos. The test split consists of 500 videos, including 250 physically implausible videos with manually annotated content of physical violations and 250 physically plausible counterparts. The implausible videos are collected from various T2V models that unintentionally generate abnormal content under normal prompts, while the plausible ones are drawn from both real-world videos and high-quality T2V generations. Using the PID train split, we propose a lightweight fine-tuning approach that requires only minimal computational cost (via LoRA-based parameter-efficient tuning). The resulting model, namely PhyDetEx ( Phy sical Plausibility Det ector and Ex plainer), empowers VLMs to (i) accurately identify physically implausible events and (ii) produce textual explanations of the violated physical principles. Our experiments demonstrate that PhyDetEx achieves significant improvements in detecting physical implausibility, validating that VLMs indeed possess an implicit understanding of physics that can be unlocked with a small number of contrastive examples. Finally, we apply PhyDetEx as an evaluation tool to benchmark the physical plausibility of current T2V models. Our results reveal that while recent closed-source models have made remarkable strides toward generating physically consistent videos, understanding and adhering to physical laws remain a substantial challenge, especially for open-source models. These findings highlight both the progress and the limitations of current T2V systems in genuine world modeling. In summary, our contributions are as follows. First, we introduce PID , a comprehensive benchmark for physical implausibility detection of T2V models, which includes a test split of 500 annotated videos (250 physically plausible and 250 implausible) and a train split of 2,588 plausible/implausible paired videos. Second, we reveal the reasons behind VLMs’ poor performance on physical implausibility based on comprehensive experiments. Third, we propose a lightweight