MMVIAD: Multi-view Multi-task Video Understanding for Industrial Anomaly Detection
Xiran Zhao, Jing Jin, Yan Bai, Zhongan Wang, Yifeng Sun, [0.ex] Yihang Lou, Xuanyu Zhu, Tao Feng, Yingna Wu · 2026
Read MMVIAD: Multi-view Multi-task Video Understanding for Industrial Anomaly Detection by Xiran Zhao, Jing Jin, Yan Bai, Zhongan Wang, Yifeng Sun, [0.ex] Yihang Lou, Xuanyu Zhu, Tao Feng, Yingna Wu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10833.txt.
Introduction
Zhao and eight colleagues introduce MMVIAD, the first continuous multi-view video set for industrial anomaly detection. It holds object-centred two-second inspection clips with about 120 degrees of camera motion. It covers 48 object types, 14 settings and 6 anomaly types. It supports four tasks, from detection to defect classification. Current video models still fall far short of human skill here, and the team's two-stage training lifts its VISTA model from 45 point 0 to 57 point 5 on unseen data.
Catalog record
| CREATOR | Xiran Zhao, Jing Jin, Yan Bai, Zhongan Wang, Yifeng Sun, [0.ex] Yihang Lou, Xuanyu Zhu, Tao Feng, Yingna Wu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52348 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.10833
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MMVIAD: Multi-view Multi-task Video Understanding for Industrial Anomaly Detection Xiran Zhao, Jing Jin, Yan Bai, Zhongan Wang, Yifeng Sun, [0.ex] Yihang Lou, Xuanyu Zhu, Tao Feng, Yingna Wu Abstract Industrial anomaly detection is critical for manufacturing quality control, yet existing datasets mainly focus on static images or sparse views, which do not fully reflect continuous inspection processes in real industrial scenarios. We introduce MMVIAD (Multi-view Multi-task Video Industrial Anomaly Detection), to the best of our knowledge the first continuous multi-view video dataset for industrial anomaly detection and understanding, together with a benchmark for multi-task evaluation. MMVIAD contains object-centric 2-second inspection clips with approximately 120 degrees of camera motion, covering 48 object categories, 14 environments, and 6 structural anomaly types. It supports anomaly detection, defect classification, object classification, and anomaly visible-time localization. Systematic evaluations on MMVIAD show that current commercial and open-source video MLLMs remain far below human performance, especially for fine-grained defect recognition and temporal grounding. To improve transferable anomaly understanding, we further develop a two-stage post-training pipeline where PS-SFT (Perception-Structured Supervised Fine-Tuning) initializes perception-structured reasoning and VISTA-GRPO (Visibility-grounded Industrial Structured Temporal Anomaly Group Relative Policy Optimization) refines the model with semantic-gated defect reward and visibility-aware temporal reward, producing the final model VISTA . On MMVIAD-Unseen, VISTA improves the base model’s average score across the four tasks from 45.0 to 57.5, surpassing GPT-5.4. Source code is available at https://github.com/Georgekeepmoving/MMVIAD . 1 Introduction Industrial visual inspection is rarely limited to a single static view 6 ; 36 ; 44 . In practical inspection, a camera may move around a part, or the part may rotate on a fixture, so that different surfaces are observed over a short video. For structural defects such as cracks, holes, bulges, broken regions, scratches, and concavities, the diagnostic evidence is often viewpoint-dependent: a defect can be invisible from one view, weakly visible from another, and clearly diagnosable only during a short interval of the inspection trajectory 6 ; 36 ; 44 . Figure 1 illustrates this shift from single-view and sparse multi-view anomaly detection to continuous multi-view video anomaly detection, where models must not only recognize anomaly existence, defect type, and object category, but also identify when the video provides visual evidence for the defect 33 ; 21 ; 37 . Existing industrial anomaly benchmarks cover important parts of this problem but do not directly evaluate this continuous multi-view visibility setting, as contrasted in Figure 1 . MVTec AD and VisA established static image-level and pixel-level evaluation 6 ; 47 . MVTec 3D-AD, PAD, Real-IAD, and RAD extend inspection to 3D sensing, pose variation, or sparse multi-view observations 7 ; 45 ; 36 ; 44 . Recent video datasets such as Phys-AD further introduce temporal industrial anomaly scenarios 24 . However, these datasets generally do not provide continuous multi-view inspection videos with annotations of when viewpoint-dependent structural evidence becomes visible. As a result, a model may predict the correct label while remaining ungrounded in the diagnostic video interval. Figure 1: Comparison of anomaly detection paradigms. From single-view and sparse multi-view detection to continuous multi-view video anomaly detection. To address this gap, we introduce MMVIAD (Multi-view Multi-task Video Industrial Anomaly Detection), a visibility-grounded video dataset and benchmark for continuous multi-view, multi-task industrial anomaly understanding. To the best of our knowledge, MMVIAD is the first continuous multi-view video dataset for industrial anomaly detection. MMVIAD is built from controllable object-centric rendering trajectories, where each 2-second clip covers approximately 120 degrees of viewpoint change 25 ; 45 . We use controllable rendering because accurate visible-time annotation requires aligned viewpoints and verifiable defect visibility, which are difficult to obtain reliably from real inspection videos. The dataset contains over four thousand inspection clips across 48 object categories, 14 environments, and 6 structural anomaly types. For each anomalous object, we generate two aligned videos under identical rendering conditions: an anomaly-unmarked video that renders the anomalous object without additional visual cues, and an anomaly-marked video where the defective region is highlighted in red for visibility annotation. By comparing the aligned videos and manually verifying the candidate intervals, MMVIAD obtains visible-time annotations for four coupled QA-style tasks: anomaly detection, defect classification, object classification, and anomaly visible-time localization. These four tasks are deliberately coupled. Defect classification is meaningful only after anomaly detection is correct; object identity provides geometric and semantic context for interpreting the defect; visible-time localization asks the model to bind the predicted defect to the temporal interval where its evidence appears. MMVIAD therefore evaluates whether a video MLLM can connect object-level perception, defect semantics, and temporal grounding, rather than solve four independent classification problems. To provide a reference training baseline for this setting, we further study a two-stage structured post-training pipeline. The first stage, PS-SFT (Perception-Structured Supervised Fine-Tuning), follows multimodal instruction tuning to teach the model to separate whole-clip perception from localized temporal evidence 28 ; 10 . The second stage, VISTA-GRPO (Visibility-grounded Industrial Structured Temporal Anomaly Group Relative Policy Optimization), refines the model with task-aware rewards inspired by recent rule-based reinforcement learning, including a semantic gate for defect classification and a visibility-aware reward for temporal localization 16 ; 13 ; 37 . The resulting model VISTA serves as our reference post-training baseline. We evaluate humans, commercial video MLLMs, and open-source video MLLMs under two MMVIAD protocols 4 ; 13 ; 37 ; 26 ; 39 . MMVIAD-Standard measures overall performance when train and test clips cover the same object categories, while MMVIAD-Unseen tests whether training transfers to unseen object categories. The results show a persistent gap between current models and human annotators, especially on fine-grained defect classification and anomaly visible-time localization. On MMVIAD-Unseen, VISTA improves the Qwen3-VL-8B base model from 45.0 to 57.5 average score, with the largest gains in anomaly detection, temporal localization, and object classification. These results suggest that MMVIAD exposes a failure mode of current video MLLMs: they can often recognize coarse object or anomaly cues, but still struggle to bind defect semantics to the viewpoint interval where the evidence is available.We summarize our contributions as follows: • Dataset and benchmark. We introduce MMVIAD, to the best of our knowledge the first continuous multi-view video dataset for industrial anomaly detection, with QA-based tasks and visible-time annotations for viewpoint-dependent structural defects. • Diagnostic evaluation. We evaluate human annotators, commercial models, and open-source video MLLMs on MMVIAD-Standard and MMVIAD-Unseen, showing that defect semantics and visible-time grounding remain key bottlenecks. • Reference post-training. We propose VISTA, a two-stage post-training baseline that combines PS-SFT initialization with VISTA-GRPO reward-based refinement to improve generalization on MMVIAD-Unseen. 2 Related Work Industrial Anomaly Detection. Industrial anomaly detection has been shaped by static-image and sparse-view benchmarks. MVTec AD, MPDD, and VisA established image-level and pixel-level evaluation 6 ; 19 ; 47 , while MVTec 3D-AD, PAD, Real-IAD, and RAD extended the setting toward 3D sensing, pose variation, and multi-view observation 7 ; 45 ; 36 ; 44 . Recent video datasets such as Phys-AD further extend industrial anomaly detection to video scenarios 24 . In parallel, methods such as PaDiM, CutPaste, DRAEM, Reverse Distillation, PatchCore, and EfficientAD advanced distribution modeling, self-supervised reconstruction, memory-bank, and distillation-based anomaly detection 11 ; 22 ; 40 ; 12 ; 34 ; 5 . Recent work further connects industrial inspection with multimodal large models