Video-of-Thought : Step-by-Step Video Reasoning from Perception to Cognition
Hao Fei, Shengqiong Wu, Wei Ji, Hanwang Zhang, Meishan Zhang, Mong Li Lee, Wynne Hsu · 2025
Read Video-of-Thought : Step-by-Step Video Reasoning from Perception to Cognition by Hao Fei, Shengqiong Wu, Wei Ji, Hanwang Zhang, Meishan Zhang, Mong Li Lee, Wynne Hsu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-03230.txt.
Description
Seven researchers present a way for computers to reason through video step by step, in work first published in 2024. Most video systems still miss fine detail and deep sense in complex clips. The team built a model called MotionEpic that grounds video at the level of single pixels across space and time. It does so by mapping each scene as a graph of objects and their links.
On top of that model sits a reasoning frame called Video-of-Thought. Like chain-of-thought work for text, it splits a hard task into small steps, moving from raw sight to high-level sense. Tests on hard video question sets showed large gains over prior best systems. The authors say this is the first full use of chain-of-thought for video, with room to spread to many more video tasks.
Catalog record
| CREATOR | Hao Fei, Shengqiong Wu, Wei Ji, Hanwang Zhang, Meishan Zhang, Mong Li Lee, Wynne Hsu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-03230