Temporal Chain of Thought: Long-Video Understanding by Thinking in Frames
Anurag Arnab, Ahmet Iscen, Mathilde Caron, Alireza Fathi, Cordelia Schmid · 2025
Read Temporal Chain of Thought: Long-Video Understanding by Thinking in Frames by Anurag Arnab, Ahmet Iscen, Mathilde Caron, Alireza Fathi, Cordelia Schmid (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-02001.txt.
Description
Anurag Arnab and co-authors teach video models to think in frames in a 2025 paper. Modern vision-language models can swallow about a thousand frames of a long video, yet they still stumble, distracted by irrelevant footage. Their fix lets the model curate its own input before answering a question.
The model scans the video in rounds, picking the frames most relevant to the question, then answers from that shortlist. Spending extra compute at question time on selection paid off across four varied video question sets and three different models. On hour-plus videos, a small curated context beat the same model fed a raw context more than twenty times larger. The work extends test-time scaling ideas from text models to video.
Catalog record
| CREATOR | Anurag Arnab, Ahmet Iscen, Mathilde Caron, Alireza Fathi, Cordelia Schmid |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-02001