CAViAR: Critic-Augmented Video Agentic Reasoning

Sachit Menon 1,2 Ahmet Iscen 1 Arsha Nagrani 1 Tobias Weyand 1 Carl Vondrick 2 Cordelia Schmid 1 1 Google DeepMind 2 Columbia University · 2025

Read CAViAR: Critic-Augmented Video Agentic Reasoning by Sachit Menon 1,2 Ahmet Iscen 1 Arsha Nagrani 1 Tobias Weyand 1 Carl Vondrick 2 Cordelia Schmid 1 1 Google DeepMind 2 Columbia University (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-07680.txt.

Description

Sachit Menon and 5 co-authors build CAViAR in 2025, an agent system for reasoning about long videos. Video models keep improving at perceiving short clips, but benchmarks such as LVBench, Neptune, and ActivityNet-RTL show performance drops as questions grow complex and videos grow long. The authors ask whether existing perception skills can be composed, by an agent, into genuine reasoning.

A large language model agent calls video modules as tools and decides each next step from the results, rather than following a fixed script like earlier visual programming systems. A critic, inspired by textual reasoning work, learns to tell successful action sequences from unsuccessful ones. Agent plus critic achieve strong performance on the named benchmarks. The design suggests long-video understanding may advance by orchestrating tools, not only by scaling perception models.

Catalog record

CREATORSachit Menon 1,2 Ahmet Iscen 1 Arsha Nagrani 1 Tobias Weyand 1 Carl Vondrick 2 Cordelia Schmid 1 1 Google DeepMind 2 Columbia University
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-07680

Browse the full library · About the Tower of Babel