VideoMultiAgents: A Multi-Agent Framework for Video Question Answering

Noriyuki Kugo, Xiang Li, Zixin Li, Ashish Gupta, Arpandeep Khatua, Nidhish Jain, Chaitanya Patel, Yuta Kyuragi, Yasunori Ishii, Masamoto Tanabiki, Kazuki Kozuka, Ehsan Adeli · 2025

Read VideoMultiAgents: A Multi-Agent Framework for Video Question Answering by Noriyuki Kugo, Xiang Li, Zixin Li, Ashish Gupta, Arpandeep Khatua, Nidhish Jain, Chaitanya Patel, Yuta Kyuragi, Yasunori Ishii, Masamoto Tanabiki, Kazuki Kozuka, Ehsan Adeli (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-20091.txt.

Description

Noriyuki Kugo and co-authors introduce VideoMultiAgents, a 2025 framework that answers questions about videos by splitting the work among specialist AI agents. Watching a video well means joining sight, timing, and language, and single models fed with frame captions often miss how events unfold.

Separate agents handle vision, scene structure, and text, then pool what they find. A question-guided caption step writes descriptions that stress the objects, actions, and changes the question asks about. The system set new best scores on three public test sets for video questions, with the largest gain on a set that probes intent. Code was released for others to build on.

Catalog record

CREATORNoriyuki Kugo, Xiang Li, Zixin Li, Ashish Gupta, Arpandeep Khatua, Nidhish Jain, Chaitanya Patel, Yuta Kyuragi, Yasunori Ishii, Masamoto Tanabiki, Kazuki Kozuka, Ehsan Adeli
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-20091

Browse the full library · About the Tower of Babel