EEA: Exploration–Exploitation Agent for Long Video Understanding
Te Yang, Xiangyu Zhu, Bo Wang, Quan Chen, Peng Jiang, Zhen Lei · 2025
Read EEA: Exploration–Exploitation Agent for Long Video Understanding by Te Yang, Xiangyu Zhu, Bo Wang, Quan Chen, Peng Jiang, Zhen Lei (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-03500.txt.
Introduction
Long videos hide key moments in hours of footage. Te Yang and co-authors present an exploration-exploitation agent for that task in this 2025 work. Current methods either preprocess densely at high cost or balance search poorly.
Dense methods waste compute, while weak search misses sparse but critical information. Their agent, EEA, navigates long visual data more efficiently. It balances exploring new segments with exploiting promising ones. Better long video understanding helps surveillance review, sports analysis, and meeting archives. Exploration choices decide coverage, since a fixed scan of long footage wastes most frames.
Catalog record
| CREATOR | Te Yang, Xiangyu Zhu, Bo Wang, Quan Chen, Peng Jiang, Zhen Lei |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-03500
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
EEA: Exploration–Exploitation Agent for Long Video Understanding Te Yang, Xiangyu Zhu, Bo Wang, Quan Chen, Peng Jiang, Zhen Lei Abstract Long-form video understanding requires efficient navigation of extensive visual data to pinpoint sparse yet critical information. Current approaches to long-form video understanding either suffer from severe computational overhead due to dense preprocessing, or fail to effectively balance exploration and exploitation, resulting in incomplete information coverage and inefficiency. In this work, we introduce EEA, a novel video agent framework that archives exploration-exploitation balance through semantic guidance with hierarchical tree search process. EEA autonomously discovers and dynamically updates task-relevant semantic queries, and collects video frames closely matched to these queries as semantic anchors. During the tree search process, instead of uniform expansion, EEA preferentially explores semantically relevant frames while ensuring sufficient coverage within unknown segments. Moreover, EEA adaptively combines intrinsic rewards from vision-language models (VLMs) with semantic priors by explicitly modeling uncertainty to achieve stable and precise evaluation of video segments. Experiments across various long-video benchmarks validate the superior performance and computational efficiency of our proposed method. 1 Introduction Long-form video understanding 58 ; 40 remains a fundamental challenge in computer vision and artificial intelligence, forming the cornerstone of applications that require long-term temporal reasoning over visual contents, such as documentary analysis, sports understanding, and live-stream comprehension. Long videos are often characterized by highly uneven information density and complex event structures 44 ; 59 . Extracting valuable information from such videos requires models to identify relevant information from massive redundancy and handle long-term temporal dependencies 27 ; 52 ; 4 . Figure 1 : Accuracy versus. Computational Cost and Frame Utilization. Our agent achieves higher accuracy with improved efficiency, requiring fewer observed frames and comparable or lower GPU cost on EgoSchema, under both GPT-4o and Qwen2-VL-72B settings. Existing VLM-based methods 45 ; 70 rely on dense frame sampling, resulting in redundant and inefficient representations 53 ; 65 . Meanwhile, agent systems that require costly preprocessing such as dense captioning 29 ; 30 ; 71 ; 34 ; 11 often incurs substantial computational overhead. These challenges call for an agent capable of reasoning selectively and efficiently, acquiring only the most informative frames for decision-making. Recent long video understanding studies have introduced an on-the-fly agent-based paradigm 26 ; 56 , which formulates long-video understanding as a online decision-making process, avoiding costly offline preprocessing. Exploitation based methods 54 ; 66 ; 64 use existing queries as a guide for action, continuously refining the search process through iterative retrieval to ultimately aggregate only the most relevant information required. However, their heavy reliance on exploitation tends to trap the search in local optima, neglecting novel evidence beyond initial queries. Exploration based methods 63 ; 55 , improve long-video reasoning through hierarchical tree search, where the video is recursively partitioned into multiple segments represented as tree nodes. At each search step, a node is uniformly expanded into finer-grained child nodes, and the most promising nodes are selected by comparing their relevance to the user instructions. The key challenge lies in determining how to expand nodes effectively. To ensure efficiency, existing methods typically sample only sparse frames within each node, which serve both as expansion boundaries and as references for deciding subsequent actions. However, under uniform partitioning, this sparse sampling often results in critical information being overlooked. Figure 2 : Comparison of EEA with prior works. Difference-1: Prior methods use no semantic priors. EEA performs dynamic query discovery and query update during exploration, enabling progressively refined guidance over long videos. Difference-2: EEA performs semantic-guided expansion, leveraging semantic queries and anchors to focus on relevant frames. In contrast, previous methods rely on blind uniform sampling, risking the omission of critical events. Difference-3: : Previous methods base exploration decisions solely on a potentially noisy intrinsic reward. EEA enhances more stable evaluation by fusing this reward with a robust query-based score. In this work, we introduce EEA, an E xploration– E xploitation A gent for long-form video understanding motivated by human cognitive processes. When humans attempt to understand an unfamiliar environment, they typically do not explore blindly. Instead, guided by initial hypotheses based on task semantics, they iteratively balance exploration of new information and exploitation of existing knowledge, continuously refining their understanding 8 ; 60 . Inspired by this processes, we propose a novel video agent framework, EEA, that efficiently leverages existing textual information while actively exploring unknown regions, enabling accurate and efficient reasoning over long-form videos. EEA is built upon a hierarchical tree search framework, focusing on three critical steps of the search process: maintaining semantic queries, evaluating nodes for expansion, and strategically expanding nodes into child segments. (1) To make sure that our semantic queries are not static but dynamically updated, we propose Dynamic Query Management(DQM) to continuously discover and enrich additional semantic priors during exploration. By dynamically generating new semantic queries from the visual information of the selected node in each iteration, EEA effectively addresses the insufficiency of semantic priors derived from initial user instructions. (2) To determine which node to expand, we introduce a sophisticated reward mechanism named Uncertainty-Aware Reward Fusion (UARF). This reward adaptively integrates intrinsic signals from the VLM with query scores derived from semantic priors, effectively addressing the insufficient discriminability that arises when relying solely on intrinsic rewards. (3) Instead of uniformly partitioning nodes into child segments, we propose Semantic-Guided Expansion(SGE) by strategically expanding node guided by semantic queries, effectively balancing focused search and broad information coverage. The key differences between EEA and the prior work are illustrated in Fig 2 . Extensive experiments conducted across multiple benchmarks validate that our proposed EEA framework substantially enhances both the effectiveness and efficiency of agents in long-form video reasoning tasks, achieving superior performance compared to baseline approaches. Our contributions can be summarized as fourfold: • We propose EEA, a E xploration– E xploitation agent framework that achieves an effective balance between exploring new information and leveraging known semantics for efficient long-form video reasoning. • EEA employs a novel Semantic Guided Expansion approach in hierarchical tree search process that effectively balances targeted search with broad coverage, significantly improving long-form video understanding. • EEA designs an Uncertainty-Aware Reward Fusion mechanism that integrates intrinsic reward signals with semantic priors, providing stable and discriminative evaluation during long-horizon reasoning. • EEA introduces a Dynamic Query Mangement mechanism that continuously refines semantic queries throughout reasoning, effectively resolving the insufficiency of initial queries and enhancing the agent’s ability to discover and accurately identify critical evidence. Figure 3 : Pipeline of EEA Framework. The agent first derives semantic queries from the query and identifies their corresponding semantic anchors in the video. Guided by these anchors, it performs semantic-guided expansion to expand candidate nodes. It then evaluates each node with a fused reward obtained through uncertainty-aware reward fusion, combining intrinsic reward and query score. Then the agent decides its next action based on obtained information and updates the semantic queries, anchors, and memory buffer. 2 Related work 2.1 Large Vision-Language Models Large vision-language models (VLMs), empowered by recent advances in large language models (LLMs) 1 ; 47 ; 32 , have demonstrated remarkable performance across various multimodal tasks, including visual question answering, image captioning, and multimodal reasoning 52 ; 4 ; 45 . However, applying these