ViaRL: Adaptive Temporal Grounding via Visual Iterated Amplification Reinforcement Learning

Ziqiang Xu, Qi Dai, Tian Xie, Yifan Yang, Kai Qiu, DongDong Chen, Zuxuan Wu, Chong Luo, [2mm] Fudan University, Microsoft[2mm] https://github.com/xuzq23/ViaRL · 2025

Read ViaRL: Adaptive Temporal Grounding via Visual Iterated Amplification Reinforcement Learning by Ziqiang Xu, Qi Dai, Tian Xie, Yifan Yang, Kai Qiu, DongDong Chen, Zuxuan Wu, Chong Luo, [2mm] Fudan University, Microsoft[2mm] https://github.com/xuzq23/ViaRL (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-15447.txt.

Introduction

Ziqiang Xu and seven co-authors present ViaRL, a frame that teaches video models to pick the frames that matter. Their paper from twenty twenty-five notes that human viewing is goal-led: we scan for what our task needs. Video chain-of-thought systems lack a direct signal for that pick. Heuristic rules and fake labels fill the gap at high cost and low reach.

ViaRL trains a frame picker by rule-based reinforcement learning. The reward is the final answer's accuracy from a partner model. No hand labels are needed. An iterated loop refines picker and answerer in turns. Tests on VideoMME, LVBench, and MLVU show steady gains in time grounding. One needle-in-haystack task jumped by a wide margin. The method scales across tasks with no costly annotation.

Catalog record

CREATORZiqiang Xu, Qi Dai, Tian Xie, Yifan Yang, Kai Qiu, DongDong Chen, Zuxuan Wu, Chong Luo, [2mm] Fudan University, Microsoft[2mm] https://github.com/xuzq23/ViaRL
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-15447

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ViaRL: Adaptive Temporal Grounding via Visual Iterated Amplification Reinforcement Learning Ziqiang Xu, Qi Dai, Tian Xie, Yifan Yang, Kai Qiu, DongDong Chen, Zuxuan Wu, Chong Luo, [2mm] Fudan University, Microsoft[2mm] https://github.com/xuzq23/ViaRL Abstract Video understanding is inherently intention-driven-humans naturally focus on relevant frames based on their goals. Recent advancements in multimodal large language models (MLLMs) have enabled flexible query-driven reasoning; however, video-based frameworks like Video Chain-of-Thought lack direct training signals to effectively identify relevant frames. Current approaches often rely on heuristic methods or pseudo-label supervised annotations, which are both costly and limited in scalability across diverse scenarios. To overcome these challenges, we introduce ViaRL, the first framework to leverage rule-based reinforcement learning (RL) for optimizing frame selection in intention-driven video understanding. An iterated amplification strategy is adopted to perform alternating cyclic training in the video CoT system, where each component undergoes iterative cycles of refinement to improve its capabilities. ViaRL utilizes the answer accuracy of a downstream model as a reward signal to train a frame selector through trial-and-error, eliminating the need for expensive annotations while closely aligning with human-like learning processes. Comprehensive experiments across multiple benchmarks, including VideoMME, LVBench, and MLVU, demonstrate that ViaRL consistently delivers superior temporal grounding performance and robust generalization across diverse video understanding tasks, highlighting its effectiveness and scalability. Notably, ViaRL achieves a nearly 15% improvement on Needle QA, a subset of MLVU, which is required to search a specific needle within a long video and regarded as one of the most suitable benchmarks for evaluating temporal grounding. 1 Introduction Recent advancements in OpenAI’s o3 model ( openai2025o3 ) , have demonstrated remarkable capabilities in image understanding. The model leverages multi-turn query-based grounding and powerful reasoning abilities to process visual signals alongside textual queries. Inspired by this paradigm, an intriguing question arises: can video understanding be enhanced through a similar approach using temporal grounding? While spatial grounding focuses on identifying key regions within an image, temporal grounding aims to pinpoint the most relevant frames in a video sequence. Classic approaches ( openai2024gpt4o ; team2023gemini ; bai2025qwen25vl ) in video understanding often treat videos as uniform entities, processing all frames equally without considering the specific intent of the task or query. However, human perception is inherently intention-driven that we selectively focus on specific segments of a video based on the context or objective. For instance, when answering a question about a sports video, a person might pay attention to key moments of action, such as scoring or player interactions, while ignoring irrelevant segments like breaks or pauses. This highlights the importance of temporal grounding, a process that dynamically identifies and prioritizes the most relevant frames in accordance with the given query or task. By aligning video processing with task-specific intent, temporal grounding enables more efficient and meaningful video understanding. Several recent works have explored frame selection techniques and video Chain-of-Thought (CoT) pipelines. For instance, Hu et al. ( hu2025mllmbased ) employs a learnable score query to predict importance scores for each frame, using pseudo-labels annotated by MLLMs during training. AKS tang2025AKS leverages the CLIP model to compute relevance scores between each frame and the query. Both of them introduce extra sophisticated strategies, such as Non-Maximum Suppression (NMS) sampling, to reduce redundancy in frame selection. CoS hu2025CoS uses the LLaVA to evaluate whether the query elements are present in each frame to construct positive and negative shots for further co-reasoning, without temporal consideration. Additionally, Frame-Voyager yu2024framevoyager applies a Direct Policy Optimization (DPO) strategy to select a group from combinations of candidate frames. All of these methods face limitations, specifically, these methods lack a clear training goal for assessing the quality of selected frames, making it challenging to consistently produce optimal results. To address these limitations, we propose a novel learning framework, ViaRL, that incorporates rule-based reinforcement learning (RL) into the video CoT pipeline to optimize frame selection for temporal grounding. Unlike previous approach that relies on supervised fine-tuning with pseudo-labels, ViaRL uses the answer accuracy of a downstream MLLM as a reward signal, enabling a trial-and-error learning process that eliminates the need for expensive frame selection annotations. This approach aligns more closely with human-like learning, where individuals refine their perceptual skills through interaction and feedback rather than exhaustive supervision. By leveraging reinforcement learning, ViaRL dynamically trains a lightweight frame selector to identify the most relevant frames for a given query, ensuring that the model focuses on the key moments that contribute to accurate answer generation. Inspired by the concept of iterated distillation and amplification introduced in AI 2027 ( Daniel2025forecast ) , we adopt an iterative training strategy, referred to as Visual Iterated Amplification System, to progressively improve the performance of both the frame selector and the downstream MLLM. They Daniel2025forecast ; christiano2018supervising decompose a complex problem into multiple simple sub-problems and handle them in parallel, enabling the model to progressively adapt to more challenging tasks. In comparison, we employ a sequential processing approach, which is better aligned with the requirements of our task. Initially, the frame selector is trained using RL to optimize its selection effectiveness, based on the reward signal provided by the downstream MLLM’s accuracy. Once the selector achieves a certain level of performance, we freeze it and fine-tune the downstream MLLM to maximize its ability to generate accurate answers using the selected frames. As the downstream model improves, the selector is retrained to further refine its frame selection process, creating a feedback loop where both components collectively enhance their performance. This iterative process ensures that the pipeline adapts to increasingly complex scenarios, enabling robust temporal grounding across diverse video understanding tasks. By leveraging reinforcement learning and iterative optimization, ViaRL provides a scalable and human-inspired solution to intention-driven video understanding, setting a new standard for temporal grounding in multimodal tasks. We evaluate ViaRL extensively across multiple benchmarks, including VideoMME fu2024videomme , LVBench wang2024lvbench , and MLVU zhou2024mlvu , demonstrating its effectiveness and scalability. Notably, ViaRL achieves significant improvements in temporal grounding performance compared to state-of-the-art baselines. For example, ViaRL achieves a 15% improvement on Needle QA, a subset of MLVU that is widely regarded as one of the most suitable benchmarks for evaluating temporal grounding. Additionally, our experiments demonstrate that ViaRL consistently performs well across diverse visual scenarios and question types, underscoring its broad applicability and robustness. Our contributions can be summarized as follows: • We propose ViaRL, the first framework to apply rule-based reinforcement learning to temporal grounding in video understanding tasks. By addressing the challenges posed by training signals, ViaRL establishes a learning paradigm that is both flexible and human-like. • We introduce Visual Iterated Amplification Learning System, an iterative training strategy that progressively improves both frame selection and answer generation through feedback loops. • Extensive experiments across multiple benchmarks featuring diverse task scenes demonstrate that ViaRL consistently outperforms strong baselines in temporal grounding tasks, highlighting its effectiveness and scalability across a broad range of task scenarios. 2 Related Works MLLMs for Video Understanding. Recent advancements in Multimodal Large Language Models (MLLMs) have transformed video understanding through unified representation learning, efficient temporal modeling, and scalable architectures. Video-LLaVA ( lin2023videollava ) pioneered alignment of image and video features into a shared language space, achieving state-of-the-art performance on video QA benchmarks. Video-LLaMA ( zhang2023videollama )

Read the complete text