Retrieving Any Relevant Moments: Benchmark and Models for Generalized Moment Retrieval CCS: Information systems Retrieval tasks and goals CCS: Computing methodologies Computer vision

Yiming Ding 1,2 Siyu Cao 1 Luyuan Jiao 3 Yixuan Li 1 Zitong Wang 4 Zhiyong Liu 1 Lu Zhang 1,∗ 1 Institute of Automation, Chinese Academy of Sciences 2 Beijing University of Posts and Telecommunications 3 Wuhan University 4 University of Electronic Science and Technology of China Code and dataset: https://github.com/dymm9977/generalized-moment-retrieval · 2026

Read Retrieving Any Relevant Moments: Benchmark and Models for Generalized Moment Retrieval CCS: Information systems Retrieval tasks and goals CCS: Computing methodologies Computer vision by Yiming Ding 1,2 Siyu Cao 1 Luyuan Jiao 3 Yixuan Li 1 Zitong Wang 4 Zhiyong Liu 1 Lu Zhang 1,∗ 1 Institute of Automation, Chinese Academy of Sciences 2 Beijing University of Posts and Telecommunications 3 Wuhan University 4 University of Electronic Science and Technology of China Code and dataset: https://github.com/dymm9977/generalized-moment-retrieval (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-02623.txt.

Description

Yiming Ding and six co-authors widen a video search task: finding every moment in a video that matches a written query, not just one. Classic moment retrieval assumes exactly one match, but real queries may match several moments, or none. Their generalized setting requires the full set of matches, or an empty answer when nothing fits.

To study the task, the team builds Soccer-GMR, a large benchmark from soccer videos with realistic positive and negative queries, made by a semi-automated pipeline with human checks. A unified scoring protocol covers rejection of empty cases, location of true moments, and end-to-end performance. Baselines include a plug-in adapter for existing retrieval models and a tailored reinforcement reward for fine-tuning multimodal language models, giving the new task a starting point.

Catalog record

CREATORYiming Ding 1,2 Siyu Cao 1 Luyuan Jiao 3 Yixuan Li 1 Zitong Wang 4 Zhiyong Liu 1 Lu Zhang 1,∗ 1 Institute of Automation, Chinese Academy of Sciences 2 Beijing University of Posts and Telecommunications 3 Wuhan University 4 University of Electronic Science and Technology of China Code and dataset: https://github.com/dymm9977/generalized-moment-retrieval
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.02623

Browse the full library · About the Tower of Babel