Enrich and Detect: Video Temporal Grounding with Multimodal LLMs

Shraman Pramanick Effrosyni Mavroudi Yale Song Rama Chellappa, Lorenzo Torresani Triantafyllos Afouras · 2025

Read Enrich and Detect: Video Temporal Grounding with Multimodal LLMs by Shraman Pramanick Effrosyni Mavroudi Yale Song Rama Chellappa, Lorenzo Torresani Triantafyllos Afouras (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-17023.txt.

Description

Shraman Pramanick leads five co-authors in sharpening video moment search in a 2025 paper. Temporal grounding finds where a described moment occurs in video. User queries often omit details needed for precise matching. Their method first enriches the query before locating it.

A multimodal language model rewrites queries with missing cues added. A lightweight decoder then predicts the moment's boundaries. Training uses a multiple-instance objective to fight noise. That objective picks the best query version for each example. It also limits damage from model-invented details. Results set new best scores on several grounding benchmarks. The method beat every earlier language-model approach clearly. It also matched or beat specialized grounding models overall.

Catalog record

CREATORShraman Pramanick Effrosyni Mavroudi Yale Song Rama Chellappa, Lorenzo Torresani Triantafyllos Afouras
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE79 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-17023

Browse the full library · About the Tower of Babel