Factorized Learning for Temporally Grounded Video-Language Models

Wenzheng Zeng, Difei Gao, Mike Zheng Shou, Hwee Tou NgNational University of Singapore [email protected], {daniel.difei.gao, mike.zheng.shou}@gmail.com, [email protected] · 2025

Read Factorized Learning for Temporally Grounded Video-Language Models by Wenzheng Zeng, Difei Gao, Mike Zheng Shou, Hwee Tou NgNational University of Singapore [email protected], {daniel.difei.gao, mike.zheng.shou}@gmail.com, [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-24097.txt.

Description

Wenzheng Zeng, Difei Gao, Mike Zheng Shou, and Hwee Tou Ng tackle temporal grounding in video. A model watching a clip should point to supporting moments. Fluent text alone is not enough. The two tasks form a hierarchy, the authors note. Reliable answers rest on well-grounded evidence. Most systems still train the tasks tangled together.

Their framework separates the jobs but keeps the dependency. The model first grounds event-level evidence. Special evidence tokens mark that evidence. The model then answers by referring to it. A training algorithm teaches both skills at once. Grounding is treated probabilistically inside that algorithm. A synthetic dataset fills a gap in existing data. Across several tasks, the approach beat coupled baselines clearly. The team released its code in public.

Catalog record

CREATORWenzheng Zeng, Difei Gao, Mike Zheng Shou, Hwee Tou NgNational University of Singapore [email protected], {daniel.difei.gao, mike.zheng.shou}@gmail.com, [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-24097

Browse the full library · About the Tower of Babel