VidChain: Chain-of-Tasks with Metric-based Direct Preference Optimization for Dense Video Captioning

Ji Soo Lee, Jongha Kim, Jeehye Na, Jinyoung Park, Hyunwoo J. Kim · 2025

Read VidChain: Chain-of-Tasks with Metric-based Direct Preference Optimization for Dense Video Captioning by Ji Soo Lee, Jongha Kim, Jeehye Na, Jinyoung Park, Hyunwoo J. Kim (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-06761.txt.

Description

Ji Soo Lee and co-authors present VidChain, a 2025 framework for describing every event in a video with timestamps. Dense video captioning mixes segmentation, captioning, and time grounding. Video language models often try it in one leap and stumble. VidChain chains the sub-tasks in order instead.

Each step feeds the next, using the model reasoning along the way. A preference training method tunes outputs to the scoring metrics. That alignment was missing in older training goals. Fine-grained time understanding is the core gain. Surveillance, sports, and media archives all need such dense logs.

Catalog record

CREATORJi Soo Lee, Jongha Kim, Jeehye Na, Jinyoung Park, Hyunwoo J. Kim
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-06761

Browse the full library · About the Tower of Babel