LDDR: Linear-DPP-Based Dynamic-Resolution Frame Sampling for Video MLLMs

Jingfeng Chen Jiawen Qian Wendi Deng Yinuo Guo, Jiaqi Yu Sicong Leng Raghuveer Thirukovalluru Bhuwan Dhingra · 2026

Read LDDR: Linear-DPP-Based Dynamic-Resolution Frame Sampling for Video MLLMs by Jingfeng Chen Jiawen Qian Wendi Deng Yinuo Guo, Jiaqi Yu Sicong Leng Raghuveer Thirukovalluru Bhuwan Dhingra (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11477.txt.

Description

Chen and seven colleagues propose LDDR, a budget-aware frame sampling framework for long-video multimodal models. Old methods miss key events, keep redundant frames, or cost too much, and give every frame equal tokens. LDDR performs query-aware determinantal point process selection in a task-conditioned feature space, three times faster than standard DPP baselines. A group importance score guides retention and resolution, giving more tokens to informative frames. It gains 2 point 5 points at low budgets and 1 point 6 points at high budgets across four video benchmarks.

Catalog record

CREATORJingfeng Chen Jiawen Qian Wendi Deng Yinuo Guo, Jiaqi Yu Sicong Leng Raghuveer Thirukovalluru Bhuwan Dhingra
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61107
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.11477

Browse the full library · About the Tower of Babel