mDP 3 : A Training-free Approach for List-wise Frame Selection in Video-LLMs

Hui Sun, Shiyin Lu, Huanyu Wang, Qing-Guo Chen, Zhao Xu, Weihua Luo, Kaifu Zhang, Ming Li · 2025

Read mDP 3 : A Training-free Approach for List-wise Frame Selection in Video-LLMs by Hui Sun, Shiyin Lu, Huanyu Wang, Qing-Guo Chen, Zhao Xu, Weihua Luo, Kaifu Zhang, Ming Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-02885.txt.

Description

Hui Sun and co-authors pick which frames a video language model should see, with no training at all, in work from 2025. Feeding every frame floods the model's context and buries the useful shots. Even sampling and simple text matching each miss part of what a good pick needs.

The team names three needs: frames should fit the question, differ from each other, and respect time order. Their method scores frame likeness given the question, then uses a spread-seeking sampler inside time segments to balance all three. The segment-by-segment pick runs by dynamic programming. The add-on drops into existing video models as-is, trimming input while keeping the shots that answer the question.

Catalog record

CREATORHui Sun, Shiyin Lu, Huanyu Wang, Qing-Guo Chen, Zhao Xu, Weihua Luo, Kaifu Zhang, Ming Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-02885

Browse the full library · About the Tower of Babel