mDP 3 : A Training-free Approach for List-wise Frame Selection in Video-LLMs
Hui Sun, Shiyin Lu, Huanyu Wang, Qing-Guo Chen, Zhao Xu, Weihua Luo, Kaifu Zhang, Ming Li · 2025
Read mDP 3 : A Training-free Approach for List-wise Frame Selection in Video-LLMs by Hui Sun, Shiyin Lu, Huanyu Wang, Qing-Guo Chen, Zhao Xu, Weihua Luo, Kaifu Zhang, Ming Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-02885.txt.
Description
Hui Sun and co-authors pick which frames a video language model should see, with no training at all, in work from 2025. Feeding every frame floods the model's context and buries the useful shots. Even sampling and simple text matching each miss part of what a good pick needs.
The team names three needs: frames should fit the question, differ from each other, and respect time order. Their method scores frame likeness given the question, then uses a spread-seeking sampler inside time segments to balance all three. The segment-by-segment pick runs by dynamic programming. The add-on drops into existing video models as-is, trimming input while keeping the shots that answer the question.
Catalog record
| CREATOR | Hui Sun, Shiyin Lu, Huanyu Wang, Qing-Guo Chen, Zhao Xu, Weihua Luo, Kaifu Zhang, Ming Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-02885