STOP: Integrated Spatial-Temporal Dynamic Prompting for Video Understanding

Zichen Liu, Kunlun Xu, Bing Su, Xu Zou, Yuxin Peng, Jiahuan Zhou · 2025

Read STOP: Integrated Spatial-Temporal Dynamic Prompting for Video Understanding by Zichen Liu, Kunlun Xu, Bing Su, Xu Zou, Yuxin Peng, Jiahuan Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-15973.txt.

Description

Zichen Liu and co-authors present a prompting method in two thousand twenty-five that adapts image-language models to video. Models like CLIP learn from huge image-text collections and transfer well to new image tasks. Video is harder: labeled clips are scarce and training is costly.

Earlier video prompting used one fixed prompt for every clip, ignoring how scenes change over time. Their model, STOP, works on two levels. Prompts inside each frame steer attention to regions that change and matter. Prompts between frames mark the frames with the biggest shifts, so key moments get priority. Together the two levels capture fine detail and time flow. Tests across several video benchmarks showed strong results, which the authors credit to the dynamic design.

Catalog record

CREATORZichen Liu, Kunlun Xu, Bing Su, Xu Zou, Yuxin Peng, Jiahuan Zhou
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-15973

Browse the full library · About the Tower of Babel