Audio-visual Event Localization on Portrait Mode Short Videos

Wuyang Liu Yi Chai Yongpeng Yan Yanzhen Ren · 2025

Read Audio-visual Event Localization on Portrait Mode Short Videos by Wuyang Liu Yi Chai Yongpeng Yan Yanzhen Ren (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-06884.txt.

Description

Wuyang Liu, Yi Chai, Yongpeng Yan, and Yanzhen Ren wrote this 2025 paper on finding events in short phone videos using both sound and sight. Most past data sets used wide, long videos with clean sound. Short clips shot in portrait mode are now the main form online, and their sound often layers speech, music, and effects.

The team built a new data set of 25,335 clips in 86 classes, each marked frame by frame. They then tested top methods from the older task on this new set. Scores dropped by about 19 percent on average when methods crossed to the new format. The paper names two key problems that drive the drop.

Catalog record

CREATORWuyang Liu Yi Chai Yongpeng Yan Yanzhen Ren
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-06884

Browse the full library · About the Tower of Babel