Minimalistic Video Saliency Prediction via Efficient Decoder & Spatio Temporal Action Cues

Rohit Girmaji, Siddharth Jain, Bhav Beri, Sarthak Bansal, Vineet Gandhi · 2025

Read Minimalistic Video Saliency Prediction via Efficient Decoder & Spatio Temporal Action Cues by Rohit Girmaji, Siddharth Jain, Bhav Beri, Sarthak Bansal, Vineet Gandhi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-00397.txt.

Description

Rohit Girmaji and co-authors present 2025 models that predict where a viewer will look in a video, with a lean build. Guessing gaze hot spots helps in video coding, ads, and interface design. Top models can be huge and slow, which bars their use on small devices or in real time.

One model trims a known design to a 36-megabyte form with a light decoder, with no loss in scores. A larger kin adds cues from where actions take place in space and time, a shift from the class labels most past models use. An ensemble that averages the two maps tops the field on three sight-only and six audio-visual test sets. The lean model runs at over 1,000 frames per second, which beats transformer models on speed and size.

Catalog record

CREATORRohit Girmaji, Siddharth Jain, Bhav Beri, Sarthak Bansal, Vineet Gandhi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-00397

Browse the full library · About the Tower of Babel