SalFormer360: a transformer-based saliency estimation model for 360-degree videos

Mahmoud Z. A. Wahba, Francesco Barbato, Sara Baldoni, and Federica Battisti · 2026

Read SalFormer360: a transformer-based saliency estimation model for 360-degree videos by Mahmoud Z. A. Wahba, Francesco Barbato, Sara Baldoni, and Federica Battisti (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04584.txt.

Description

Where viewers look inside a 360-degree video matters for streaming and immersive design. Mahmoud Z. A. Wahba and 3 co-authors present SalFormer360 in a 2026 paper, a model that predicts those attention hotspots.

The design combines a SegFormer encoder, originally built for image segmentation, with a custom decoder. Fine-tuning adapts the encoder to panoramic content. A viewing center bias reflects the tendency of viewers to look toward the middle of the scene. On the three largest benchmark datasets for this task, SalFormer360 beat previous state-of-the-art methods. Gains in correlation with real viewer attention appeared on every dataset, with the largest improvement on an eye-tracking collection.

Catalog record

CREATORMahmoud Z. A. Wahba, Francesco Barbato, Sara Baldoni, and Federica Battisti
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-04584

Browse the full library · About the Tower of Babel