Towards Generalizing Temporal Action Segmentation to Unseen Views

Emad Bahrami, Olga Zatsarynna, Gianpiero Francesca, Juergen Gall · 2025

Read Towards Generalizing Temporal Action Segmentation to Unseen Views by Emad Bahrami, Olga Zatsarynna, Gianpiero Francesca, Juergen Gall (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-02512.txt.

Description

Bahrami, Zatsarynna, Francesca, and Gall tackle video action segmentation for camera views the model never saw in training. Splitting a video into timed action steps works well for known views, but unseen angles break most systems. Their 2025 paper sets a test protocol for this harder case, including shifts from front views to side or first person views.

Their method learns shared features at both the whole sequence level and the single segment level. Two added loss terms push video and action features to stay consistent across views. On three datasets, scores rose sharply for unseen views. The gain reached about 54 percent for the hardest shift, to first person views.

Catalog record

CREATOREmad Bahrami, Olga Zatsarynna, Gianpiero Francesca, Juergen Gall
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-02512

Browse the full library · About the Tower of Babel