EgoLoc: A Generalizable Solution for Temporal Interaction Localization in Egocentric Videos

Junyi Ma, Erhang Zhang, Yin-Dong Zheng, Yuchen Xie, Yixuan Zhou, Hesheng Wang · 2025

Read EgoLoc: A Generalizable Solution for Temporal Interaction Localization in Egocentric Videos by Junyi Ma, Erhang Zhang, Yin-Dong Zheng, Yuchen Xie, Yixuan Zhou, Hesheng Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-12349.txt.

Description

Junyi Ma and co-authors present in 2025 a tool that spots the exact frames where a hand touches or leaves an object in first-person video. Such timing matters for virtual reality and for teaching robots by watching people. Older tools need masks or fixed lists of actions, which limits their use.

Their tool, called EgoLoc, picks smart sample frames from hand motion and asks a vision-language model to judge contact and parting. Feedback loops then refine the call. It needs no training labels for each scene. Tests on public data and new benchmarks show it lands the key moments well across varied clips.

Catalog record

CREATORJunyi Ma, Erhang Zhang, Yin-Dong Zheng, Yuchen Xie, Yixuan Zhou, Hesheng Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-12349

Browse the full library · About the Tower of Babel