The TIME Machine: On The Power of Motion for Efficient Perception

Mantas Skackauskas, Xinyue Hao, Laura Sevilla-Lara · 2026

Read The TIME Machine: On The Power of Motion for Efficient Perception by Mantas Skackauskas, Xinyue Hao, Laura Sevilla-Lara (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-23045.txt.

Description

Skackauskas, Hao, and Sevilla-Lara propose TIME, a video representation learned from motion rather than pixels. Scaling video models costs enormously, and next-frame prediction overemphasizes spatial detail while neglecting time. Given point tracks for a video's motion, they mask some tracks and train a masked autoencoder to rebuild them, yielding a Temporally-Informed Motion Embedding focused on temporal structure. Since motion ignores appearance, TIME generalizes from far less data, matching state-of-the-art temporal results with up to four orders of magnitude less training data.

Catalog record

CREATORMantas Skackauskas, Xinyue Hao, Laura Sevilla-Lara
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42921
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.23045

Browse the full library · About the Tower of Babel