Efficient Object-centric Representation Learning with Pre-trained Geometric Prior

Phúc H. Le Khac, Graham Healy and Alan F. Smeaton · 2024

Read Efficient Object-centric Representation Learning with Pre-trained Geometric Prior by Phúc H. Le Khac, Graham Healy and Alan F. Smeaton (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-12331.txt.

Description

Phuc Le Khac, Graham Healy, and Alan Smeaton present a method for teaching AI to see scenes as separate objects, in a 2024 paper. Video scenes with many moving objects are hard for such systems. Their method stresses shape understanding and borrows from pre-trained vision models. It needs only weak supervision, not full labels.

A lean decoder turns learned slots into objects in the scene. The method works without direct depth data. Tests on synthetic videos grew harder step by step, with more objects, more overlap, and camera motion. Results matched fully supervised methods while using less computing power. The work moves object-based video learning closer to real-world use, where labels are scarce and scenes are messy.

Catalog record

CREATORPhúc H. Le Khac, Graham Healy and Alan F. Smeaton
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-12331

Browse the full library · About the Tower of Babel