Object-Centric World Models from Few-Shot Annotations for Sample-Efficient Reinforcement Learning

Weipu Zhang ⋄†, Adam Jelley †, Trevor McInroe †, Amos Storkey †, Gang Wang ⋄ · 2025

Read Object-Centric World Models from Few-Shot Annotations for Sample-Efficient Reinforcement Learning by Weipu Zhang ⋄†, Adam Jelley †, Trevor McInroe †, Amos Storkey †, Gang Wang ⋄ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-16443.txt.

Description

Weipu Zhang and co-authors present an object-centric world model for sample-efficient reinforcement learning, in a research paper from 2025. Agents that learn from pixels need many trials, which blocks real-world use. World models cut trials by simulating experience, but pixel-level losses often miss small objects that decide success in busy scenes.

Their framework adds object representations from a pretrained segmentation network to a strong world model. A few annotated frames suffice to teach which objects matter. The model then tracks object dynamics and interactions without extra labels. Tests beat the base model on a classic game benchmark and set top sample efficiency on hard boss fights in a complex game.

Catalog record

CREATORWeipu Zhang ⋄†, Adam Jelley †, Trevor McInroe †, Amos Storkey †, Gang Wang ⋄
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-16443

Browse the full library · About the Tower of Babel