Object-Centric World Models from Few-Shot Annotations for Sample-Efficient Reinforcement Learning
Weipu Zhang ⋄†, Adam Jelley †, Trevor McInroe †, Amos Storkey †, Gang Wang ⋄ · 2025
Read Object-Centric World Models from Few-Shot Annotations for Sample-Efficient Reinforcement Learning by Weipu Zhang ⋄†, Adam Jelley †, Trevor McInroe †, Amos Storkey †, Gang Wang ⋄ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-16443.txt.
Description
Weipu Zhang and co-authors present an object-centric world model for sample-efficient reinforcement learning, in a research paper from 2025. Agents that learn from pixels need many trials, which blocks real-world use. World models cut trials by simulating experience, but pixel-level losses often miss small objects that decide success in busy scenes.
Their framework adds object representations from a pretrained segmentation network to a strong world model. A few annotated frames suffice to teach which objects matter. The model then tracks object dynamics and interactions without extra labels. Tests beat the base model on a classic game benchmark and set top sample efficiency on hard boss fights in a complex game.
Catalog record
| CREATOR | Weipu Zhang ⋄†, Adam Jelley †, Trevor McInroe †, Amos Storkey †, Gang Wang ⋄ |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-16443