FlowDreamer: A RGB-D World Model with Flow-based Motion Representations for Robot Manipulation

Jun Guo, Xiaojian Ma, Yikai Wang, Min Yang, Huaping Liu, Qing Li · 2025

Read FlowDreamer: A RGB-D World Model with Flow-based Motion Representations for Robot Manipulation by Jun Guo, Xiaojian Ma, Yikai Wang, Min Yang, Huaping Liu, Qing Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-10075.txt.

Description

Jun Guo and five co-authors present FlowDreamer, an RGB-D world model for robot manipulation in two thousand twenty-five. World models predict future views from past frames and robot acts. Most fold motion into the render step in an implicit way. FlowDreamer makes motion explicit as 3D scene flow instead.

A U-Net first predicts that flow from the past and the act. A diffusion model then draws the next frame guided by the flow. Training runs end to end despite the split design. Four benchmarks cover video prediction and visual planning. Gains span semantic match, pixel quality, and task success.

Catalog record

CREATORJun Guo, Xiaojian Ma, Yikai Wang, Min Yang, Huaping Liu, Qing Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-10075

Browse the full library · About the Tower of Babel