Grounding Generated Videos in Feasible Plans via World Models

Christos Ziakas, Amir Bar, Alessandra Russo · 2026

Read Grounding Generated Videos in Feasible Plans via World Models by Christos Ziakas, Amir Bar, Alessandra Russo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01960.txt.

Description

Christos Ziakas and colleagues ground video plans in feasible actions with GVP-WM. Large video models act as zero shot visual planners, yet generated plans often break temporal and physical constraints. GVP-WM first creates a video plan from start and goal views, then projects guidance onto feasible trajectories via latent collocation. Grounding becomes goal conditioned latent trajectory optimization over states and actions under world dynamics, while preserving video plan alignment. Tests recover feasible plans from zero shot and motion blurred videos violating physical constraints, across navigation and manipulation tasks.

Catalog record

CREATORChristos Ziakas, Amir Bar, Alessandra Russo
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47958
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.01960

Browse the full library · About the Tower of Babel