EmboAlign : Aligning Video Generation with Compositional Constraints for Zero-Shot Manipulation

Gehao Zhang, Zhenyang Ni, Payal Mohapatra, Han Liu, Ruohan Zhang, Qi Zhu · 2026

Read EmboAlign : Aligning Video Generation with Compositional Constraints for Zero-Shot Manipulation by Gehao Zhang, Zhenyang Ni, Payal Mohapatra, Han Liu, Ruohan Zhang, Qi Zhu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-05757.txt.

Description

Zhang and team present EmboAlign, lining up video making outputs with limits for zero-shot handling. Video making models produce smooth rollouts holding moves. However, they often produce unreal rollouts, and re-aiming brings errors from flawed depth guessing. It uses a vision-language model to extract task limits. Limit-guided picking keeps the most likely rollout try. Limit-based tuning refines the path under the same limits. On six real-robot tasks, it improves success by 43.3 points over the base without training data.

Catalog record

CREATORGehao Zhang, Zhenyang Ni, Payal Mohapatra, Han Liu, Ruohan Zhang, Qi Zhu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33890
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.05757

Browse the full library · About the Tower of Babel