NovaPlan: Zero-Shot Long-Horizon Manipulation via Closed-Loop Video Language Planning
Jiahui Fu*, Junyu Nan*, Lingfeng Sun*, Hongyu Li*, Jianing Qian, Jennifer L. Barry, Kris Kitani, George Konidaris* Equal contribution, Robotics, AI Institute, Carnegie Mellon University, Brown University, University of Pennsylvania · 2026
Read NovaPlan: Zero-Shot Long-Horizon Manipulation via Closed-Loop Video Language Planning by Jiahui Fu*, Junyu Nan*, Lingfeng Sun*, Hongyu Li*, Jianing Qian, Jennifer L. Barry, Kris Kitani, George Konidaris* Equal contribution, Robotics, AI Institute, Carnegie Mellon University, Brown University, University of Pennsylvania (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-20119.txt.
Description
Long robotic tasks need joint reasoning about task structure and physical contact. Zero-shot planning from vision-language models plus video generation tends to fail. Hallucinated physics and geometric errors compound over time. A 2026 arXiv paper by Jiahui Fu and nine co-authors introduces NovaPlan, a layered framework for robust zero-shot long-horizon handling. It proposes, verifies, and repairs visual plans.
At the high level, a vision-language planner breaks tasks down. It filters out futures that violate dynamics by checking multiple candidate video rollouts. Imagined futures become reliable physical actions through a hybrid spatial representation. That representation switches as needed between flow centred on objects and flow from human hands. NovaPlan then closes the loop. It monitors the run throughout, checks outcomes, and creates local non-prehensile fixes such as fingertip poking when the run drifts.
Catalog record
| CREATOR | Jiahui Fu*, Junyu Nan*, Lingfeng Sun*, Hongyu Li*, Jianing Qian, Jennifer L. Barry, Kris Kitani, George Konidaris* Equal contribution, Robotics, AI Institute, Carnegie Mellon University, Brown University, University of Pennsylvania |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 90 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-20119