Spatial Policy: Guiding Visuomotor Robotic Manipulation with Spatial-Aware Modeling and Reasoning
Yijun Liu, Yuwei Liu, Yuan Meng, Jieheng Zhang, Yuwei Zhou · 2025
Read Spatial Policy: Guiding Visuomotor Robotic Manipulation with Spatial-Aware Modeling and Reasoning by Yijun Liu, Yuwei Liu, Yuan Meng, Jieheng Zhang, Yuwei Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-15874.txt.
Introduction
Robot arms that watch and grab often fail where space sense matters, and Yijun Liu and co-authors give their system an explicit space plan, in work from twenty twenty-five. A plan table guides a video dreamer that previews the move. A flow-based part then turns previews into arm actions.
A feedback loop re-plans the table in two stages when the world drifts. Scores jumped by more than a third on one test world and a quarter on another, across twenty-plus tasks. Real robot trials backed the lab gains. The team argues that writing the space plan down, rather than hiding it in weights, is what steadies the arm.
Catalog record
| CREATOR | Yijun Liu, Yuwei Liu, Yuan Meng, Jieheng Zhang, Yuwei Zhou |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-15874
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Spatial Policy: Guiding Visuomotor Robotic Manipulation with Spatial-Aware Modeling and Reasoning Yijun Liu, Yuwei Liu, Yuan Meng, Jieheng Zhang, Yuwei Zhou Abstract Vision-centric hierarchical embodied models have demonstrated strong potential for long-horizon robotic control. However, existing methods lack spatial awareness capabilities, limiting their effectiveness in bridging visual plans to actionable control in complex environments. To address this problem, we propose Spatial Policy (SP), a unified spatial-aware visuomotor robotic manipulation framework via explicit spatial modeling and reasoning. Specifically, we first design a spatial-conditioned embodied video generation module to model spatially guided predictions through a spatial plan table. Then, we propose a spatial-based action prediction module to infer executable actions with coordination. Finally, we propose a spatial reasoning feedback policy to refine the spatial plan table via dual-stage replanning. Extensive experiments show that SP significantly outperforms state-of-the-art baselines, achieving a 33.0% average improvement over the best baseline. With an 86.7% average success rate across 11 diverse tasks, SP substantially enhances the practicality of embodied models for robotic control applications. Code and checkpoints are maintained at https://plantpotatoonmoon.github.io/SpatialPolicy/ . Introduction In recent years, hierarchical embodied models combining high-level planning and low-level action have achieved remarkable success in long-horizon robotic manipulation ( Brohan et al. 2024 ; Cheang et al. 2024 ; Ze et al. 2024 ; Li et al. 2025b ) . Among these approaches, vision-based methods, known as visuomotor robotic manipulation, have emerged as a particularly promising direction. By leveraging rich visual cues, these methods enable effective cross-hierarchical information transfer across diverse robotic embodiments and environments ( Du et al. 2023 ; Tian et al. 2024 ; Ko et al. 2023 ; Soni et al. 2025 ; Black et al. 2023 ; Li et al. 2025a ) . Specicially, visuomotor robotic manipulation employs a generative model to predict trajectories of future video, which are subsequently translated into executable actions through a action prediction module. Despite significant advances, existing visuomotor robotic manipulation frameworks lack spatial awareness ability, failing to effectively bridge visual plans to executable actions in complex environments ( Tian et al. 2024 ; Black et al. 2023 ) . For instance, AVDC ( Ko et al. 2023 ) lacks explicit spatial modeling in its video generation process, resulting in physically implausible predictions, such as robotic arms passing through walls. Feedback module of CLOVER ( Bu et al. 2024 ) enhances dynamic environment adaptation, but its inability to process spatial relationships prevents handling of occluded target scenarios ( Tian et al. 2024 ) . To tackle this problem, we investigate the spatial-aware visuomotor robotic manipulation via explicit spatial modeling and reasoning, which introduces three key challenges: (1) how to generate videos that explicitly model spatial relations, such as object-goal positioning and task alignment; (2) how to utilize the generated videos to guide action prediction in a way that preserves spatial consistency and task relevance; and (3) how to reason over spatial cues during execution to enable real-time feedback that effectively bridges visual and control. To address these challenges, we propose Spatial Policy ( SP ), a unified framework for robotic manipulation that integrates spatial-aware video generation, action prediction, and feedback. The core idea is to unify spatial modeling and reasoning via a spatial plan table that guides video generation, enables spatially consistent action prediction, and supports feedback-driven refinement during execution. Specifically, (1) we propose a Spatial-Conditioned Embodied Video Generation module that generates visual predictions guided by a structured spatial plan table, which encodes object-goal relations and directional cues to ensure spatial coherence in imagined futures, addressing the challenge of modeling spatially meaningful video trajectories; (2) we introduce a Spatial-Based Action Prediction module that infers executable actions by capturing spatial motion dynamics between predicted frames using spatial coordinates, tackling the challenge of translating visual predictions into spatially consistent actions; (3) we develop a Spatial Reasoning Feedback Policy that refines the spatial plan and video execution through dual-stage replanning based on VLM feedback and rule-based corrections, solving the challenge of real-time spatial reasoning during policy execution. Extensive experiments demonstrate that our model outperforms existing baselines, achieving 86.7% performance. The contributions of this paper are summarized as follows: • Spatial policy for vision-action alignment. We propose SP, a spatially grounded visuomotor policy framework that explicitly models and reasons about spatial structures to align visual prediction with executable actions. • Modular design with structured spatial modeling and reasoning. SP consists of three synergistic modules: a spatial-conditioned video generation module guided by a structured spatial plan table, a spatial-based action prediction that preserves spatial consistency, and a spatial reasoning feedback policy that refines execution through real-time spatial replanning. • Comprehensive evaluation and strong performance. We conduct extensive experiments on the MetaWorld benchmark to assess the impact of spatial integration, including ablations on video generation, action prediction, and feedback mechanisms. SP outperforms prior methods by over 30%, demonstrating the effectiveness of spatial reasoning in visuomotor robotic manipulation. Related Work Video Generation for Embodied Manipulation Video generation has recently been explored as a visual planning mechanism for embodied agents. AVDC ( Ko et al. 2023 ) generates action-annotated video plans from raw RGB inputs using dense correspondencesenabling policy learning without action supervision. However, due to the lack of explicit spatial reasoning in both generation and action prediction, limiting precision in manipulation tasks. VideoAgent ( Soni et al. 2025 ) refines video plans via self-conditioning to reduce hallucinations and improve visual quality. However, it inherits the lack of explicit spatial reasoning from AVDC in both generation and action prediction, limiting precision in geometry-sensitive manipulation tasks. Clover ( Bu et al. 2024 ) introduces a closed-loop framework combining video diffusion planning and feedback control via an embedding-based error signal, achieving strong results in long-horizon tasks. However, its spatial modeling is limited to depth-based cues and lacks explicit 3D spatial planning or structured geometric reasoning, which restricts generalization across diverse spatial layout. SEER ( Tian et al. 2024 ) proposes a Predictive Inverse Dynamics Model (PIDM) that forecasts future visual states and infers actions end-to-end, closing the loop between vision and control. While it achieves strong performance through large-scale training, it lacks explicit spatial reasoning modules and does not leverage structured spatial plans, which may limit interpretability and adaptability in geometry-sensitive tasks. SuSIE ( Black et al. 2023 ) leverages an image-editing diffusion model to generate visual subgoals for a low-level goal-conditioned policy, enabling better generalization in unstructured environments. However, its subgoal generation relies on appearance-based edits without explicit incorporation of 3D spatial relationships, limiting its precision in spatially complex manipulation scenarios. Spatial Reasoning in Vision-Language Embodied Systems Spatial understanding has been addressed in embodied AI from several perspectives. SpatialVLM ( Chen et al. 2024a ) and GraspCorrect ( Lee, Hong, and Kim 2025 ) leverage pretrained vision-language models to extract chain-of-thought spatial cues and determine object relations in manipulation tasks. 3D-VLA ( Zhen et al. 2024 ) explicitly encodes spatial semantics by aligning 3D vision with textual instructions. SPA ( Zhu et al. 2025 ) utilizes point cloud reconstruction for spatial alignment in manipulation and navigation tasks. Meanwhile, LLM-Planner ( Song et al. 2023 ) and related methods employ large language models to infer spatially structured plans in symbolic form. Despite these advances, such methods either focus on semantic spatial understanding or