MoMaStage: Skill-State Graph Guided Planning and Closed-Loop Execution for Long-Horizon Indoor Mobile Manipulation

Chenxu Li, Zixuan Chen, Yetao Li, Jiapeng Xu, Hongyu Ding, Jieqi Shi, Jing Huo, Yang Gao · 2026

Read MoMaStage: Skill-State Graph Guided Planning and Closed-Loop Execution for Long-Horizon Indoor Mobile Manipulation by Chenxu Li, Zixuan Chen, Yetao Li, Jiapeng Xu, Hongyu Ding, Jieqi Shi, Jing Huo, Yang Gao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08383.txt.

Introduction

Li and colleagues present MoMaStage, a map-light framework for state-consistent planning and closed-loop control in long-horizon indoor mobile manipulation. Such tasks require robots to execute extended navigation runs whose feasibility depends on state changes from preceding skills. Vision-language models can decompose instructions into skill runs, but they do not reliably track cumulative embodiment constraints or revise plans when execution deviates. MoMaStage couples a frozen vision-language model with robot action through a library of grounded skills and a Skill-State Graph that constrains planning.

Catalog record

CREATORChenxu Li, Zixuan Chen, Yetao Li, Jiapeng Xu, Hongyu Ding, Jieqi Shi, Jing Huo, Yang Gao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38675
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.08383

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MoMaStage: Skill-State Graph Guided Planning and Closed-Loop Execution for Long-Horizon Indoor Mobile Manipulation Chenxu Li, Zixuan Chen, Yetao Li, Jiapeng Xu, Hongyu Ding, Jieqi Shi, Jing Huo, Yang Gao Abstract Indoor mobile manipulation (MoMA) enables robots to translate natural language instructions into physical actions, yet long-horizon execution remains challenging due to cascading errors and limited generalization across diverse environments. Learning-based approaches often fail to maintain logical consistency over extended horizons, while methods relying on explicit scene representations impose rigid structural assumptions that reduce adaptability in dynamic settings. To address these limitations, we propose MoMaStage, a structured vision-language framework for long-horizon MoMA that eliminates the need for explicit scene mapping. MoMaStage grounds a Vision-Language Model (VLM) within a Hierarchical Skill Library and a topology-aware Skill-State Graph, constraining task decomposition and skill composition within a feasible transition space. This structured grounding ensures that generated plans remain logically consistent and topologically valid with respect to the agent’s evolving physical state. To enhance robustness, MoMaStage incorporates a closed-loop execution mechanism that monitors proprioceptive feedback and triggers graph-constrained semantic replanning when deviations are detected, maintaining alignment between planned skills and physical outcomes. Extensive experiments in physics-rich simulations and real-world environments demonstrate that MoMaStage outperforms state-of-the-art baselines, achieving substantially higher planning success, reducing token overhead, and significantly improving overall task success rates in long-horizon mobile manipulation. Video demonstrations are available on the project website: https://chenxuli-cxli.github.io/MoMaStage/ . I INTRODUCTION Indoor long-horizon mobile manipulation (MoMa) requires robots to accomplish tasks through extended sequences of navigation and object interaction within complex and dynamic environments such as homes and kitchens [ 39 , 6 ] . These tasks tightly couple perception, decision-making, and control over long horizons while the agent interacts with changing environmental states. Although imitation learning approaches [ 42 , 8 , 41 ] have shown advantages over classical planning and control pipelines in terms of visual robustness and short-horizon dexterity, scaling these policies to long-horizon mobile manipulation remains challenging. Fig. 1 : We propose MoMaStage, a framework for long-horizon mobile manipulation that drives VLMs to translate instructions into valid skill chains via a Skill-State Graph and a hierarchical skill library, with closed-loop proprioceptive verification for guided replanning upon failure. Long-horizon mobile manipulation is bottlenecked by the combinatorial explosion of task complexity. This increases expert data collection costs, limits the generalization of end-to-end policies [ 5 , 36 ] , and exacerbates compounding errors. While prior map-based symbolic planning methods [ 15 , 27 , 12 , 38 ] attempt to address this, they are hindered by rigid assumptions, limited real-world semantic understanding, and computational overhead from explicit mapping. Recently, the integration of Vision-Language Models (VLMs) [ 4 , 10 , 20 ] has presented a highly promising alternative. These models possess vast internalized knowledge and demonstrate strong capabilities in grounding natural language instructions into sequential sub-tasks. However, purely VLM-driven agents often act without structural constraints. Frequently, open-loop language planners [ 1 , 19 , 22 ] may generate semantically plausible but physically inconsistent skill sequences. This is because executability depends not only on the current subtask, but also on the accumulated effects of previous skills which are often ignored by current methods [ 34 , 7 , 17 ] . To bridge this critical gap, we propose MoMaStage , a structured closed-loop framework driven by VLMs, designed for indoor long-horizon mobile manipulation without requiring explicit scene mapping, as shown in Figure 1 .Our key insight is that, for long-horizon mobile manipulation, the critical missing abstraction is not a richer, explicit scene graph, but rather a state-grounded skill transition model that explicitly tracks how each semantic skill alters the robot-task state. Guided by this insight, our framework systematically constrains the generative reasoning of the VLM by introducing a Hierarchical Skill Library and a topology-aware Skill-State Graph. Inspired by classical precondition-effect reasoning, we reformulate open-loop VLM planning into a state-grounded skill transition process. Unlike computationally heavy symbolic world models, our approach introduces a lightweight embodiment-state grounding interface that seamlessly embeds the robot’s evolving physical constraints directly into the structured graph. Furthermore, executing long-horizon plans in the real world requires dynamic adaptability. To ensure robust execution, MoMaStage features a closed-loop mechanism that decouples physical safety from semantic reasoning. The system uses high-frequency proprioceptive ego-state monitoring to evaluate task progress and ensure immediate safety without inducing inference latency. Only when significant execution anomalies occur does it trigger semantic verification [ 11 , 43 ] , allowing the VLM to replan the skill sequence [ 34 ] and recover from out-of-distribution disruptions. In summary, our primary contributions are as follows: • We present MoMaStage, a map-free and VLM-driven framework for indoor long-horizon mobile manipulation, which unifies instruction understanding, skill-chain generation, execution, and feedback-driven refinement into a closed-loop decision-making pipeline. • We introduce a state-grounded skill planning and execution mechanism built on a Skill-State Graph and a hierarchical skill library, which enforces cumulative state feasibility over VLM-generated skill chains and enables robust failure recovery through lightweight ego-state monitoring and targeted semantic replanning. • We validate MoMaStage through extensive mobile manipulation experiments in complex simulations and dynamic real-world environments, demonstrating significant improvements in planning validity, execution robustness, and long-horizon task completion over representative baselines. II Related Work II-A Mobile Manipulation and Skill Learning Mobile manipulation has progressed from fixed-base tabletop settings toward household deployment and everyday activities [ 35 ] . Systems such as Mobile ALOHA [ 14 ] enable whole-body bimanual control, while HomeRobot [ 39 ] introduces the Open-Vocabulary Mobile Manipulation (OVMM) benchmark for pick-and-place in unseen environments, and OK-Robot [ 23 ] achieves zero-shot performance by composing open-knowledge models. At the policy level, large-scale VLA architectures, including RT-1 [ 5 ] , RT-2 [ 4 ] , VIMA [ 44 ] , RoboAgent [ 3 ] , Octo [ 36 ] , OpenVLA [ 20 ] , and DP-VLA [ 17 ] , learn end-to-end language-conditioned policies, while imitation learning methods such as Implicit Behavioral Cloning [ 13 ] , BeT [ 30 ] , ACT [ 42 ] , Diffusion Policy [ 8 ] , UMI [ 9 ] , and DP3 [ 41 ] provide visuomotor control. Furthermore, approaches like SPiRL [ 26 ] demonstrate the effectiveness of skill priors for accelerating downstream tasks. However, these monolithic policies struggle to maintain logical consistency over long horizons, as decisions made at one stage often depend on latent state constraints accumulated from earlier interactions, making them brittle to error propagation. II-B VLMs for Task Planning and Long-Horizon Execution LLMs and VLMs have shown strong capabilities for task decomposition and semantic reasoning [ 1 , 19 ] , and reward-driven skill synthesis [ 40 , 24 ] . They serve as zero-shot planners via code generation [ 21 ] , PDDL representations [ 22 , 38 ] , or structured programs [ 33 ] . Embodied agents such as PaLM-E [ 10 ] , DeCo [ 7 ] , VoxPoser [ 18 ] , and OWMM-Agent [ 6 ] integrate visual inputs with sequential sub-task generation, while ReAct [ 37 ] synergizes reasoning and acting. To ground these planners, SayPlan [ 27 ] leverages 3D scene graphs for large-scale LLM planning, and GRID [ 25 ] encodes scene graphs via graph attention

Read the complete text