Recurrent Reasoning with Vision-Language Models for Estimating Long-Horizon Embodied Task Progress
Yuelin Zhang, Sijie Cheng, Chen Li, Zongzhao Li, Yuxin Huang, Yang Liu, Wenbing Huang · 2026
Read Recurrent Reasoning with Vision-Language Models for Estimating Long-Horizon Embodied Task Progress by Yuelin Zhang, Sijie Cheng, Chen Li, Zongzhao Li, Yuxin Huang, Yang Liu, Wenbing Huang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-17312.txt.
Introduction
Zhang and co-authors present a recurrent reasoning vision language model for estimating progress on long embodied tasks. Judging progress matters for agents that plan multi step work, but reading whole long videos is costly. Their model works through short video snippets in turn. A growing chain of thought holds the context: the task split, key steps, and what is done so far. Training data were generated at scale from ALFRED and Ego4D. Tests show a new state of the art in progress estimation.
Catalog record
| CREATOR | Yuelin Zhang, Sijie Cheng, Chen Li, Zongzhao Li, Yuxin Huang, Yang Liu, Wenbing Huang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62650 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.17312
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Recurrent Reasoning with Vision-Language Models for Estimating Long-Horizon Embodied Task Progress Yuelin Zhang, Sijie Cheng, Chen Li, Zongzhao Li, Yuxin Huang, Yang Liu, Wenbing Huang Abstract Accurately estimating task progress is critical for embodied agents to plan and execute long-horizon, multi-step tasks. Despite promising advances, existing Vision-Language Models (VLMs) based methods primarily leverage their video understanding capabilities, while neglecting their complex reasoning potential. Furthermore, processing long video trajectories with VLMs is computationally prohibitive for real-world deployment. To address these challenges, we propose the Recurrent Reasoning Vision-Language Model ( R 2 \text{R}^{2} VLM). Our model features a recurrent reasoning framework that processes local video snippets iteratively, maintaining a global context through an evolving Chain of Thought (CoT). This CoT explicitly records task decomposition, key steps, and their completion status, enabling the model to reason about complex temporal dependencies. This design avoids the high cost of processing long videos while preserving essential reasoning capabilities. We train R 2 \text{R}^{2} VLM on large-scale, automatically generated datasets from ALFRED and Ego4D. Extensive experiments on progress estimation and downstream applications, including progress-enhanced policy learning, reward modeling for reinforcement learning, and proactive assistance, demonstrate that R 2 \text{R}^{2} VLM achieves strong performance and generalization, achieving a new state-of-the-art in long-horizon task progress estimation. The models and benchmarks are publicly available at huggingface . 1 Introduction Accurately estimating task progress is essential for embodied agents in performing complex, multi-step tasks. By observing and recording actions, agents must assess their advancement toward the goal, including what has been completed and what remains. This internal tracking of progress enables long-horizon planning and context-aware decision-making. For instance, to address the query “Please make me a cup of coffee”, an agent can proceed to the subtask navigate_to_coffee_machine if pick_cup is 100% complete; and it can trigger a recovery behavior if progress stalls. Figure 1 : \text{R}^{2} VLM performs multi-turn recurrent reasoning. It takes a video snippet and the CoT from the previous iteration as input, and outputs the updated CoT and a progress estimation. Recently, GVL Du et al. 2023 and ROVER Schroeder et al. 2025 have explored using Vision-Language Models (VLMs) for task progress estimation. However, their approaches primarily leverage VLMs’ video understanding capabilities and large context windows, leaving their reasoning potential underexplored. Accurately estimating progress in long-horizon, egocentric tasks remains highly challenging for two main reasons. First, embodied tasks often consist of multiple subtasks with complex temporal dependencies. A model must therefore reason about these dependencies and align them with visual observations. Second, the long video trajectories involved incur substantial computational and time costs when processed by VLMs, rendering such approaches impractical for real-world deployment. Addressing these challenges is essential to developing a progress estimation model that is stable, accurate, and practical for real-world use. In this work, we introduce the R ecurrent R easoning V ision- L anguage M odel ( \text{R}^{2} VLM) for long-horizon embodied task progress estimation. As illustrated in Fig. 2 , \text{R}^{2} VLM introduces two key innovations to address the aforementioned challenges. First, analogous to standard reasoning VLMs, we endow \text{R}^{2} VLM with a Chain of Thought (CoT) that precedes its final progress estimation, which equips the model with the reasoning capability needed to handle complex temporal dependencies between subtasks. Our CoT is specifically designed to record the high-level task decomposition, the required key steps, and their completion status. Second, unlike standard VLMs, our model performs recurrent reasoning over local video snippets rather than the full, long video. At each temporal iteration, \text{R}^{2} VLM updates its CoT by integrating the historical CoT with the currently observed video snippet. This strategy provides two major benefits: it avoids the redundant overhead of processing a large number of visual tokens, and it maintains crucial global context through the evolving CoT, even when visual inputs are locally restricted. To evaluate the progress estimation capability in long-horizon embodied tasks, we conduct experiments on both the simulated ALFRED dataset Shridhar et al. 2020 and real-world Ego4D dataset Grauman et al. 2022 . Specifically, we develop an automated data generation pipeline to build a large-scale, multi-turn incremental video interaction dataset for training and evaluating. Experimental results demonstrate that \text{R}^{2} VLM achieves superior performance across the two benchmarks and four metrics, validating the effectiveness of both recurrent reasoning and specifically designed rewards. Furthermore, we extensively explore three potential downstream applications, including progress-enhanced embodied policy learning, reward modeling for online reinforcement learning, and step-wise proactive assistance. Extensive experiments confirm that \text{R}^{2} VLM exhibits strong generalization ability and promising application potential for embodied AI research. 2 Related Work Large Pre-trained Models as Progress Estimator. In embodied and robotic tasks, many prior studies have explored using large models to give progress estimation. Early methods Ma et al. 2022 ; Ma et al. 2023 fine-tune pretrained image or text encoders and compute the feature distance between the current observation and the goal state to represent progress. However, these methods operate primarily at the image level and fail to capture temporal processes, leading to degraded performance in long-horizon tasks. Many video-based works leverage the context window of VLMs to naturally maintain global information. GVL Du et al. 2023 and ROVER Schroeder et al. 2025 are two methods based on in-context learning, which design innovative prompting strategies or inference trajectories to enhance the VLMs’ progress estimation capability. However, as these methods fully depend on pretrained VLMs and overlook the VLMs’ reasoning capabilities, their performance remains limited on complex long-horizon tasks. Although Du et al. 2023 fine-tunes Flamingo as a success detector, it only provides sparse binary feedback. In contrast, our model integrates temporal modeling of long-horizon multi-step execution with reinforcement learning, enabling stronger reasoning and delivering dense, accurate progress estimation. Reward Modeling for Long-Horizon Tasks. Early reward learning often uses inverse reinforcement learning (IRL; Ng et al. 2000 ; Kumar et al. 2023 ; Krishnan et al. 2016 ), which infers latent rewards from expert demonstrations but is unstable under noise and hard to scale to long horizons. For long-horizon manipulation tasks, many studies Hung et al. 2024 ; Chen et al. 2025 have proposed hierarchical reward frameworks. These methods decompose complex tasks into multi-level subtasks according to the semantics and sequentially estimate the reward at different levels. In contrast, our model supports end-to-end reward modeling, directly using progress changes inferred from visual observations as rewards. Without manual hierarchical decomposition, it learns task decomposition and reasoning strategies inherently through training. This enables smooth, context-aware reward signals for long-horizon tasks while maintaining interpretability and robustness. Figure 2 : Framework of \text{R}^{2} VLM. It performs recurrent reasoning over the newly observed video snippet, while incorporating the historical CoT as context. The CoT records the completed, pending, and incomplete steps from earlier video snippets and is dynamically updated throughout the recurrent reasoning process. The model estimates task progress based on the proportion of completed steps, and supports diverse applications including progress estimation, reward modeling, and proactive assistance. 3 \text{R}^{2} VLM In this section, we introduce the core design and training strategy of \text{R}^{2} VLM. We begin by formally defining the progress estimation task in Section 3.1 . Then, we present the proposed recurrent reasoning framework in Section 3.2 . In Section 3.3 , we describe the automated dataset construction pipeline. Finally,