RoamFlow: Reinforcement-Aligned One-Step Action MeanFlow Policy for Image-Goal Navigation ∗ Equal contribution. † Corresponding author.

Zixuan Zhang, Yuqi Chen, Junjie Gao, Siyuan Song, Yongzhou Pan, Beichen Wang, Mir Feroskhan · 2026

Read RoamFlow: Reinforcement-Aligned One-Step Action MeanFlow Policy for Image-Goal Navigation ∗ Equal contribution. † Corresponding author. by Zixuan Zhang, Yuqi Chen, Junjie Gao, Siyuan Song, Yongzhou Pan, Beichen Wang, Mir Feroskhan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-29934.txt.

Introduction

Zhang and six colleagues present RoamFlow, a policy for image-goal navigation, where a robot must reach a place shown only in a goal image. Step-by-step policies often act myopically, missing long-range structure, while generative policies that draft whole trajectories are slow to run.

RoamFlow uses MeanFlow, a method that predicts the average velocity field of a trajectory, to synthesise action sequences in a single generation step, cutting inference delay. Training runs in two stages: expert imitation first for a stable start, then reinforcement learning, training by reward, to refine the policy for the task. In Habitat simulation and on real robots, RoamFlow keeps strong navigation performance while running fast enough for real-time control.

Catalog record

CREATORZixuan Zhang, Yuqi Chen, Junjie Gao, Siyuan Song, Yongzhou Pan, Beichen Wang, Mir Feroskhan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.29934

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

RoamFlow: Reinforcement-Aligned One-Step Action MeanFlow Policy for Image-Goal Navigation ∗ Equal contribution. † Corresponding author. Zixuan Zhang, Yuqi Chen, Junjie Gao, Siyuan Song, Yongzhou Pan, Beichen Wang, Mir Feroskhan Abstract Image-goal navigation is a key challenge in embodied robotics, where an agent must reach a target specified solely by a goal image. While existing reinforcement learning approaches map perceptual observations directly to actions, they struggle to model long-horizon dependencies, often leading to suboptimal trajectories. To address this limitation, we propose RoamFlow , a generative navigation framework that leverages MeanFlow to predict the average velocity field for trajectory synthesis, enabling efficient few-step generation and reducing inference latency. We further adopt a two-stage training strategy that combines expert imitation for stable initialization with reinforcement learning for task-specific policy refinement. Extensive experiments in both Habitat simulation and real-world robotic platforms demonstrate that RoamFlow achieves efficient inference while maintaining strong navigation performance under real-time constraints. I INTRODUCTION Image-goal navigation [ 37 ] is a central problem in embodied robotics, where an agent must reach a target location specified solely by a goal image using onboard sensory observations. Existing reinforcement learning approaches [ 29 , 14 , 3 ] typically adopt end-to-end policies that map perceptual observations directly to actions. While such methods demonstrate robustness to perceptual noise and environment uncertainty, their step-wise action prediction paradigm struggles to capture long-horizon dependencies. As a result, these policies often exhibit myopic behaviors and produce suboptimal trajectories in complex environments where multi-step planning and global reasoning are required. To address this limitation, recent studies reformulate navigation as a trajectory distribution modeling problem within generative frameworks. Instead of predicting single-step actions, generative policies synthesize coherent multi-step action sequences, enabling trajectory-level reasoning and alleviating short-sighted decision-making. Representative approaches include diffusion-based methods such as NoMaD [ 24 ] and conditional flow matching methods such as FlowNav [ 6 ] . By modeling a distribution over trajectories, these methods improve long-horizon coherence and allow multimodal trajectory prediction. Fig. 1: Comparison of different generative policies for image-goal navigation: (a) Traditional Diffusion Policy, which requires multiple iterations, leading to long inference time; (b) Distillation Diffusion Policy, which reduces inference time to a single step but sacrifices trajectory quality; (c) RoamFlow Policy, the proposed method, which utilizes a single-step generation mechanism while maintaining high-quality performance. Fig. 2: Overview of the two-stage training pipeline. The policy is pretrained via imitation learning (IL) and then fine-tuned with reinforcement learning (RL). The current RGB-D observation and the goal image are encoded and fused into a joint latent representation, which conditions a MeanFlow-based trajectory generator to produce candidate trajectories and a trajectory evaluator head to select safe, goal-directed behaviors. However, despite these advantages, generative navigation policies still face two fundamental challenges. First, their inference efficiency remains limited by inherently iterative generation processes. Diffusion-based policies require multiple denoising steps to generate each trajectory, while flow-based methods still depend on step-wise numerical integration of learned velocity fields. Such iterative procedures introduce non-negligible computational latency, hindering real-time deployment on resource-constrained robotic platforms. Distillation-based acceleration methods [ 27 , 16 , 34 ] attempt to reduce inference steps by approximating multi-step teacher distributions, but aggressive compression often degrades trajectory quality and diversity. Second, most generative navigation policies rely primarily on imitation learning. Although offline demonstrations provide useful trajectory priors, imitation alone cannot correct suboptimal expert behaviors or adapt to unseen environments during deployment. As a result, policies trained purely with imitation may accumulate long-horizon errors and fail to align trajectory generation with task-level objectives such as efficient goal reaching and collision avoidance. Motivated by these limitations, we propose RoamFlow, a generative navigation framework that combines efficient trajectory generation with reinforcement learning for task-driven refinement. RoamFlow leverages the MeanFlow [ 5 ] model to predict the average velocity field that transports Gaussian noise to the target action sequence. By modeling interval-level displacement instead of instantaneous velocity, the proposed policy significantly reduces the number of required transport steps, leading to more efficient inference while preserving trajectory quality. To further enhance task performance, RoamFlow adopts a two-stage training strategy. The policy is first initialized via offline imitation learning to capture expert navigation priors. Subsequently, reinforcement learning is applied in the Habitat simulation environment [ 21 ] to refine the trajectory policy using task-specific rewards, enabling the agent to better align trajectory generation with navigation objectives. In this work, our contributions are summarized as follows: • We propose a MeanFlow-based generative navigation policy that predicts the average velocity field, enabling efficient few-step trajectory generation and reducing inference latency. • We introduce a two-stage training framework that combines offline imitation learning for stable initialization with reinforcement learning for task-driven policy refinement. • We validate the proposed framework in both Habitat simulation and real-world robotic experiments, demonstrating efficient inference and strong navigation performance. II Related Work II-A Generative Policies for Navigation Recent studies have explored diffusion models [ 9 ] for trajectory generation in navigation tasks, where policies iteratively transform Gaussian noise into structured trajectories, effectively capturing complex, multi-modal action distributions. For example, NoMaD [ 24 ] formulates navigation as a diffusion-based policy and generates multi-modal action sequences conditioned on visual observations, improving robustness in previously unseen environments. NaviDiffusor [ 32 ] further incorporates gradient guidance derived from environmental constraints and task costs during the diffusion process, thereby enhancing the safety and feasibility of the generated trajectories. NaviBridger [ 18 ] introduces a diffusion bridge [ 35 ] formulation that conditions the generative process on an informative prior action distribution rather than pure Gaussian noise, which improves generation stability and facilitates long-horizon trajectory synthesis. To further improve sampling efficiency, recent work has investigated flow-based generative formulations for navigation. In particular, FlowNav [ 6 ] adopts Conditional Flow Matching (CFM) [ 12 ] to learn continuous transport dynamics in trajectory space, enabling more efficient trajectory generation while preserving expressive modeling capacity. Despite these advances in trajectory modeling, most existing methods still rely on iterative sampling or numerical integration during inference, which introduces considerable computational overhead and poses challenges for real-time deployment on resource-constrained robotic platforms. II-B Fast Sampling for Diffusion Models Reducing the inference cost of generative models has become an important research direction, motivating a number of approaches that aim to reduce the number of sampling steps. A common strategy is knowledge distillation [ 10 , 13 ] , which compresses a multi-step generative process into a few-step or single-step generator. For example, Progressive Distillation [ 20 ] progressively compresses the sampling procedure of diffusion models, enabling significantly faster generation. Distribution Matching Distillation (DMD) [ 27 ] further learns a one-step generator by matching the output distribution of the original diffusion model. In addition, Consistency Models [ 23 ] learn a consistency mapping that enables few-step or even single-step sampling while preserving the learned data distribution. Beyond distillation-based approaches, recent work has explored intrinsically one-step generative formulations. In particular, MeanFlow models [ 5 ] the average velocity field of the transport dynamics between distributions, allowing samples to be generated with a single forward pass of the network. II-C Reinforcement Learning for Generative Policies Deep reinforcement learning (DRL) [ 22 , 7 ] has recently been explored to further improve generative policies beyond imitation learning. Diffusion policies are typically trained

Read the complete text