GET: Goal-directed Exploration and Targeting for Large-Scale Unknown Environments

Lanxiang Zheng, Ruidong Mei, Mingxin Wei, Hao Ren, Hui Cheng · 2025

Read GET: Goal-directed Exploration and Targeting for Large-Scale Unknown Environments by Lanxiang Zheng, Ruidong Mei, Mingxin Wei, Hao Ren, Hui Cheng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20828.txt.

Introduction

Lanxiang Zheng, Ruidong Mei, Mingxin Wei, Hao Ren, and Hui Cheng wrote this 2025 robotics paper on searching for objects in large unknown places. A robot that must find an object outdoors faces a hard task. The space is wide, unstructured, and may change as the search goes on.

Their framework, called GET, joins language model reasoning with lessons from past searches. Large language models bring strong meaning skills, but they ground poorly in space and lack a good memory for past tries. At the core of GET sits a reasoning module called DoUT. It makes choices in real time through a role-based feedback loop. The loop weighs task rules and outside memory as the search unfolds. The aim is steady, grounded choices across a long search, not one-off guesses.

Catalog record

CREATORLanxiang Zheng, Ruidong Mei, Mingxin Wei, Hao Ren, Hui Cheng
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-20828

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

GET: Goal-directed Exploration and Targeting for Large-Scale Unknown Environments Lanxiang Zheng, Ruidong Mei, Mingxin Wei, Hao Ren, Hui Cheng Abstract Object search in large-scale, unstructured environments remains a fundamental challenge in robotics, particularly in dynamic or expansive settings such as outdoor autonomous exploration. This task requires robust spatial reasoning and the ability to leverage prior experiences. While Large Language Models (LLMs) offer strong semantic capabilities, their application in embodied contexts is limited by a grounding gap in spatial reasoning and insufficient mechanisms for memory integration and decision consistency.To address these challenges, we propose GET (Goal-directed Exploration and Targeting), a framework that enhances object search by combining LLM-based reasoning with experience-guided exploration. At its core is DoUT (Diagram of Unified Thought), a reasoning module that facilitates real-time decision-making through a role-based feedback loop, integrating task-specific criteria and external memory. For repeated tasks, GET maintains a probabilistic task map based on a Gaussian Mixture Model, allowing for continual updates to object-location priors as environments evolve.Experiments conducted in real-world, large-scale environments demonstrate that GET improves search efficiency and robustness across multiple LLMs and task settings, significantly outperforming heuristic and LLM-only baselines. These results suggest that structured LLM integration provides a scalable and generalizable approach to embodied decision-making in complex environments. 1 Introduction Object searching is a fundamental task in mobile robotics, with broad applications in service robotics [ 1 ] , search-and-rescue [ 2 ] , and autonomous exploration [ 3 ] . Achieving efficient and reliable object search in complex environments requires robots to perceive their surroundings, reason about spatial layouts, and make sequential decisions in real time [ 4 ] . Despite recent progress, object search remains a challenging problem, particularly in large-scale, unstructured environments. Traditional approaches typically rely on hand-crafted search strategies or heuristic exploration rules [ 5 , 6 , 7 ] , which often fail to generalize across diverse tasks and environments. Recent advances in deep learning and reinforcement learning have led to notable improvements by enabling data-driven policies [ 8 , 9 , 10 ] . However, these methods still face generalization issues due to their reliance on exhaustive and task-specific training data, as well as their limited ability to reason about spatial semantics or incorporate historical experiences. To address these shortcomings, Large Language Models (LLMs) have emerged as a promising alternative, offering strong contextual understanding and high-level reasoning capabilities [ 5 , 6 , 7 ] . By analyzing environmental descriptions and inferring semantic cues, LLMs can guide robot exploration with more adaptive and informed strategies. However, their application to 3D object search remains limited due to several key challenges: weak spatial perception [ 11 ] , dependence on extensive prompt tuning or fine-tuning [ 12 ] , and difficulty in maintaining robust and consistent performance in dynamic or unstructured environments. Moreover, LLMs lack effective mechanisms for recording or retrieving task-specific historical knowledge, making it challenging to leverage accumulated past experiences [ 13 , 14 ] . These limitations become particularly pronounced in large-scale or outdoor settings, where the spatial correspondence between objects and their surroundings becomes diffuse, increasing ambiguity and complicating the generalization of search strategies across tasks and environments. To address these limitations, we introduce a novel framework called GET (Goal-directed Exploration and Targeting). GET leverages the contextual reasoning capabilities of Large Language Models (LLMs), enhanced by a new reasoning improvement module, the Diagram of Unified Thought (DoUT), designed specifically to refine decision-making without extensive task-specific pretraining. In the DoUT module, an LLM-generated proposal is iteratively refined through evaluative feedback from an independent evaluator model, promoting self-improvement in real-time decision-making. Additionally, GET incorporates a Gaussian Mixture Model (GMM)-based probabilistic approach to explicitly represent and update historical search experiences. This probabilistic representation incrementally updates the target object’s spatial distribution, effectively addressing the limitations of LLMs in utilizing historical data and providing robust guidance for repeated search tasks. The main contributions of this paper are summarized as follows: • We propose GET, a novel LLM-based framework for goal-directed exploration and target localization in large-scale environments, integrating semantic reasoning with probabilistic experience modeling. • We introduce DoUT, a general-purpose reasoning enhancement module that facilitates iterative and adaptive decision-making in real time, avoiding the need for extensive task-specific annotations. • We present a GMM-based probabilistic experience model that allows for explicit memory of prior tasks, supporting incremental updates and the gradual fading of outdated information to accelerate the efficiency of repeated search tasks. • We validate the proposed method through real-world experiments, demonstrating improved efficiency and performance in challenging large-scale environmentss. Figure 1: The GET framework consists of several modules: The Perception module converts panoramic images and point clouds into semantic point clouds. The Memory model features a real-time updated semantic octomap and a multi-layered task probability map that record the environment and historical experiences. The Decision-Making module operates in two modes: reasoning search, where the DoUT module infers potential target locations to guide the robot’s search process, and experience-based search, where the robot utilizes historical data and the semantic octomap to locate the target and plan search routes. Finally, the Trajectory Refinement module optimizes the robot’s path for safe, smooth, and continuous navigation. 2 Related Work 2.1 Target Search Methods Numerous effective methods are dedicated to object searching tasks. Traditional approaches often rely on predefined search strategies and Simultaneous Localization and Mapping (SLAM), involving detailed path planning and grid-based mapping with various sensors and predetermined rules [ 15 , 16 , 17 ] . However, their effectiveness heavily depends on sensor accuracy [ 16 , 17 ] and the quality of environmental models [ 18 , 15 , 6 ] . While effective, these methods lack flexibility to adapt to diverse search targets and perform poorly in large-scale, unstructured environments. Neural network methods [ 19 , 20 , 10 , 21 ] enhance robotic capabilities through advanced data-driven models. For instance, Pandey and Parhi [ 19 ] proposed a behavior-based neural network for trajectory planning and target search in mobile robots, improving adaptability in dynamic environments. Ye et al. [ 20 ] integrated CNN and Transformer architectures in UAV systems for robust real-time object detection in high-speed scenarios. End-to-end methods, such as SenseAct-NN in GOAT-Bench [ 10 ] and GOAT [ 21 ] , directly map sensor inputs to navigation paths, improving flexibility but relying heavily on large-scale labeled training data, limiting scalability in data-scarce environments. Reinforcement learning (RL) methods [ 22 , 23 , 24 , 25 ] also show promise in target search tasks. Kulkarni et al. [ 8 ] introduced h-DQN, a hierarchical RL framework that efficiently solves long-horizon tasks with sparse rewards. Luo et al. [ 23 ] extended RL to multi-UAV cooperative target search, optimizing energy efficiency in large environments. Zhu et al. [ 24 ] combined visual observations and goal representations for indoor navigation. Fang et al. [ 25 ] enhanced navigation by integrating imitation learning with deep RL. Ye et al. [ 9 ] employed a hierarchical policy framework to improve RL-based search methods in complex environments. DRL-Searcher [ 26 ] enhances adaptability and efficiency in target search tasks without relying on the target’s motion model. Despite strong performance, these RL methods face challenges related to large-scale training data and

Read the complete text