From Entity-Centric to Goal-Oriented Graphs: Enhancing LLM Knowledge Retrieval in Minecraft

Jonathan Leung, Yongjie Wang, Zhiqi Shen · 2025

Read From Entity-Centric to Goal-Oriented Graphs: Enhancing LLM Knowledge Retrieval in Minecraft by Jonathan Leung, Yongjie Wang, Zhiqi Shen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18607.txt.

Introduction

Jonathan Leung, Yongjie Wang, and Zhiqi Shen restructure game knowledge for language models in a 2025 paper. Step-by-step procedures, like crafting chains in Minecraft, trip up chat models that reason loosely. Retrieval systems built on entity graphs hand back scattered facts, not a plan.

Their goal-oriented graphs flip the layout: each node is a goal, and edges show what must come first. Retrieval then walks a goal's prerequisites in order, handing the model a coherent chain. On Minecraft tests, the goal graphs beat graph-based retrieval and other strong baselines by a wide margin on multi-step tasks. The approach targets any domain where order matters.

Catalog record

CREATORJonathan Leung, Yongjie Wang, Zhiqi Shen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-18607

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

From Entity-Centric to Goal-Oriented Graphs: Enhancing LLM Knowledge Retrieval in Minecraft Jonathan Leung, Yongjie Wang, Zhiqi Shen Abstract Large Language Models (LLMs) demonstrate impressive general capabilities but often struggle with step-by-step procedural reasoning, a critical challenge in complex interactive environments. While retrieval-augmented methods like GraphRAG attempt to bridge this gap, their fragmented entity-relation graphs hinder the construction of coherent, multi-step plans. In this paper, we propose a novel framework based on Goal-Oriented Graphs (GoGs), where each node represents a goal and edges encode logical dependencies between them. This structure enables the explicit retrieval of causal reasoning paths by identifying a high-level goal and recursively retrieving its prerequisites, forming a coherent chain to guide the LLM. Through extensive experiments on the Minecraft testbed, a domain that demands robust multi-step planning and provides rich procedural knowledge, we demonstrate that GoG substantially improves procedural reasoning and significantly outperforms GraphRAG and other state-of-the-art baselines. 1 Introduction Large Language Models (LLMs) have recently been applied as reasoning and planning components in interactive environments, where they enable dynamic decision-making for agents such as non-player characters (NPCs) and virtual assistants. Games, in particular, have become valuable testbeds for studying the reasoning capabilities of LLMs because they combine structured rules with open-ended objectives ( Gallotta et al., 2024 ) . While early research has explored strategic domains like chess ( Feng et al., 2023 ) , the frontier has moved toward open-world settings that demand long-horizon, hierarchical goal decomposition. Environments like Minecraft ( Wang et al., 2024 ; Zhu et al., 2023 ) have emerged as critical benchmarks for this challenge due to their combinatorial action space and the need for multi-step procedural reasoning. To ground LLMs in such complex domains, Retrieval-Augmented Generation (RAG) has become a standard approach ( Gao et al., 2023 ) . State-of-the-art methods like GraphRAG ( Edge et al., 2025 ) structure external knowledge into entity-relation graphs to facilitate retrieval. However, this entity-centric paradigm is fundamentally ill-suited for procedural tasks. It fragments causal knowledge into an excessive number of low-granularity triples, making it difficult to reconstruct a coherent, step-by-step plan. This is not just a theoretical issue; in our experiments, this fragmentation introduces significant noise that hinders the agent’s performance. Figure 1 : GraphRAG extracts an excessive number of low-granularity entity–relation triples, which hinders effective reasoning over fragmented information. In contrast, our GoG captures procedural knowledge through goal hierarchies, thereby supporting coherent and structured reasoning. Reconstructing a coherent plan from this fragmented knowledge is akin to the saying, “tearing paper is easy, putting it back together is hard”, illustrated in Figure 1 . This motivates our work: to design a knowledge framework that explicitly captures procedural dependencies. We introduce the Goal-Oriented Graph (GoG), a novel structure where nodes represent goals and directed edges encode the prerequisite relationships between them. Using this graph, our retrieval process identifies a high-level goal and recursively retrieves its subgoals, forming a coherent reasoning chain to guide the LLM. We focus on Minecraft as a deep and open-ended benchmark for multi-step reasoning rather than as a generic game environment. While the GoG framework is conceptually general, in this work we explicitly target domains where procedural knowledge can be externalized into goal–precondition structures, and we do not claim applicability to arbitrary game environments. This focused scope allows us to rigorously evaluate how goal-oriented knowledge retrieval improves LLM reasoning in a well-studied, reproducible setting. Our contributions are summarized as follows: 1. We introduce Goal-Oriented Graphs (GoGs), a novel framework designed to enhance the procedural, multi-step reasoning of LLMs. GoG is designed to leverage external procedural descriptions that can be organized into goals, preconditions, and postconditions, a common characteristic of instructional and technical domains. GoGs model how complex tasks decompose into actionable subgoals, shifting the paradigm from entity-centric relations to logical goal dependencies. 2. We propose a goal-driven retrieval algorithm that traverses the GoG to construct coherent and explicit reasoning chains, overcoming the fragmented retrieval of traditional graph-based methods for procedural tasks. 3. We validate our framework through extensive experiments in Minecraft, a demanding benchmark for long-horizon procedural planning, demonstrating its effectiveness in Minecraft and, more broadly, in domains characterized by structured, goal-oriented procedural knowledge. 2 Related Work LLM-Based Agents have been proposed for Minecraft. For example, Voyager is an agent that learns skills via lifelong learning ( Wang et al., 2024 ) . MP5 ( Qin et al., 2024 ) focuses on leveraging multimodal LLMs to perform planning based on what the agent sees. Unlike these methods, our method aims to improve an agent’s performance by using goal-oriented knowledge extracted from text sources. Two methods that are more closely related to ours are GITM ( Zhu et al., 2023 ) and Optimus-1 ( Li et al., 2024 ) . GITM uses text knowledge from the Minecraft Wiki and in-game recipes, as does our method. However, we focus on the construction of Goal-Oriented Graphs from text sources and the retrieval process for planning. On the other hand, GITM is presented as a unified agent system. Optimus-1 is a Minecraft agent that contains a hierarchical knowledge graph that is used to decompose goals into subgoals. However, the process by which their graph is created is different from ours as it only uses recipes from the game files, and their agent is focused on the utilization of multimodal memory. Reasoning using LLMs is a popular research area that aims to enable LLMs to handle more complex tasks. There are a wide variety of methods, including those that alter the prompt to encourage the LLM to output intermediate steps ( Wei et al., 2022 ) , provide feedback from the environment to the LLM so that it can adjust its behaviour accordingly ( Yao et al., 2023 ; Shinn et al., 2023 ) , maintain and expand multiple generated reasoning sequences ( Yao et al., 2023 ) , and use majority choice voting ( Wang et al., 2023 ) . RAG-Based Systems aim to address LLMs’ knowledge gaps. RAG maintains a vector database of source documents that can be retrieved and given to the LLM as context information according to the embedding similarity of the source documents to a given query ( Lewis et al., 2020 ) . However, if the answer to a given query spans across several documents, then the retrieval process may fail to contain the answer. Therefore, GraphRAG and its variants were proposed to address this issue ( Edge et al., 2025 ; Wu et al., 2024 ; Guo et al., 2024 ) . Hierarchical Decomposition is a traditional method in AI to break complex problems into smaller sub-problems that has been used in areas including planning ( Ghallab et al., 2004 ; Erol et al., 1994 ) and reinforcement learning ( Dietterich et al., 1998 ; Sutton et al., 1999 ) . These methods typically rely on domain knowledge or hand-crafted rules to establish the hierarchy of tasks. In this work, we aim to construct a hierarchy of goals in the form of a graph by constructing it from text data sources. 3 Methodology Figure 2 : An overview of our proposed method GoG. First, we construct a knowledge base of goals from source text documents. Then, given a task

Read the complete text