L3M+P: Lifelong Planning with Large Language Models
Krish Agarwal, Yuqian Jiang, Jiaheng Hu, Bo Liu, Peter Stone · 2025
Read L3M+P: Lifelong Planning with Large Language Models by Krish Agarwal, Yuqian Jiang, Jiaheng Hu, Bo Liu, Peter Stone (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-01917.txt.
Introduction
Krish Agarwal and four co-authors present a 2025 paper on robots that plan tasks with help from large language models. Past systems pair a language model with a classic planner, but they treat each task as a one-off job. A home robot, by contrast, must recall a home that changes over time.
Their system, L3M+P, stores the state of the world in a knowledge graph. The graph can be updated from sensors and from plain speech with people, and rules keep the updates in a fixed, clean form. When a new task comes, the robot pulls what it needs from the graph to plan.
Catalog record
| CREATOR | Krish Agarwal, Yuqian Jiang, Jiaheng Hu, Bo Liu, Peter Stone |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-01917
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
L3M+P: Lifelong Planning with Large Language Models Krish Agarwal, Yuqian Jiang, Jiaheng Hu, Bo Liu, Peter Stone Abstract By combining classical planning methods with large language models (LLMs), recent research such as LLM+P has enabled agents to plan for general tasks given in natural language. However, scaling these methods to general-purpose service robots remains challenging: (1) classical planning algorithms generally require a detailed and consistent specification of the environment, which is not always readily available; and (2) existing frameworks mainly focus on isolated planning tasks, whereas robots are often meant to serve in long-term continuous deployments, and therefore must maintain a dynamic memory of the environment which can be updated with multi-modal inputs and extracted as planning knowledge for future tasks. To address these two issues, this paper introduces L3M+P (Lifelong LLM+P), a framework that uses an external knowledge graph as a representation of the world state. The graph can be updated from multiple sources of information, including sensory input and natural language interactions with humans. L3M+P enforces rules for the expected format of the absolute world state graph to maintain consistency between graph updates. At planning time, given a natural language description of a task, L3M+P retrieves context from the knowledge graph and generates a problem definition for classical planners. Evaluated on household robot simulators and on a real-world service robot, L3M+P achieves significant improvement over baseline methods both on accurately registering natural language state changes and on correctly generating plans, thanks to the knowledge graph retrieval and verification. I INTRODUCTION Large language models (LLMs) have proven to be very promising natural language (NL) interfaces in a variety of domains, including Robotics [ 1 ] . However, their lack of grounding in the physical world prevents them from being used effectively as direct planners in “agentic” systems [ 2 ] . A large body of work has thus been motivated toward grounding LLM-based agents to bridge the gap between human-friendly interfaces and consistent, accurate planning [ 3 , 4 , 5 , 6 , 7 , 8 ] . However, applying these recent advancements to general-purpose service robots remains difficult. A primary challenge is that these robots are meant to serve their function over an extended period of time, and any actions they take must be grounded in a dynamic , real-world environment. We can consider the following two cases to see why an LLM alone is insufficient for interfacing with a service robot, and an external structured memory is required. Suppose a human in the environment informs the service robot on events that have taken place in the environment. These events affect the state of the environment, in turn affecting future planning performed by the service robot. An LLM-only solution might keep track of these events by accumulating them into a report and feeding this report as context to the LLM whenever a planning query is processed. However, the report can grow arbitrarily long, so this approach is prone to model hallucination, which can significantly affect the accuracy of the agent [ 9 ] . As such, the LLM-based agent must have an external memory. Of course, it is unreasonable to expect a human to report every event that takes place in an environment. Specifically, a service robot can be expected to consume not only human dialogue but also sensor input to gain knowledge about the environment. Solutions already exist for traditional knowledge representation in service robots that can be updated based on sensor input [ 10 , 11 , 12 ] . In order to use robot perception alongside human dialogue, an LLM must be able to interact with a unified memory that is compatible with a traditional knowledge representation system. Fig. 1 : L3M+P enables a household robot to keep a dynamic memory of verbal interactions and other sensory inputs and plan for long-horizon natural language tasks. Top: robot interactions with the environment and users for a sequence of tasks. Bottom: task planning and memory updates. This motivation leads us to develop the L3M+P framework for augmenting existing research on grounded LLM-based agents with a dynamic, structured memory. L3M+P interfaces with this memory as follows. 1. It uses a LLM-based natural language interface for updating the memory given NL descriptions of environment updates. 2. It integrates with robot perception so the memory can be updated based on sensory input. 3. It retrieves relevant information from the memory that can be used as context within an existing LLM-based, grounded planner. The rest of this paper is organized as follows: Section II provides preliminary information for the modules in L3M+P. Section III introduces the formalisms used in this paper. Section IV explains the implementation of each component of L3M+P. Section V discusses experiments and results. Finally, Section VI highlights recent work related to L3M+P. II BACKGROUND II-A Planning with Language Models LLM+P [ 4 ] is a framework for combining LLMs with classical planning to bridge the gap between NL task descriptions and symbolic planners. These planners operate using the planning domain definition language (PDDL), a commonly-used language to formalize environments and tasks [ 13 , 14 ] . A PDDL domain defines the state-action space through (a) a set of predicates that can fully represent a state and (b) a set of actions for manipulating the current state. A PDDL problem specifies a set of initial predicates (representing the initial state) and a set of goal conditions (identifying one or more goal states). Given an initial state description, a task description, and a domain, LLM+P prompts an LLM to generate a PDDL problem that a symbolic planner can use along with the domain to generate a plan. L3M+P extends LLM+P by removing the requirement for a description of the initial state and instead maintaining the current state in a knowledge base that can be used to extract information relevant to a given planning task. II-B Knowledge Graphs Knowledge graphs [ 15 ] are representations that organize information into graph structures, where nodes represent entities and edges represent relationships between entities. A knowledge graph can be constructed from various sources, including structured databases, unstructured text, or other forms of data. Similar to traditional databases, graph databases also generally support structured querying, such as through the Cypher query language [ 16 ] . The relationship between a pair of nodes in a knowledge graph is commonly referred to as a triplet of subject, predicate, and object. We work with the following triplet forms: • (subject, relationship, object) • (subject, property, boolean) L3M+P uses a knowledge graph to represent the world state for a general-purpose robot. II-C Retrieval-Augmented Generation Many applications of LLMs involve answering domain-specific queries. One approach for adapting a pretrained model to this purpose is to fine-tune the model on domain-specific knowledge [ 17 ] . However, this method can be expensive and is not versatile to changes in knowledge. Retrieval-augmented generation (RAG) is a method for augmenting language models with external knowledge sources [ 18 ] . Context from an external knowledge source is retrieved based on a user-prompt and fed alongside the original prompt to the language model in order to provide the model with sufficient information to answer the prompt. Our framework has a