MemGuide: Intent-Driven Memory Selection for Goal-Oriented Multi-Session LLM Agents
Yiming Du, Bingbing Wang, Yang He, Bin Liang, Baojun Wang, Zhongyang Li, Lin Gui, Jeff Z. Pan, Ruifeng Xu, Kam-Fai Wong · 2025
Read MemGuide: Intent-Driven Memory Selection for Goal-Oriented Multi-Session LLM Agents by Yiming Du, Bingbing Wang, Yang He, Bin Liang, Baojun Wang, Zhongyang Li, Lin Gui, Jeff Z. Pan, Ruifeng Xu, Kam-Fai Wong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20231.txt.
Introduction
Yiming Du and co-authors select memories for chat agents by intent in this 2025 paper. Task chatbots that serve users over many sessions lean on stored memories. Picking memories by word likeness alone misses the user's goal, and talks lose their thread.
Their two-stage system, MemGuide, first matches the current talk to stored intent notes and pulls memories with the same goal. Then a slot check hunts what facts are still missing and filters by them. Step-by-step reasoning guides the second stage. The aim is memory that serves the task, not just the topic. Longer, goal-driven service talks are the target.
Catalog record
| CREATOR | Yiming Du, Bingbing Wang, Yang He, Bin Liang, Baojun Wang, Zhongyang Li, Lin Gui, Jeff Z. Pan, Ruifeng Xu, Kam-Fai Wong |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-20231
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MemGuide: Intent-Driven Memory Selection for Goal-Oriented Multi-Session LLM Agents Yiming Du, Bingbing Wang, Yang He, Bin Liang, Baojun Wang, Zhongyang Li, Lin Gui, Jeff Z. Pan, Ruifeng Xu, Kam-Fai Wong Abstract Modern task-oriented dialogue (TOD) systems increasingly rely on large language model (LLM) agents, leveraging Retrieval-Augmented Generation (RAG) and long-context capabilities for long-term memory utilization. However, these methods are primarily based on semantic similarity, overlooking task intent and reducing task coherence in multi-session dialogues. To address this challenge, we introduce MemGuide , a two-stage framework for intent-driven memory selection. (1) Intent‑Aligned Retrieval matches the current dialogue context with stored intent descriptions in the memory bank, retrieving QA‑formatted memory units that share the same goal. (2) Missing‑Slot Guided Filtering employs a chain‑of‑thought slot reasoner to enumerate unfilled slots, then uses a fine‑tuned LLaMA‑8B filter to re‑rank the retrieved units by marginal slot‑completion gain. The resulting memory units inform a proactive strategy that minimizes conversational turns by directly addressing information gaps. Based on this framework, we introduce the MS-TOD 1 1 1 Code and dataset will be released upon paper acceptance. , the first multi-session TOD benchmark comprising 132 diverse personas, 956 task goals, and annotated intent-aligned memory targets, supporting efficient multi‑session task completion. Evaluations on MS-TOD show that MemGuide raises the task success rate by 11% (88%→99%) and reduces dialogue length by 2.84 turns in multi-session settings, and maintains parity with single‑session benchmarks. 1 The Chinese University of Hong Kong, 2 Harbin Institute of Technology, Shenzhen 3 The Hong Kong University of Science and Technology, 4 Huawei Noah’s Ark Lab, 5 King’s College London, 6 The University of Edinburgh, {ydu, kfwong}@se.cuhk.edu.hk, [email protected] Figure 1: Task-oriented dialogue, without ( left ) vs. with ( right ) multi-session memory; the former demands more turns of conversation. Introduction Modern task-oriented dialogue (TOD) systems increasingly integrate large language models (LLMs) to enhance generalization, context understanding, and response generation ( Nguyen et al. 2025 ; Xu et al. 2024a ; Xu et al. 2024b ; Chung et al. 2023 ; Hudeček and Dusek 2023 ) . To utilize historical dialogue states across turns, two dominant strategies have emerged: retrieval-augmented generation (RAG), which supplements the LLM with relevant task descriptions or prior dialogue states ( Xu et al. 2024a ; Xu et al. 2024b ) , and the use of long-context models, which encode the entire history directly as input ( Nguyen et al. 2025 ) . However, they are both limited to surface-level semantic similarity, often ignoring the task-specific intent and slot-level continuity crucial for coherent multi-session TOD. While memory-augmented methods ( Lu et al. 2023 ) have emerged, they are often evaluated on single-session benchmarks that lack support for long-term goal tracking and multi-session memory supervision. Unlike open-domain settings that focus on free-form recall ( Zhong et al. 2024 ) , task-oriented dialogue demands structured slot tracking, evolving intent management, and consistent state maintenance. Crucially, real-world users frequently interact with assistants across multiple sessions to accomplish complex goals, yet most existing TOD models and datasets ( Budzianowski et al. 2018 ; Rastogi et al. 2020 ; Stacey et al. 2024 ; Liu et al. 2024a ) are confined to single-session settings, highlighting a fundamental gap between current TOD systems and the demands of persistent, goal-driven dialogue settings. As shown in Figure 1 , traditional single-session TOD systems require users to restate details (e.g., flight times, seat preferences) in every session, leading to inefficiency and frustration. To address this, we propose MemGuide , a novel framework that utilizes long-term memory in the multi-session TOD task. Unlike prior methods that rely solely on semantic similarity for memory selection, MemGuide incorporates task intent and slot-level guidance to enhance memory relevance and response quality. It consists of two core phases: (1) Intent-Aligned Retrieval , where an LLM generates an intent hypothesis based on the current dialogue state and retrieves memory units aligned with the predicted goal, ensuring retrieved history is both semantically similar and goal-consistent to support cross-session task tracking robustly. (2) Missing-Slot Guided Filtering , which first employs a chain-of-thought (CoT) slot reasoner to detect missing slot values, followed by a filtering module that removes irrelevant or redundant Question Answering (QA) memory units to distill slot-level content for response generation. These two phases enable MemGuide to convert long-term user history into actionable context, supporting minimal-turn, task-consistent dialogue generation across sessions. To enable systematic evaluation, we construct the Multi-Session Task-oriented Dialogue (MS-TOD) , a new benchmark comprising 132 simulated speakers, each engaging in over 20 sessions covering diverse task goals derived from Schema-Guided Dialogue (SGD) ( Rastogi et al. 2020 ) . MS-TOD supports evaluation of slot continuity and long-term memory retrieval across sessions. Unlike open-domain benchmarks focused on retrieving dialogue summaries ( Zhong et al. 2024 ; Li et al. 2024a ; Du et al. 2024 ) , multi-session TOD introduces additional challenges. Systems must recall key slot-value pairs, track evolving user intents, and proactively resolve missing or outdated information, while minimizing redundant interactions. To support automatic evaluation, we introduce a proactive response generation module to simulate user engagement and evaluate system performance in resolving missing information. Experimental results demonstrate that MemGuide significantly improves dialogue coherence, response quality, task success rate, and overall efficiency in multi-session TOD. The main contributions include: • We propose MemGuide , a two-stage framework that distills and leverages cross-session memory for efficient, minimal-turn task completion. • We introduce MS-TOD , the first multi-session TOD dataset and benchmark task for evaluating long-term memory integration across sessions. • We demonstrate that MemGuide consistently outperforms strong baselines across multiple metrics, demonstrating the effectiveness of intent-aware memory retrieval and slot-guided filtering. Related Work Task-Oriented Dialogue Dataset TOD datasets are typically constructed via either Machine-to-Machine (M2M) ( Shah et al. 2018 ; Rastogi et al. 2020 ) or Wizard-of-Oz (WOz) setups ( Wen et al. 2017 ; Budzianowski et al. 2018 ) . M2M datasets (e.g., SGD, STAR) provide schema-driven task flows, while WOz-based datasets (e.g., MultiWOZ, FRAMES) offer more natural but annotation-heavy dialogues. Recent efforts aim to improve realism and domain diversity ( Hu et al. 2023 ; Dai et al. 2022 ; Xu et al. 2024b ; Li et al. 2024b ) , yet existing benchmarks primarily assume single-session tasks. There remains a notable gap in datasets designed for multi-session TOD, where tracking long-range goals and user intents is essential. Task-Oriented Dialogue Systems Traditional TOD systems adopt modular pipelines for NLU, DST, and response generation ( Wu et al. 2019a ; Peng et al. 2018 ) , later unified into end-to-end models trained on annotated dialogues ( Wen et al. 2017 ; Wang et al. 2020 ) . With the rise of LLMs, recent work explores their use in zero-shot and fine-tuned TOD ( Madotto et al. 2021 ; Bang, Lee, and Koo 2023 ) , often achieving strong results on intent recognition and slot filling. In parallel, long-term memory (LTM) methods such as ChitChat ( Li et al. 2024c ) , MemoryBank ( Zhong et al. 2024 ) , and LoCoMo ( Maharana et al. 2024 ) support extended context retention through summarization or heuristic filtering, but lack structured memory aligned with task goals. Most assume single-session dialogues and overlook challenges in maintaining multi-session goal