MMAG: Mixed Memory-Augmented Generation for Large Language Models Applications

Stefano Zeppieri · 2025

Read MMAG: Mixed Memory-Augmented Generation for Large Language Models Applications by Stefano Zeppieri (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-01710.txt.

Introduction

Stefano Zeppieri adds mixed memory to language model generation. Models write coherent text in one prompt. Across long chats they lose relevance, personal fit, and continuity. Human talk rests on many memory types at once. Past chats, traits, and context all guide each reply.

MMAG mixes those memory forms for the model. Recalled chats ground facts. Trait memory tunes tone and choice. Context memory tracks the present scene. Mixed memory aims for replies that stay on thread over long use, like a good human partner in talk. Mixed forms also degrade gracefully, since a lost trait memory still leaves chat recall to keep the exchange on solid ground.

Catalog record

CREATORStefano Zeppieri
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-01710

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MMAG: Mixed Memory-Augmented Generation for Large Language Models Applications Stefano Zeppieri Abstract Large Language Models (LLMs) excel at generating coherent text within a single prompt but fall short in sustaining relevance, personalization, and continuity across extended interactions. Human communication, however, relies on multiple forms of memory, from recalling past conversations to adapting to personal traits and situational context. This paper introduces the Mixed Memory-Augmented Generation (MMAG) pattern, a framework that organizes memory for LLM-based agents into five interacting layers: conversational, long-term user, episodic and event-linked, sensory and context-aware, and short-term working memory. Drawing inspiration from cognitive psychology, we map these layers to technical components and outline strategies for coordination, prioritization, and conflict resolution. We demonstrate the approach through its implementation in the Heero conversational agent, where encrypted long-term bios and conversational history already improve engagement and retention. We further discuss implementation concerns around storage, retrieval, privacy, and latency, and highlight open challenges. MMAG provides a foundation for building memory-rich language agents that are more coherent, proactive, and aligned with human needs. Keywords: Large Language Models, Memory-Augmented Generation, Conversational Agents, User Personalization, Human–AI Interaction 1 Introduction Large Language Models (LLMs) have achieved remarkable progress in generating fluent and contextually appropriate text. Yet most current systems operate within the boundaries of a single prompt or, at best, a limited conversational window. This constraint makes it difficult for agents to sustain meaningful, personalized, and context-rich interactions over time. By contrast, human communication depends on memory [ 15 ] : we recall past discussions, adapt to personal preferences, and build on shared experiences. Without memory, LLMs risk remaining reactive tools that reset with every session rather than evolving into trusted collaborators. Recent work has begun to explore memory-augmented systems, but many approaches still treat memory as either a flat retrieval store or an extended context buffer. Such designs improve access to past information but do not capture the diversity of memory functions that shape human dialogue. Human cognition distinguishes between short-term recall, long-term factual knowledge, episodic experiences, and context awareness, each playing a distinct role in communication [ 10 ] . Bringing this perspective into LLM design can help move beyond longer contexts toward richer and more adaptive interactions. To address this need, we propose the Mixed Memory-Augmented Generation (MMAG) pattern. MMAG organizes memory into five interacting types: conversational history, long-term user traits, episodic and event-linked knowledge, sensory and context-aware signals, and short-term working memory. This taxonomy draws inspiration from cognitive psychology while mapping directly to technical components such as vector databases, structured stores, and event triggers. By coordinating across layers, agents can recall relevant past exchanges, adapt tone and recommendations, surface timely reminders, and remain sensitive to environmental context without overwhelming users. We implement and study MMAG in the Heero conversational agent 1 1 1 https://heero.me/ , a language learning platform where continuity and personalization are crucial for engagement. Even with a partial deployment that combines conversational history with encrypted long-term bios, Heero demonstrates tangible improvements in user retention and conversation length. These results highlight the practical value of modular memory design and motivate further extensions. The rest of this paper introduces the MMAG taxonomy, discusses coordination and implementation strategies, and reports on user-facing outcomes. We close with a discussion of opportunities and risks, as well as open challenges in balancing technical performance, user autonomy, and ethical responsibility when building memory-rich agents. 2 Related Work The integration of memory into large language models has become a growing area of interest as researchers and practitioners seek to extend the capabilities of LLMs beyond short-lived prompts. Early efforts focused on retrieval-augmented generation (RAG) methods, which dynamically pull relevant documents from external sources. More recent work has shifted toward deeper and more structured forms of memory that aim to simulate aspects of human cognition, including long-term memory, episodic recall, and contextual awareness. MemGPT [ 12 ] is a representative example of this trend. It treats memory as a system-level construct, organizing context into long-term and working memory and introducing scheduling mechanisms that mimic operating system processes. This helps the model maintain relevant information across conversations without bloating the context window. Similarly, Retentive Networks [ 8 ] offer architectural improvements to improve long-range coherence, introducing structured memory representations directly into the model’s design. These systems show that expanding memory capabilities isn’t just about scaling up context size but rethinking how memory is organized and accessed. Another line of work has focused on hybrid approaches that combine storage and retrieval strategies. MemoryBank [ 19 ] , for instance, proposes a two-tiered memory system that uses dense retrieval for semantic matching and sparse memory for temporal relevance. This framework supports long-term personalization and adapts to user interaction patterns over time. On the applied side, Medium articles such as Nigam’s guide to memory-augmented RAG [ 11 ] and Kim’s tutorial on modern LLM memory techniques [ 6 ] walk through practical strategies for managing memory in real-world systems, including the use of time-based triggers and structured memory stores. As memory-augmented systems proliferate, researchers have begun to ask how well these systems actually remember. Tan et al. [ 16 ] explore this question directly, analyzing how LLMs retain and forget information across sessions. Similarly, Maharana et al. [ 7 ] propose evaluation methods for long-term memory in dialogue agents, focusing on the alignment between remembered content and user expectations. LongMemEval [ 17 ] introduces a comprehensive benchmarking suite that enables developers to evaluate memory retrieval, relevance, and latency in long-term interactive settings under a unified framework. Surveys and conceptual papers have also helped shape the field. Wu et al. [ 18 ] present “From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMs,” a thorough taxonomy of memory components in LLM systems, while Paul’s overview [ 14 ] highlights the emerging consensus on the need for modular, human-aligned memory structures. Both emphasize the importance of distinguishing between different types of memory, such as conversational, biographical, and contextual, and recognizing their distinct roles in interaction. Finally, applied perspectives from industry, such as the IBM Research blog on memory-augmented LLMs [ 4 ] , help bridge the gap between research and deployment. These sources focus on practical concerns like latency, privacy, and system design, factors that are essential when building memory-rich systems meant to operate in open-ended, real-world settings. Our work builds on this foundation by proposing a unified pattern, that we call Mixed Memory-Augmented Generation (MMAG), that organizes memory across several distinct but interacting components. Unlike approaches that treat memory as a single block or retrieval mechanism, MMAG introduces a layered system that reflects the diversity of memory types found in human interaction, including biographical data, time-sensitive cues, and situational context. 3 Memory Taxonomy Memory in human cognition is not monolithic; it consists of multiple interdependent systems with distinct functions. Cognitive psychology differentiates between episodic memory, semantic memory, working memory, and procedural memory, among others. Inspired by this framework, we organize memory for LLM-based agents into five categories: conversational, long-term user, episodic and event-linked, sensory and context-aware, and short-term working memory. Each type captures a different dimension of interaction, and together they form a taxonomy that supports richer, more human-aligned behavior. This taxonomy both mirrors human

Read the complete text