CAIM: Development and Evaluation of a Cognitive AI Memory Framework for Long-Term Interaction with Intelligent Agents

Rebecca Westhäußer, Frederik Berenz, Wolfgang Minker, Sebastian Zepf · 2025

Read CAIM: Development and Evaluation of a Cognitive AI Memory Framework for Long-Term Interaction with Intelligent Agents by Rebecca Westhäußer, Frederik Berenz, Wolfgang Minker, Sebastian Zepf (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-13044.txt.

Introduction

Rebecca Westhäußer and co-authors present CAIM in 2025, a memory framework for long talks with intelligent agents. Large language models still struggle to adapt to a user and recall context across sessions.

CAIM draws on ideas about human thought and memory. A central controller decides what to store and fetch, a retrieval part filters the right data for each reply, and a post-thinking part keeps storage in order. Tests against rival frameworks show better recall accuracy, reply correctness, context fit, and storage use. The authors argue the design can improve long-term human and AI interaction.

Catalog record

CREATORRebecca Westhäußer, Frederik Berenz, Wolfgang Minker, Sebastian Zepf
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-13044

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CAIM: Development and Evaluation of a Cognitive AI Memory Framework for Long-Term Interaction with Intelligent Agents Rebecca Westhäußer, Frederik Berenz, Wolfgang Minker, Sebastian Zepf Abstract . Large language models (LLMs) have advanced the field of artificial intelligence (AI) and are a powerful enabler for interactive systems. However, they still face challenges in long-term interactions that require adaptation towards the user as well as contextual knowledge and understanding of the ever-changing environment. To overcome these challenges, holistic memory modeling is required to efficiently retrieve and store relevant information across interaction sessions for suitable responses. Cognitive AI, which aims to simulate the human thought process in a computerized model, highlights interesting aspects, such as thoughts, memory mechanisms, and decision-making, that can contribute towards improved memory modeling for LLMs. Inspired by these cognitive AI principles, we propose our memory framework CAIM. CAIM consists of three modules: 1.) The Memory Controller as the central decision unit; 2.) the Memory Retrieval, which filters relevant data for interaction upon request; and 3.) the Post-Thinking, which maintains the memory storage. We compare CAIM against existing approaches, focusing on metrics such as retrieval accuracy, response correctness, contextual coherence, and memory storage. The results demonstrate that CAIM outperforms baseline frameworks across different metrics, highlighting its context-awareness and potential to improve long-term human-AI interactions. Conference: ; ; 1. Introduction Advancements in LLMs, such as GPT-3.5 ( Brown et al., 2020 ) , are reshaping the interaction between humans and AI systems. These models allow direct and seamless communication through natural language. This offers new opportunities for human-computer interaction, contributing to their adoption across diverse domains ( Chen et al., 2023 ; Ning et al., 2024 ; Liu et al., 2023 ) . These advancements led to a growing area of research focused on utilizing LLMs to develop AI agents with human-like capabilities, such as decision-making and planning ( Cui et al., 2024 ; Zhong et al., 2024 ) . While LLMs have advanced the field of AI, they still have shortcomings that hinder their ability to emulate human intelligence as they do not understand the ever-changing environment ( Xie et al., 2023 ) . Furthermore, some LLMs are constrained by limited context windows, which negatively impacts their ability to understand and memorize historical information over extended periods ( Xu et al., 2022 ) , hindering their effectiveness in long-term interactions ( Packer et al., 2023 ; Sun, 2024 ; Zhong et al., 2024 ; Liu et al., 2023 ; Ram et al., 2023 ) . Although models such as GPT-4o ( Hurst et al., 2024 ) or Gemini ( Team et al., 2024 ) offer larger context windows, it is crucial to keep the input concise to ensure high performance, as longer inputs may reduce efficiency and potentially overwhelm the model ( Lu et al., 2024 ) . Maintaining contextual understanding is critical to ensure meaningful interactions and understand user behavior ( Zhong et al., 2024 ) . Therefore, remembering information from the past and correctly referencing it in ongoing conversations is crucial in long-term interactions ( Bae et al., 2022 ) . Without a long-term memory (LTM), LLMs also face challenges in delivering personalized responses. Personalization stands as an important connection that bridges the gap between humans and machines, as understanding the user’s preferences is fundamental to adapting to their evolving needs and ensuring user satisfaction and engagement ( Woźniak et al., 2024 ; Chen et al., 2024 ; Eapen and Adhithyan, 2023 ; Wu et al., 2024 ; Kirmayr et al., 2025 ) . Various studies emphasize the importance of personalization in building a relationship with AI assistants. For example, Lee et al. ( Lee et al., 2012 ) indicate that adding personalized services enhances user engagement with an assistant. Similarly, Ligthart et al. ( Ligthart et al., 2022 ) and Kirmayr et al. ( Kirmayr et al., 2025 ) indicate that personalization fosters closeness, maintains the user’s interest over time, and adds continuity to interactions across sessions. These challenges highlight the need for a context-aware memory mechanism that effectively manages input limits and proficiently draws on information from past conversations to improve long-term interactions and personalization. In this context, methods such as reinforcement learning from human feedback ( Woźniak et al., 2024 ; Wu et al., 2024 ; Salemi et al., 2024 ) have shown promising approaches to improve the long-term capabilities of LLMs. Their practical application is often limited due to retraining the model, which is challenging and often impossible for models accessible only via API ( Ram et al., 2023 ; Salemi et al., 2024 ; Lee et al., 2023 ) . This paper focuses on retrieval-augmented methods as a practical and effective approach to equip LLMs with a memory mechanism without retraining the model, leaving the architecture unchanged. By utilizing external knowledge sources, memory-augmented methods address the limitation of a limited context window and enable the integration of past information into the current input prompt ( Ram et al., 2023 ; Wang et al., 2023 ; Liu et al., 2023 ; Packer et al., 2023 ; Sumers et al., 2023 ; Xu, 2021 ; Lewis et al., 2020 ; Zhang et al., 2023 ) . While memory-augmented methods are already used to extend the general memory capabilities of LLMs, the existing approaches lack a context-aware mechanism and still fall short in achieving human-like performance in this regard. To address these limitations, insights from cognitive AI offer a promising perspective to enable LLMs to operate more contextually aware ( Sun, 2024 ; Zhao et al., 2022 ) . Cognitive AI intends to let computers think, reason, and make decisions similarly to humans, by mimicking their cognitive processes ( Zhao et al., 2022 ) . Therefore, incorporating insights from human cognition is promising to contribute to the development of more capable and reliable systems. Sun ( Sun, 2024 ) discusses the principles of Cognitive AI and their potential when bringing them together with LLMs. He argues that integrating these principles with LLMs can enhance several aspects, including information retention and retrieval, decision-making in dynamic environments, self-reflection, and interpersonal interactions. Building on the potential of both memory-augmented methods and cognitive AI principles to achieve a more robust, human-like, and context-aware memory mechanism for LLMs, we propose CAIM, a C ognitive AI M emory Framework for LLMs. In addition to Cognitive AI, CAIM builds upon three existing memory-augmented approaches - MemoryBank, Think-in-Memory, and Self-Controlled Memory - by combining and extending their concepts to create a more holistic memory mechanism. Specifically, our approach consists of three modules (see Figure 2 ) and addresses aspects of human memory, such as active decision-making, by positioning the LLM as a central decision unit involved in recalling memories, filtering retrieved information for contextual relevance, and determining which data to store in memory. Ultimately, CAIM aims to enhance long-term interactions by improving the memory capabilities of LLMs, which serves as a critical first step toward developing AI agents that act in a personalized manner and adapt to individual users over time. In particular, CAIM addresses the following challenges of LLMs and existing approaches by combining a memory-augmented approach and cognitive AI principles. Challenge 1: Lack of an effective LTM. Current LLMs are not designed

Read the complete text