MemRec: Collaborative Memory-Augmented Agentic Recommender System
Weixin Chen, Yuhan Zhao, Jingyuan Huang, Zihe Ye, Clark Mingxuan Ju, Tong Zhao, Neil Shah, Li Chen, Yongfeng Zhang · 2026
Read MemRec: Collaborative Memory-Augmented Agentic Recommender System by Weixin Chen, Yuhan Zhao, Jingyuan Huang, Zihe Ye, Clark Mingxuan Ju, Tong Zhao, Neil Shah, Li Chen, Yongfeng Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-08816.txt.
Introduction
Weixin Chen and eight co-authors build a pick system that learns from a shared store of past likes. Old pick tools store likes as scores or as dense codes. New agent tools store likes as text notes. But each agent keeps its own notes, so group signs are lost. A song one user loves may guide a pick for a like user.
Their system is called MemRec. It lets agents share a joint note store built from a graph of users and items. The hard part is to pull rich graph facts in with out flooding the agent. The team also needs fast ways to keep the store fresh. A reader who builds picks gets a shared mind plan for agent teams.
Catalog record
| CREATOR | Weixin Chen, Yuhan Zhao, Jingyuan Huang, Zihe Ye, Clark Mingxuan Ju, Tong Zhao, Neil Shah, Li Chen, Yongfeng Zhang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 84 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-08816
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MemRec: Collaborative Memory-Augmented Agentic Recommender System Weixin Chen, Yuhan Zhao, Jingyuan Huang, Zihe Ye, Clark Mingxuan Ju, Tong Zhao, Neil Shah, Li Chen, Yongfeng Zhang Abstract The evolution of recommender systems has shifted preference storage from rating matrices and dense embeddings to semantic memory in the agentic era. Yet existing agents rely on isolated memory, overlooking crucial collaborative signals. Bridging this gap is hindered by the dual challenges of distilling vast graph contexts without overwhelming reasoning agents with cognitive load, and evolving the collaborative memory efficiently without incurring prohibitive computational costs. To address this, we propose MemRec , a framework that architecturally decouples reasoning from memory management to enable efficient collaborative augmentation. MemRec introduces a dedicated, cost-effective LM Mem \text{LM}_{\text{Mem}} to manage a dynamic collaborative memory graph, serving synthesized, high-signal context to a downstream LLM Rec \text{LLM}_{\text{Rec}} . The framework operates via a practical pipeline featuring efficient retrieval and cost-effective asynchronous graph propagation that evolves memory in the background. Extensive experiments on four benchmarks demonstrate that MemRec achieves state-of-the-art performance. Furthermore, architectural analysis confirms its flexibility, establishing a new Pareto frontier that balances reasoning quality, cost, and privacy through support for diverse deployments, including local open-source models. Code: https://github.com/rutgerswiselab/memrec Homepage: https://memrec.weixinchen.com 2 2 footnotetext: Authors affiliated with Snap Inc. served in advisory roles only for this work. 3 3 footnotetext: Corresponding author. 1 Introduction Memory has long served as a foundational component in Recommender Systems (RS). The field has evolved from capturing preferences through sparse rating matrices in conventional collaborative filtering era 27 ; 13 to using dense latent embeddings in the deep learning era 3 ; 8 . Recently, the emergence of agentic RS, powered by Large Language Models (LLMs), has ushered in a new paradigm, i.e., semantic memory 39 ; 46 . In agentic RS, memory is transformed into a semantic format, enabling LLMs to perform complex reasoning and use tools with natural language as the substrate 47 . For an agent to be more than a stateless function, it must utilize this persistent memory to retain and evolve its user understanding through ongoing interactions 40 ; 22 . The evolution of memory mechanisms in this context can be delineated into three key milestones: (1) No explicit memory , relying solely on the LLM’s inherent knowledge 16 ; 18 ; (2) Static memory , characterized by retrieving context from fixed storage 42 ; 5 ; and recently (3) Dynamic, self-reflective memory , where agents iteratively update their understanding over time 30 ; 45 . (a) (b) Figure 1: (a) Existing Agents interact with user and item memories through separate, isolated read/write channels. (b) MemRec performs collaborative operations on memory graph, enabling global connectivity. However, these approaches predominantly represent non-collaborative paradigms. As illustrated in Figure 1(a) , current agents typically reflect only on their siloed history with a user ( M_{u} ) or item ( M_{i} ) 42 ; 45 . This isolates them from the most potent signal in recommender systems, i.e., global collaboration. The high-order connectivity of the broader user-item graph, essential for capturing community trends and serendipitous discoveries, remains largely untapped by existing agentic frameworks 35 ; 7 . A seemingly intuitive solution for bridging this gap is to inject raw collaborative neighborhoods directly into the agent’s memory. However, this naïve brute-force approach proves inadequate for at least two critical reasons: • Cognitive Overload. While the agent may be able to access large quantities of neighbor memories, it struggles to effectively distill pertinent information from this abundance. The sheer volume of textual and structural signals increases difficulty for the reasoning agent to identify salient knowledge 17 , as validated in § 3.3 . • Prohibitive Collaborative Updates. Our system requires propagating dynamic updates throughout the graph neighborhood. However, this naive approach that synchronously updates every user- or item-related neighborhood graph necessitates redundant, independent LLM calls for each interaction, resulting in an intractable computational bottleneck within the primary reasoning loop. Consequently, a core challenge emerges: How can we distill extensive collaborative knowledge into memory to empower the reasoning agent, while ensuring efficient evolution of the graph? To address these challenges, we introduce MemRec (Figure 1(b) ), a framework built upon architectural decoupling to shift from isolated to collaborative memory. By dedicating a separate Memory Manager ( \text{LM}_{\text{Mem}} ) to manage a dynamic graph and synthesize compact grounding, this architecture systematically resolves both cognitive overload and update bottlenecks. Firstly, addressing cognitive overload during retrieval, our Collaborative Memory Retrieval method overcomes the limitations of isolated memory paradigms. Instead of relying solely on siloed user or item memory, it leverages LLM-guided domain-adaptive rules to curates neighbor signals to synthesize a compact, high-utility collaborative memory. Secondly, overcoming update bottlenecks, we develop an Asynchronous Collaborative Propagation mechanism inspired by Label Propagation 49 . It efficiently batches self-reflection and neighbor updates into a single asynchronous operation and achieves constant-time ( O(1) ) interaction complexity, ensuring continuous graph evolution without incurring the computational penalties of redundant, independent updates. Extensive evaluations on four benchmarks show that MemRec achieves state-of-the-art performance. Furthermore, our architectural analysis demonstrates MemRec’s flexibility, establishing a new Pareto frontier that balances reasoning quality, computational cost, and deployment constraints, supporting diverse setups from cloud-native APIs to on-premise local models. Figure 2: The overall framework of MemRec , decoupling reasoning ( \text{LLM}_{\text{Rec}} ) from memory management ( \text{LM}_{\text{Mem}} ). The three-stage pipeline consists: Collaborative Memory Retrieval , synthesizing high-order connectivity context from memory graph; Grounded Reasoning , scoring items based on instruction and context; and Asynchronous Collaborative Propagation , evolving the semantic memory graph in the background. 2 Methodology Problem Formulation Let \mathcal{U} and \mathcal{I} denote the sets of users and items, respectively. For each user u\in\mathcal{U} , we denote their historical interactions as H_{u} . Given a target user u , a natural language instruction \mathcal{I}_{u} requiring semantic interpretation (e.g., specific constraints, complex goals), and a set of candidate items C\subseteq\mathcal{I} , the objective is to generate a ranked list of recommendations accompanied by grounded justifications. Memory in Agentic RS In agentic RS, memory serves as the persistent state, storing information in semantic form to evolve user understanding over time. Specifically, for each entity (user u or item i ), systems typically maintain an individual semantic memory, denoted as M_{u} or M_{i} . These memories are evolving textual narratives summarizing preferences, characteristics, and historical contexts. During recommendation, a reasoning agent \text{LLM}_{\text{Rec}} leverages these memories to perform the task. Despite these advancements, existing agentic RS predominantly adhere to an isolated memory paradigm. They treat the collective memory M merely as a disconnected set of individual memories \{M_{u}\}\cup\{M_{i}\} . For instance, reasoning for user u relies solely on their personal siloed memory M_{u} derived from history H_{u} . This isolation excludes critical collaborative signals from the broader community, hindering the system’s ability to fully leverage collective intelligence. 2.1 The MemRec Pipeline To address this limitation, MemRec introduces a collaborative framework featuring an architecturally decoupled Memory Manager ( \text{LM}_{\text{Mem}} ). This manager operates on a unified memory graph G=(\mathcal{V},E) . The node set \mathcal{V}=\mathcal{U}\cup\mathcal{I} represents users and items, where each node v\in\mathcal{V} stores its corresponding evolving semantic memory M_{v} . The edges E encode interactions and derived relations connecting these memories. Unlike approaches relying solely on