AI-native Memory 2.0: Second Me
Jiale Wei Xiang Ying Tao Gao Fangyi Bao Felix Tao Jingbo Shang · 2025
Read AI-native Memory 2.0: Second Me by Jiale Wei Xiang Ying Tao Gao Fangyi Bao Felix Tao Jingbo Shang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-08102.txt.
Introduction
Jiale Wei and five co-authors introduced in 2025 an AI-native memory system meant to end repetitive form-filling across digital life. People restate the same facts to every site, app, and soon every AI agent. Saved passwords and autofill patch only part of that burden.
Their system, called Second Me, stores and organizes a person's knowledge and speaks for them when asked. It can fill fields, draft context-aware replies, and smooth contact with services. The design treats memory as a standing assistant rather than a static vault. Privacy and control questions sit at the center of the proposal.
Catalog record
| CREATOR | Jiale Wei Xiang Ying Tao Gao Fangyi Bao Felix Tao Jingbo Shang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-08102
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AI-native Memory 2.0: Second Me Jiale Wei Xiang Ying Tao Gao Fangyi Bao Felix Tao Jingbo Shang Abstract Human interaction with the external world fundamentally involves the exchange of personal memory, whether with other individuals, websites, applications, or, in the future, AI agents. A significant portion of this interaction is redundant, requiring users to repeatedly provide the same information across different contexts. Existing solutions, such as browser-stored credentials, autofill mechanisms, and unified authentication systems, have aimed to mitigate this redundancy by serving as intermediaries that store and retrieve commonly used user data. The advent of large language models (LLMs) presents an opportunity to redefine memory management through an AI-native paradigm: Second Me . Second Me acts as an intelligent, persistent memory offload system that retains, organizes, and dynamically utilizes user-specific knowledge. By serving as an intermediary in user interactions, it can autonomously generate context-aware responses, prefill required information, and facilitate seamless communication with external systems, significantly reducing cognitive load and interaction friction. Unlike traditional memory storage solutions, Second Me extends beyond static data retention by leveraging LLM-based memory parameterization. This enables structured organization, contextual reasoning, and adaptive knowledge retrieval, facilitating a more systematic and intelligent approach to memory management. As AI-driven personal agents like Second Me become increasingly integrated into digital ecosystems, Second Me further represents a critical step toward augmenting human-world interaction with persistent, contextually aware, and self-optimizing memory systems. We have open-sourced the fully localizable deployment system at GitHub: https://github.com/Mindverse/Second-Me . 1 Introduction Human interaction with the external world relies heavily on memory, whether recalling information in conversations or repeatedly providing personal data across digital platforms. This redundancy leads to cognitive fatigue and disrupts seamless engagement with technology. Existing solutions, such as autofill mechanisms and unified authentication systems, help alleviate some of this burden by storing and retrieving commonly used data. However, they function as static repositories without contextual reasoning or adaptability, requiring users to manually manage and verify their information, resulting in a fragmented and suboptimal experience. The rise of large language models (LLMs) offers a transformative opportunity to redefine memory management through an AI-native approach. As shown in Figure 1 , we introduce Second Me , an intelligent, persistent memory offload system that serves as a dynamic intermediary in human-machine interactions. Unlike traditional storage solutions, Second Me is an adaptive, context-aware assistant that autonomously retrieves, organizes, and applies user-specific knowledge. Leveraging LLM-based memory parameterization as envisioned in Shang et al. (2024) , Second Me enhances structured knowledge organization, contextual reasoning, and adaptive retrieval for seamless digital interactions. In this work, we explore diverse data sources and training styles, integrating supervised fine-tuning (SFT) and direct preference optimization (DPO) ( Rafailov et al., 2024 ) to enhance LLM performance. We introduce three key tasks with automated LLM evaluation to assess the model’s effectiveness in personal AI applications: (1) memory-based multi-perspective Q&A, (2) context completion based on user needs, and (3) context critique incorporating user preferences and external responses. To support these tasks, we design an LLM-driven automated data synthesis strategy that integrates local and global data perspectives, a multi-agent framework, and Chain-of-Thought (CoT) ( Wei et al., 2023 ) style synthesis. Our experiments show that using diverse data sources with strong CoT-style normalization yields the best Second Me performance in automated evaluations. Additionally, human case studies suggest that Second Me ’s true effectiveness may surpass reported metrics, as LLM-based evaluations tend to underestimate its quality. To the best of our knowledge, we propose the first fully automated post-training pipeline based on personal document records, using the trained personal model as the core of a multi-layer hybrid system. This Second Me system would serve as a new paradigm for future personalized LLM applications. We have open-sourced the fully localizable deployment system at GitHub: https://github.com/Mindverse/Second-Me . Given Second Me ’s strong performance, we anticipate a vast range of applications in the near future. As an extension of human memory, Second Me reduces cognitive effort by preemptively providing relevant information, auto-completing forms, recalling past interactions, and maintaining context across applications. Beyond mere storage, it functions as a self-optimizing AI agent that learns, adapts, and refines its understanding of user preferences and behaviors. As AI-driven personal memory agents like Second Me integrate into digital ecosystems, they usher in a new era of human-AI collaboration. By enhancing memory retention and retrieval in a contextually aware manner, Second Me streamlines digital interactions, reduces friction, and improves efficiency, enabling a more seamless and intelligent exchange of knowledge. Furthermore, Second Me has the potential to facilitate networked intelligence , where multiple agents collaborate, share relevant insights, and coordinate tasks across different applications and users. Figure 1 : Hybrid Architecture of Second Me 2 An Overview of Second Me We envision Second Me as a Context Provider. It acts as a bridge between users, future AI agents, and the broader information world, facilitating seamless interaction. It is an evolved version of the Large Personal Model (LPM) ( Shang et al., 2024 ) , which was proposed by us last year, a three-layer system centered around personalized memory management. From a technical perspective, Second Me has further refined the Hybrid framework design and validated the iteration of personalized models, ensuring the system’s efficiency and adaptability in addressing complex demands. Second Me not only represents the cutting edge of our current technology but also embodies our product philosophy at this stage — reflecting our commitment to personalized and intelligent interactions. 2.1 Large Personal Model (LPM) 1.0: A Recap As we argued in Shang et al. (2024) , AI-native memory is a must-have component towards Artificial General Intelligence (AGI). Through experiments, we showed that LLMs with ultra long context capabilities fall short, both in terms of performance and cost, especially in searching, organizing, and reasoning with complex user memory. We proposed that a memory system shall have data across three layers: • L0: Raw Data Layer. This layer is akin to applying RALM ( Ram et al., 2023 ) or RAG ( Lewis et al., 2020 ) directly to raw data, defining memory as the entirety of unstructured data. • L1: Natural Language Memory Layer. This layer encompasses memories that can be summarized in natural language forms, such as a user’s brief bio, a list of significant sentences or phrases, and preference tags. • L2: AI-Native Memory Layer. This layer represents memories that do not necessarily require natural language descriptions. Instead, they are learned and organized through model parameters, with each LPM being a neural network. For the L2 layer, we explored the challenges and potential solutions, focusing on issues such as training efficiency, serving efficiency, cold start, and catastrophic forgetting. We conducted initial experiments with L2, defining the tasks and evaluation metrics that AI Native Memory models must address. Collaborating with early adopters, we trained and tested the model, ultimately validating that its performance surpassed that of RAG and long-context models. As the AI landscape continues to evolve rapidly, we can now articulate our vision with greater precision: in the era of AGI ( Bubeck et al., 2023 ) , powered by general-purpose LLMs, the key to enabling humans to fully integrate into this system and reap its benefits lies in an AI system that stands on the user’s