Sophia: A Persistent Agent Framework of Artificial Life
Mingyang Sun, Feng Hong, Weinan Zhang · 2025
Read Sophia: A Persistent Agent Framework of Artificial Life by Mingyang Sun, Feng Hong, Weinan Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-18202.txt.
Introduction
Mingyang Sun, Feng Hong, and Weinan Zhang argue that today's AI agents are static and reactive, frozen in narrow scenarios set by hand. Their 2025 paper proposes a third layer above perception and deliberation, called System 3. It watches over the agent's narrative identity and long term adaptation. The design turns psychological constructs such as metacognition, theory of mind, intrinsic motivation, and episodic memory into concrete computing modules.
The ideas come together in Sophia, a wrapper that adds a continuous self improvement loop to any large language model agent. Four mechanisms drive it: process supervised thought search, narrative memory, user and self modeling, and a hybrid reward system. A compact prototype anchors the mostly conceptual discussion. In tests, Sophia cut reasoning steps for recurring operations by 80%. Its persistence also raised success on high complexity tasks by 40%. The authors offer the design as a practical path toward artificial life.
Catalog record
| CREATOR | Mingyang Sun, Feng Hong, Weinan Zhang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-18202
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Sophia: A Persistent Agent Framework of Artificial Life Mingyang Sun, Feng Hong, Weinan Zhang Abstract The rapid development of Large Language Models (LLMs) has elevated AI agents from task-specific tools to long-lived, decision-making entities capable of independent planning and strategic collaboration. However, most existing architectures remain reactive: they rely on manually crafted configurations that remain static after deployment, designed for narrow tasks or fixed scenarios. These systems excel at perception (System 1) and deliberation (System 2), yet lack a persistent meta-layer capable of maintaining identity, verifying internal reasoning, and aligning short-term tasks with long-term survival. In this work, we first propose a third stratum, System 3, that presides over the agent’s narrative identity and long-horizon adaptation. The framework maps selected psychological constructs (e.g., meta-cognition, theory-of-mind, intrinsic motivation, episodic memory) to concrete computational modules, thereby translating abstract notions of artificial life into implementable design requirements. These ideas coalesce in Sophia, a “Persistent Agent” wrapper that grafts a continuous self-improvement loop onto any LLM-centric System 1/2 stack. Sophia is driven by four synergistic mechanisms: process supervised thought search that curates and audits emerging thoughts, an memory module that maintains narrative identity, dynamic user and self models that track external and internal beliefs, and a hybrid reward system balancing environmental feedback with introspective drives. Together, transform the highly repetitive reasoning episodes of a primitive agent into an endless, self-driven reasoning phase dedicated to diverse goals, enabling autobiographical memory, identity continuity, and transparent narrative explanations of behavior. Although the paper is primarily conceptual, grounding System 3 in decades of cognitive theory, we provide a compact engineering prototype to anchor the discussion. In a deployment spanning prolonged durations within a dynamic web environment, Sophia demonstrated robust operational persistence through autonomous goal generation. Quantitatively, Sophia independently initiates and executes various intrinsic tasks while achieving an 80% reduction in reasoning steps for recurring operations. Notably, meta-cognitive persistence yielded a 40% gain in success for high-complexity tasks, effectively bridging the performance gap between simple and sophisticated goals. Qualitatively, System 3 exhibited a coherent narrative identity and an innate capacity for task organization. By fusing psychological insight with a lightweight reinforcement-learning core, the persistent agent architecture advances a possible practical pathway toward artificial life. Keywords: Persistent Agent, LLM Agents, System 3, Artificial Life 1 Introduction The rapid proliferation of large language models (LLMs) has catalyzed a paradigm shift in AI agents, transforming them from single task executors into long-lived sophisticated cognitive entities endowed with capabilities for autonomous planning, strategic deliberation, and collaborative engagement ( Achiam et al. 2023 ; Grattafiori et al. 2024 ; Hurst et al. 2024 ; Guo et al. 2025 ; Yang et al. 2025 ) . This technological leap is reshaping expectations across science, industry, and everyday applications ( Yang et al. 2024 ; Chkirbene et al. 2024 ; Ren et al. 2025 ; Li et al. 2024 ) . Yet despite these breakthroughs, most existing agent frameworks remain anchored to manually crafted configurations that remain static after deployment. Once shipped, they cannot revise their skill set, develop new tasks, or integrate unfamiliar knowledge without human engineers in the loop. Lacking the intrinsic motivation and self-improvement capabilities inherent to living systems, today’s agents remain unable to achieve sustained growth or open-ended adaptation. Infusing AI agents with these lifelike principles, enabling autonomous self-reconfiguration while maintaining operational coherence, has thus emerged as a critical frontier in AI research. Within prevailing agent architectures, cognition is typically partitioned into two complementary subsystems ( Li et al. 2025 ) . System 1 embodies rapid, heuristic faculties—perception, retrieval, and instinctive response. System 2, by contrast, governs slow, deliberate reasoning. It employs chain-of-thought planning, multi-step search, counterfactual simulation, and consistency checks to refine or override System 1’s impulses. In practical LLM agents, this often manifests as a reasoning loop that expands prompts with scratch-pad deliberations, validates tool outputs, and aligns final responses with user goals. While the synergy of these two layers enables impressive task performance, both remain confined to static configurations and predetermined task scheduling. Even in cases where agents support continual learning, such updates typically follow an externally defined task schedule rather than being self-directed. Consequently, the agent can neither update its reflexive priors nor revise its thought process when encountering truly novel domains. This rigidity highlights the necessity of a higher-order " System 3 ", which is a meta-cognitive layer that monitors, audits, and continuously adapts both underlying systems, thereby enabling the entire cognitive architecture to sustain ongoing learning. In this work, we ground System 3 in four foundational theories from cognitive psychology: • Meta-cognition ( Shaughnessy et al. 2008 ; Dunlosky & Metcalfe 2008 ) : a self-reflective monitor that inspects ongoing thought traces, flags logical fallacies, and selectively rewrites its own procedures; • Theory-of-Mind ( Frith & Frith 2005 ; Wellman 2018 ) : an explicit model of actors (humans or agents) that infers their beliefs, desires, and intentions to guide cooperation and learning; • Intrinsic Motivation ( Fishbach & Woolley 2022 ) : an internal reward generator that balances extrinsic task success with curiosity-driven exploration, enabling the agent to prioritize long-term competence over short-term gains. • Episodic Memory ( Tulving 2002 ; Ezzyat & Davachi 2011 ) : A structured autobiographical record that stores, indexes, and retrieves past experiences, providing crucial context for interpreting current events and planning future actions. By integrating these components into a persistent control loop, System 3 turns an otherwise static agent into a self-aware learner that can not only reason about the world but also reason about—and iteratively improve—its own reasoning process. Such a layer is indispensable for three fundamental reasonsespecially in the context of artificial life ( Langton 1997 ; Langton 2019 ) . First, real-world environments are non-stationary: objectives shift, constraints evolve, and previously unseen tasks emerge without warning. Agents devoid of self-reconfiguration inevitably ossify, leading to performance decay or catastrophic failure. Second, sustained autonomy demands identity continuity; without a mechanism to maintain a coherent self-model across sessions, an agent cannot accumulate autobiographical knowledge, assess longitudinal progress, or ensure behavioral consistency. Third, safety and alignment require transparent introspection: only a meta-cognitive agent can audit its decision pathways in real time and correct misaligned incentives before they propagate into harmful actions. In short, System 3 elevates agents from transient problem-solvers to adaptive, trustworthy partners capable of lifelong learning in open-ended environments. To operationalize System 3 in a deployable setting, we present the persistent agent, Sophia, which is a compact, modular framework that endows any LLM-centric System 1/2 stack with a continual self-improvement loop. The design hinges on the following reinforcing mechanisms. • Process-Supervised Thought Search captures raw chain-of-thought traces, filters them through self-critique prompts, and stores only validated reasoning paths for future reuse, turning stochastic deliberations into reusable cognitive assets. • A Memory Module maintains a structured memory graph of goals, experiences, and self-assessments, giving the agent a stable narrative identity that persists across reboots and task domains. • A Self-Model records the agent’s capabilities, terminal creed and intrinsic state; gaps detected here are immediately feedback as new learning targets. A User-Model maintains a live belief state for each user—goals, social relationship and human preferences. • A Hybrid Reward Module blends external task feedback with intrinsic signals—curiosity, coherence, and self-consistency—so