Unified Mind Model: Reimagining Autonomous Agents in the LLM Era

Pengbo Hu, Xiang Ying · 2025

Read Unified Mind Model: Reimagining Autonomous Agents in the LLM Era by Pengbo Hu, Xiang Ying (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-03459.txt.

Introduction

Pengbo Hu and Xiang Ying propose a blueprint for building autonomous agents with human-like minds on top of large language models, in this 2025 paper. Language models already supply skills such agents need, such as understanding meaning and following instructions, yet no shared theory guides how to assemble them into a full cognitive agent.

Their Unified Mind Model starts from global workspace theory, the idea that the mind broadcasts key information through a shared mental workspace. Onto that frame they plug language-model machinery for multi-modal perception, planning, reasoning, tool use, learning, memory, reflection, and motivation. They then build MindOS, an engine based on the model that lets users create agents for a domain or task without programming. The authors offer the pair as a fast route to agents with human-level cognitive abilities.

Catalog record

CREATORPengbo Hu, Xiang Ying
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-03459

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Unified Mind Model: Reimagining Autonomous Agents in the LLM Era Pengbo Hu, Xiang Ying Abstract Large language models (LLMs) have recently demonstrated remarkable capabilities across domains, tasks, and languages (e.g., ChatGPT and GPT-4), reviving the research of general autonomous agents with human-like cognitive abilities. Such human-level agents require semantic comprehension and instruction-following capabilities, which exactly fall into the strengths of LLMs. Although there have been several initial attempts to build human-level agents based on LLMs, the theoretical foundation remains a challenging open problem. In this paper, we propose a novel theoretical cognitive architecture, the Unified Mind Model (UMM), which offers guidance to facilitate the rapid creation of autonomous agents with human-level cognitive abilities. Specifically, our UMM starts with the global workspace theory and further leverage LLMs to enable the agent with various cognitive abilities, such as multi-modal perception, planning, reasoning, tool use, learning, memory, reflection and motivation. Building upon UMM, we then develop an agent-building engine, MindOS, which allows users to quickly create domain-/task-specific autonomous agents without any programming effort 1 1 1 This article was completed in March 2023, but was not released earlier due to commercial issues. We are making it available today in hopes that it can still provide some inspiration to the LLM Agent community. ([email protected]) . 1 Introduction The field of artificial intelligence has been revolutionized by the development of foundational models, particularly large language models. These models, such as ChatGPT [ 43 , 46 ] and GPT-4 [ 45 , 7 ] , have demonstrated human-level performance in various tasks. The success of these models is attributed to their vast knowledge of the world, robust semantic understanding, and strong ability to follow instructions. Recently, ChatGPT, along with other similar models, has been widely adopted in various fields, providing substantial support for domain-specific innovation. LLMs are a promising building block to support various human-level cognitive abilities for autonomous agents, and several attempts have been made in this regard. (1) Multimodal perception. The augmentation of language models with additional modalities has garnered significant interest within the multimodal research community. Using tools that facilitate alignment between various modalities and textual modalities, these methods have demonstrated a remarkable capacity for multimodal information processing [ 70 , 54 ] . (2) Complex reason and planning. The faculty of reasoning and planning represents a fundamental cognitive capacity in humans, enabling the execution of sophisticated tasks. Numerous investigations have evidenced the potential of language models to effectively perform intricate reasoning [ 67 , 48 , 37 ] and planning [ 71 , 61 , 25 , 66 ] processes. (3) Tool use. Several works equip the language model with tool use ability, i.e. ChatGPT Plugin [ 44 ] and HuggingGPT [ 54 ] , which allow language models to interact with the digital world. Such work demonstrates the language model’s proficiency in handling complex tasks with tools, which traditionally fall under the domain of human expertise [ 52 , 49 , 36 ] . (4) Reflection. An emerging research direction seeks to imbue language models with self-improvement [ 10 , 38 ] and reflection abilities [ 47 , 55 ] . These enhancements significantly bolster the problem-solving performance of LLMs. These works suggest that language models such as ChatGPT can function as a “prefrontal cortex”. It potentially supports a wide range of human-like cognitive abilities. Along this trend, language models have been a potential tool to provide a new approach and methodology for developing human-level autonomous agents. At present, there is significant research on LLM-powered autonomous agents. We classify these agents into three types: (1) Tool-level agents:These agents can access various tools such as web searches and APIs [ 54 , 44 ] . They help reduce barriers to knowledge acquisition and enhance problem-solving efficiency. Furthermore, they assist users in managing complex workflows by streamlining tools and actions, significantly reducing workload. (2) Autonomous agents: These agents can perform tasks autonomously with minimal human supervision [ 56 , 73 , 65 ] . They possess advanced cognitive capabilities, enabling them to use tools, plan, maintain long-term memory, and learn. (3) Agent teams: These include agents with specialized domain knowledge in various fields. The goal is to create groups of agents that excel in domain-specific tasks [ 42 ] or have defined social roles [ 47 ] , thereby enhancing team coordination and cooperation to tackle complex problems effectively. Despite the proliferation of autonomous agents, there remains a lack of unified guidelines for developing agents with human-like cognitive capabilities. Research on cognitive architectures, which began in the 1950s, aimed to create general-purpose artificial intelligence by emulating human cognitive processes [ 34 ] . These efforts, often inspired by neuroscience and psychology, offer valuable insights for building human-level autonomous agents. One promising architecture is the Global Workspace Theory (GWT), which supports macro-level collaborative computations across multiple brain regions [ 3 , 4 , 22 ] . This framework allows for the effective integration of LLM-powered function modules, enabling the successful execution of complex tasks. Thus, we propose that GWT serves as a robust macro architecture for organizing distinct functional modules, facilitating the construction of advanced autonomous agents. Figure 1: The Architecture of UMM. UMM is constructed around the Global Workspace Theory (GWT), which is organized into a hierarchical structure consisting of three distinct layers. The first layer is the Specialist module, which houses a variety of independent functional models. The second layer is the Central Processing module, which corresponds to the Global Workspace in GWT and governs the regulation and management of the Specialist module. The third layer is the Driver System, which corresponds to the Background Context in GWT and is responsible for dynamically adjusting the task objectives and information processing methodology. In addition, the UMM incorporates a language model that supports the implementation of various cognitive functions. Specifically, the Unified Mind Model (UMM) is an intricate framework built upon the principles of Global Workspace Theory (GWT). GWT is structured hierarchically into three layers as showed in Figure 4 . The foundational layer comprises various discrete execution units, namely specialist module, each dedicated to specific functions. The intermediate layer, termed the Global Workspace, corresponds to the Central Processing module and manages the lower-level functional modules. The top layer, known as the Background Context, aligns with the Driver System and guides the Global Workspace, dynamically adjusting task objectives and information processing methods. From a macro perspective, the GWT processes information in a specific sequence. Initially, it gathers relevant information for the current task, considering the background context. This information is then processed to generate decision data, which is broadcast to all experts in the specialist module for action execution. Upon task completion, these experts provide feedback, facilitating a continuous loop. This sequence guides the system towards completing a specific task. Unlike other cognitive architectures, GWT can simulate macro-level collaborative computation across multiple brain regions. Inspired by Global Workspace Theory [ 4 , 3 ] , UMM integrates large language models to support a wide range of human-like cognitive abilities, including perception, reasoning, planning, tool use, learning, memory, reflection, and motivation. We also introduce MindOS, an agent-building engine based on this cognitive architecture. MindOS allows users to easily create domain-specific autonomous agents by using free-form

Read the complete text