AI Awareness
Xiaojian Li, Haoyuan Shi, Rongwu Xu, Wei Xu · 2025
Read AI Awareness by Xiaojian Li, Haoyuan Shi, Rongwu Xu, Wei Xu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-20084.txt.
Introduction
Xiaojian Li, Haoyuan Shi, Rongwu Xu, and Wei Xu review the idea of awareness in AI systems. Their paper is from two thousand twenty-five. They treat awareness not as a vague mind claim, but as a set of skills that can be gauged. An aware system can track its own state, know its limits, model other agents, and read its setting.
They sort the field into four forms: thought about thought, self-knowledge, social sense, and scene sense. For each, they trace roots in mind science and show how it shows up in top AI systems. They sum up how each form is tested and what tests find. More aware agents tend to act with more skill, but risks for safety and alignment grow too.
Catalog record
| CREATOR | Xiaojian Li, Haoyuan Shi, Rongwu Xu, Wei Xu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 75 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-20084
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AI Awareness Xiaojian Li, Haoyuan Shi, Rongwu Xu, Wei Xu Abstract Recent breakthroughs in artificial intelligence (AI) have brought about increasingly capable systems that demonstrate remarkable abilities in reasoning, language understanding, and problem-solving. These advancements have prompted a renewed examination of AI awareness —not as a philosophical question of consciousness, but as a measurable, functional capacity. In this review, we explore the emerging landscape of AI awareness, which includes meta-cognition (the ability to represent and reason about its own state), self-awareness (recognizing its own identity, knowledge, limitations, inter alia ), social awareness (modeling the knowledge, intentions, and behaviors of other agents), and situational awareness (assessing and responding to the context in which it operates). First, we draw on insights from cognitive science, psychology, and computational theory to trace the theoretical foundations of awareness and examine how the four distinct forms of AI awareness manifest in state-of-the-art AI. Next, we systematically analyze current evaluation methods and empirical findings to better understand these manifestations. Building on this, we explore how AI awareness is closely linked to AI capabilities, demonstrating that more aware AI agents tend to exhibit higher levels of intelligent behaviors. Finally, we discuss the risks associated with AI awareness, including key topics in AI safety, alignment, and broader ethical concerns. AI awareness is a double-edged sword: it improves general capabilities, i.e. , reasoning, safety, while also raises concerns around misalignment and societal risks, demanding careful oversight as AI capabilities grow. On the whole, our interdisciplinary review provides a roadmap for future research and aims to clarify the role of AI awareness in the ongoing development of intelligent machines. keywords Artificial Intelligence, Awareness, Large Language Model, Cognitive Science, AI Safety and Alignment † † equal-contributors: These authors contributed equally to this work. † † equal-contributors: These authors contributed equally to this work. 1 Introduction Recently, the rapid acceleration of large language model (LLM) development has transformed artificial intelligence (AI) from a narrow, task-specific paradigm into a general-purpose intelligence with far-reaching implications. Contemporary LLMs demonstrate increasingly sophisticated linguistic, reasoning, and problem-solving capabilities, and are showcasing superb human-like behaviors, prompting a fundamental research question: To what extent do these systems exhibit forms of awareness? We want to note here, while the notion of AI consciousness remains both philosophically contentious and empirically less grounded, the concept of AI awareness — defined as a system’s functional ability to represent and reason about its own identity, capabilities, and informational states — has emerged as an important and tractable research frontier. The theoretical foundations of awareness are deeply rooted in cognitive science and psychology, where awareness is typically classified into perceptual awareness, self-awareness, and social awareness. In these fields, awareness is understood as the ability to access and monitor mental states, reason about them, and adjust behavior accordingly. Recent work in computational cognitive science suggests that certain aspects of awareness may be approximated by large-scale generative models that exhibit metacognitive behaviors, calibrate their epistemic confidence, and engage in perspective-taking. These functional abilities raise pressing questions about how awareness manifests in LLMs, how it can be systematically measured, and what implications it holds for AI capability, safety and alignment. Despite the increasing attention devoted to this topic, the study of AI awareness remains fragmented across disciplines, with limited consensus regarding its definition, measurement, and significance. Some scholars emphasize emergent capabilities observed through prompt-based introspection or theory-of-mind-inspired tests; others caution against anthropomorphizing statistical models, warning that apparent self-reflection may arise from linguistic pattern completion rather than genuine metacognitive representation. Moreover, current methodologies for assessing AI awareness are often limited by confounding factors such as prompt sensitivity, dataset leakage, and lack of longitudinal robustness. This review provides the first comprehensive, cross-disciplinary synthesis of AI awareness research. We begin by laying out the theoretical foundations, carefully distinguishing AI awareness from AI consciousness, and examining how awareness-related concepts have been formalized in cognitive and computational sciences. Next, we critically evaluate experimental approaches for testing LLM awareness, highlighting both their empirical findings and methodological limitations. We then explore the potential beneficial relationships between functional AI awareness and AI capabilities, from improving model reasoning and task planning to enhancing AI safety. Finally, we address the emerging risks associated with more aware AI systems, focusing on key concerns within the safety and alignment community—such as risks of deception, manipulation, and emergent behaviors that challenge controllability—and broader ethical issues, including concerns like false anthropomorphization. By integrating insights from AI, cognitive science, psychology, AI safety and alignment, this review not only provides a structured and authoritative account of the current state of knowledge but also charts a roadmap for future inquiry. In doing so, it seeks to advance understanding of one of the most profound and interdisciplinary challenges at the intersection of AI, cognition science and our society. Figure 1 : Four dimensions of “main” awareness. Meta-cognition monitors the subject’s own processes and gives rise to self-awareness, social awareness of other individuals and the social collective, and situational awareness of the non-agent environment. 2 Theoretical Foundations of AI Awareness In this section, we will review the approaches, goals, and theories of AI consciousness that have emerged with large language models, distinguish between the research subjects that caused linguistic confusion, and clarify the targets of awareness research. In the psychology encyclopedia, awareness represents the perception or knowledge of something. When an agent possesses a “knowledge and knowing state about an internal/external situation or fact,” it gains awareness of its target of knowing. Accurate reportability of something perceived or known is widely used as a behavioral index of conscious awareness. However, it is possible to be aware of something without being explicitly conscious of it ( American Psychological Association n.d. ) . Early works that navigate the range of human awareness ( Yates 1985 ; Turing 1950 ; Duval and Wicklund 1972 ; Nagel 1974 ) , in which we easily conflate AI awareness with phenomenological consciousness . In animal and human studies, consciousness represents the subjective experience of being in a certain state of mind, and having consciousness means possessing a subjective point of view ( Nagel 1974 ) . Dehaene et al. 2017 distinguish between mere global availability of information and true reflective self-consciousness, calling the latter “C2” or self-monitoring, which entails the system observing its own processing. To prove there is an extra layer of reflective experience, where the AI assesses its own knowledge and decisions, is difficult, if not impossible. Having a conceptual or computational self-model is not the same as having the subjective, qualitative self-awareness that humans have. Since phenomenal observations do not provide sufficient evidence for the existence of consciousness, the “hard problem” of AI consciousness remains scientifically unresolved ( Nagel 1974 ; Chalmers 2023 ) . Research tends to use a theory-heavy approach to construct hypotheses for the formats of consciousness that ultimately lead to metaphysical discussions. Thus, because of the inconclusivity of metaphysical consciousness, we return to a phenomenological analysis of capacities, behaviors, and observable acquisition of knowledge. Between 2022 and 2023, there were reports of LLMs performing tasks that required understanding the knowledge and intentions of others, abilities that are central to human social awareness. This has led to questions about whether LLMs are developing rudimentary awareness. However, it is