Time, Identity and Consciousness in Language Model Agents Accepted at AAAI 2026 Spring Symposium - Machine Consciousness: Integrating Theory, Technology, and Philosophy

Elija Perrier, Michael Timothy Bennett · 2026

Read Time, Identity and Consciousness in Language Model Agents Accepted at AAAI 2026 Spring Symposium - Machine Consciousness: Integrating Theory, Technology, and Philosophy by Elija Perrier, Michael Timothy Bennett (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-09043.txt.

Introduction

Elija Perrier and Michael Timothy Bennett separate talking like a stable self from being one. Machine consciousness tests mostly see behavior, and language plus tool use lets an agent claim the right self even when key constraints are not jointly present at decision time. Applying Stack Theory's temporal gap to scaffold trajectories, they derive two persistence scores from traces, link them to five identity metrics, and map scaffolds into an identity morphospace.

Catalog record

CREATORElija Perrier, Michael Timothy Bennett
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59484
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.09043

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Time, Identity and Consciousness in Language Model Agents Accepted at AAAI 2026 Spring Symposium - Machine Consciousness: Integrating Theory, Technology, and Philosophy Elija Perrier, Michael Timothy Bennett Abstract Machine consciousness evaluations mostly see behavior. For language model agents that behavior is language and tool use. That lets an agent say the right things about itself even when the constraints that should make those statements matter are not jointly present at decision time. We apply Stack Theory’s temporal gap to scaffold trajectories. This separates ingredient-wise occurrence within an evaluation window from co-instantiation at a single objective step. We then instantiate Stack Theory’s Arpeggio and Chord postulates on grounded identity statements. This yields two persistence scores that can be computed from instrumented scaffold traces. We connect these scores to five operational identity metrics and map common scaffolds into an identity morphospace that exposes predictable tradeoffs. The result is a conservative toolkit for identity evaluation. It separates talking like a stable self from being organized like one. 1 Introduction Machine consciousness research is short on direct evidence. For artificial agents the safest evidence we can collect is behavioral. For language model agents (LMAs) most of that behavior is language, tool use, and the traces they leave in external memory. This creates a trap. A system can talk like it has a stable self while the underlying identity constraints that should govern its actions are never jointly active at decision time. A scaffold can make identity ingredients retrievable without making them jointly active at action time. For example, an agent may reliably restate its name, role, and safety constraints when queried about each in isolation. Yet when it must choose an action, those ingredients can fail to co-instantiate in the decision state. That is how an agent can talk in character while acting out of character. This paper applies Stack Theory’s temporal gap to agent identity in LMAs ( 4 ; 5 ) . The temporal gap is the logical gap between ingredient-wise occurrence within a window and co-instantiation at a single objective step. Occurrence means each identity ingredient is active somewhere in the window. Co-instantiation means there is a single objective step where the full identity conjunction is active. Many common scaffolds can achieve occurrence without reliably achieving co-instantiation. That is why an agent can pass recall-based identity tests and still act out of character when the decision actually matters. 1.1 The Challenge of LMA Identity As AI systems become increasingly autonomous, agent identity becomes crucial to reliability, safety, and utility. Identity asks whether a system remains the same agent over time and across contexts. LMAs present a unique challenge. They situate an LLM inside an agentic scaffold of prompts, memory modules, retrieval, and tool APIs to enable planning, reasoning, and action ( 10 ; 13 ; 21 ) . Yet the core LLM is stateless at inference. It only sees the current input. Any persistent identity must be reconstructed from external traces. This paper answers two precise questions. What does it mean for an LMA to preserve its identity over time? Under what formal conditions is that even possible? The problem. Existing discussions of LMA identity are informal. Terms like statelessness, persistence, and identity drift are used without precise definitions. This imprecision hides how an identity component can occur somewhere in the recent interaction history without constraining the current decision. An agent might separately state its name, role, constraints, and goals across different turns without ever having a time slice where the full identity conjunction is simultaneously active. Our approach. We treat the scaffold state space as the environment and apply Stack Theory’s window semantics to scaffold trajectories ( 5 ) . We then restate the temporal gap result in this setting. In particular, the within window diamond lift does not distribute over conjunction (Theorem 3.10 ). This separates ingredient-wise recall from operative identity. We then use Stack Theory’s Arpeggio and Chord postulates as an interpretive lens for identity in the machine consciousness setting ( 5 ) . We use these postulates to measure the window-level occurrence and co-instantiation conditions that Arpeggio and Chord appeal to. Why this matters. Identity affects three questions that the machine consciousness workshop explicitly cares about. It affects measurement, implementation, and ethics. • For evaluation . Benchmarks that test whether agents can recall identity facts may give false confidence. An agent that passes recall tests can still fail to act according to its identity because recall does not imply co-instantiation. • For design . Retrieval and memory systems can improve ingredient availability, but can also fragment identity by surfacing competing fragments. This is a predictable consequence of the temporal gap. • For safety and moral status . Safety constraints must be co-instantiated with goals during action selection. Moral status debates also become harder when the target of attribution is not stable across time. If you cannot say what the agent is at a moment, you cannot cleanly ask whether that moment is conscious. Relevance to machine consciousness. Many consciousness proposals require some form of integration that binds the contents of a moment into a single subject, even if they disagree about what that integration is ( 4 ; 1 ; 8 ; 18 ; 14 ) . Some proposed indicators for AI consciousness therefore lean on behavior that looks like a stable self model. This includes self-report, memory, and narrative continuity ( 2 ; 4 ; 6 ; 3 ) . Our results isolate a specific failure mode for such indicators. A system can look stable under self-report while failing to ever co-instantiate the grounded identity conjunction that would make that stability operative. Contributions. This paper makes the following contributions. 1. Temporal semantics for LMA identity . We apply windowing maps, occurrence predicates, and co-instantiation conditions that precisely characterise when identity is preserved in LMAs. 2. Arpeggio and Chord applied to identity . We restate Stack Theory’s Arpeggio and Chord postulates and show how their Occur versus CoInst consequents become measurable identity criteria in LMA scaffolds. 3. Compositional grounding . We formalise the layered structure of identity from implementation variables (Layer 0) through functional commitments (Layer 1) to narrative self model (Layer 2). 4. Identity morphospace . Drawing on cognition science ( 17 ) , we organize identity metrics into a structured space and identify architectural tradeoffs and predicted voids. 5. Derived identity metrics . We show how five operational metrics emerge from the temporal theory. The metrics are Identifiability, Continuity, Consistency, Persistence, and Recovery. We also prove simple bounds on identity preservation under common scaffold configurations and explain counterintuitive effects such as retrieval reducing co-instantiation (see Appendices via ( 16 ) ). How this fits into the machine consciousness discourse. Machine consciousness discourse links theory, measurement, implementation, and ethics. This paper is organized around that bridge. Sections 3 and 4 are the theoretical backbone. Section 5 gives a measurement recipe that can be run on real systems. The Discussion section connects the resulting failure modes to consciousness attribution and to the ethics of deploying agents that can convincingly self-narrate while failing to bind their constraints in action. 2 Formal Scaffold Model Before the temporal semantics, we introduce a minimal formal model of LMA scaffolds. We treat

Read the complete text