Can We Test Consciousness Theories on AI? Ablations, Markers, and Robustness

Yin Jun Phua · 2025

Read Can We Test Consciousness Theories on AI? Ablations, Markers, and Robustness by Yin Jun Phua (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-19155.txt.

Introduction

Yin Jun Phua asks whether theories of consciousness can be tested on artificial agents. Three camps dominate the debate: global workspace theory, integrated information theory, and higher-order theories. Each names a different signature of conscious processing, and brains do not allow clean removal of one part at a time.

Phua builds agents that carry each mechanism, then cuts parts out and watches what breaks. One lesion wiped out self-monitoring while task skill stayed intact, like a synthetic blindsight. Shrinking the workspace degraded access in graded steps. The patterns suggest the three theories may describe stacked layers of one system rather than rivals.

Catalog record

CREATORYin Jun Phua
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE83 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-19155

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Can We Test Consciousness Theories on AI? Ablations, Markers, and Robustness Yin Jun Phua Abstract The search for reliable indicators of consciousness has fragmented into competing theoretical camps (Global Workspace Theory (GWT), Integrated Information Theory (IIT), and Higher-Order Theories (HOT)), each proposing distinct neural signatures. We adopt a synthetic neuro-phenomenology approach: constructing artificial agents that embody these mechanisms to test their functional consequences through precise architectural ablations impossible in biological systems. Across three experiments, we report dissociations suggesting these theories describe complementary functional layers rather than competing accounts. In Experiment 1, a no-rewire Self-Model lesion abolishes metacognitive calibration while preserving first-order task performance, yielding a synthetic blindsight analogue consistent with HOT predictions. In Experiment 2, workspace capacity proves causally necessary for information access: a complete workspace lesion produces qualitative collapse in access-related markers, while partial reductions show graded degradation, consistent with GWT’s ignition framework. In Experiment 3, we uncover a broadcast-amplification effect: GWT-style broadcasting amplifies internal noise, creating extreme fragility. The B2 agent family is robust to the same latent perturbation; this robustness persists in a Self-Model-off / workspace-read control, cautioning against attributing the effect solely to z self z_{\text{self}} compression. We also report an explicit negative result: raw perturbational complexity (PCI-A) decreases under the workspace bottleneck, cautioning against naive transfer of IIT-adjacent proxies to engineered agents. A simple composite of markers (GBI + Δ \Delta PCI + AUROC) predicts OOD fragility. These results suggest a hierarchical design principle: GWT provides broadcast capacity , while HOT provides quality control . We emphasize that our agents are not conscious; they are reference implementations for testing functional predictions of consciousness theories. 1 Introduction The science of consciousness faces a validation crisis. While theories like Global Workspace Theory (GWT) ( 3 ; 9 ) , Integrated Information Theory (IIT) ( 30 ; 22 ) , and Higher-Order Theories (HOT) ( 25 ; 18 ) propose distinct neural signatures of awareness (ranging from non-linear “ignition” ( 10 ) and causal integration ( \Phi ) ( 22 ) to metacognitive self-monitoring ( 11 ) ), testing them in biological systems is constrained by the inability to perform precise architectural ablations. We propose synthetic neuro-phenomenology : building agents that explicitly embody these theoretical commitments to test their functional utility. This approach addresses a gap in both neuroscience and artificial intelligence. For neuroscience, synthetic agents offer a "perfect model organism" where every neuron, weight, and activation is observable and manipulable, allowing for causal tests that are ethically or technically impossible in biological brains. For AI, consciousness theories offer a potential roadmap for overcoming the brittleness of current systems ( 4 ) . While deep learning has achieved broad success, modern models often lack the robustness, adaptability, and self-monitoring capabilities characteristic of biological intelligence. By implementing architectural priors derived from consciousness science (such as global broadcasting ( 14 ) and self-modeling), we aim to determine whether these mechanisms confer the same functional advantages to artificial agents that they are hypothesized to provide to biological organisms. However, prior attempts to model consciousness in silico have often fallen short of systematic validation. Many implementations rely on loose metaphorical translations of neural theories, where a simple feedback loop is labeled “recurrent processing” or a central variable is called a “global workspace” without establishing the functional necessity of these features. Furthermore, existing studies typically focus on single theories in isolation (building a “GWT agent” ( 14 ) or a “HOT-inspired Self-Model agent” ( 33 ) ), ignoring the potential interactions and dependencies between these mechanisms. Few studies subject these architectures to “adversarial phenomenology”: actively trying to break the system via lesions, noise, and deceptive signaling to distinguish genuine architectural advantages from mere task-specific overfitting. In this work, we address these shortfalls by subjecting our agents to a battery of stress tests. We move beyond merely confirming theory predictions to stress-testing them in a controlled synthetic environment. To do this, we designed agents with reinforcement-learning-style architectures—trained here via supervised behavior cloning from an oracle (used only to generate training targets) to isolate architectural effects from optimization confounds—that incorporate specific architectural features proposed by consciousness theories. Specifically, we built agents with (1) a global workspace to broadcast information between modules (representing GWT), (2) a Self-Model to monitor internal states (representing HOT), and (3) complexity probes to measure information integration (inspired by IIT). Because these are software agents, we can perform manipulations that are impossible in biology: we apply causal lesions (selectively breaking parts of the “brain”), noise titration (injecting precise amounts of interference to test robustness), and adversarial reward structures (creating environments that incentivize the agent to “lie” to itself). Our findings reveal a functional hierarchy rather than competing theories: 1. Action Without Metacognition (Synthetic Blindsight): Consistent with HOT predictions, we find that in this agent family, ablating the Self-Model selectively abolishes metacognitive calibration (“knowing that you know”) while leaving first-order task performance largely intact, yielding a synthetic analogue of blindsight where agents can do without knowing . 2. Bus-Off Discontinuity in Access Markers: We observe an ignition-analogous discontinuity in this finite, discrete-capacity workspace: across the capacity settings we test, access markers remain similar across the tested non-zero capacities but collapse when the workspace is fully lesioned (bus-off) 1 1 1 Here, we use “ignition-analogous” in a loose access sense: an abrupt change between tested discrete capacity settings in a finite system. We do not claim a thermodynamic-limit phase transition, power-law scaling, or a precisely estimated critical point. . Reducing workspace capacity does not gradually dim access within the tested levels; instead, a complete workspace lesion produces a qualitative collapse in access-related markers. 3. Broadcast-Amplification vs. Noise-Attenuation: Contrary to the intuition that broadcasting creates robustness ( 3 ; 4 ) , we find that a global workspace alone exhibits a broadcast-amplification effect: it broadcasts information but also amplifies noise, making the system fragile even under standard regularization and noise augmentation. In our implementation, the B2 agent family remains robust in the same perturbation regime (L75 >0.50 ), including in a Self-Model-off / workspace-read control; we therefore treat noise-attenuation as an empirical robustness property of the B2 family rather than as a bottleneck-only effect. 4. A Transfer Constraint on IIT-Adjacent Proxies: Raw perturbational complexity (PCI-A) is inverted under the workspace bottleneck: the GWT agent shows lower trajectory complexity than baselines, contrary to a naive “more integrated \Rightarrow higher PCI” expectation. This explicit negative result constrains how PCI-style measures transfer to engineered agents and suggests that absolute algorithmic complexity is not an architecture-invariant proxy for integration. These results suggest that consciousness markers are not redundant. GWT provides the capacity for information exchange, while HOT mechanisms provide the control necessary to stabilize that exchange. Neither alone is sufficient for robust agency. Scope and Limitations. Throughout this work, we focus strictly on Access Consciousness (information availability for report and action) rather than phenomenal consciousness or subjective experience. Our agents are not conscious; they are reference implementations of proposed mechanisms. Our claims concern functional correlates within these synthetic systems: whether certain architectural features are necessary or sufficient for particular behavioral and representational signatures. We make no claims about whether these features would produce phenomenal experience in biological or artificial systems. Because we evaluate up to n=20 seeds per condition

Read the complete text