Position: AI as Part of Self — Extending the Mind Requires Cognitive Co-Regulation
Alina Gutoreva, Fendi Tsim, Trisevgeni Papakonstantinou · 2026
Read Position: AI as Part of Self — Extending the Mind Requires Cognitive Co-Regulation by Alina Gutoreva, Fendi Tsim, Trisevgeni Papakonstantinou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16197.txt.
Introduction
Gutoreva, Tsim, and Papakonstantinou argue that AI safety and alignment must grow from co-regulation of the human-AI mind system as a whole, not from curbing an outside tool. AI now shapes attention, reasoning, synthesis, and choices before conscious thought, forming one linked unit with its users. Loose delegation risks deskilling, automation bias, transfer of epistemic authority, and oracle-style centralization of knowledge. The authors close with design rules for joint regulation aimed at engineers and governance bodies.
Catalog record
| CREATOR | Alina Gutoreva, Fendi Tsim, Trisevgeni Papakonstantinou |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46428 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.16197
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Position: AI as Part of Self — Extending the Mind Requires Cognitive Co-Regulation Alina Gutoreva, Fendi Tsim, Trisevgeni Papakonstantinou Abstract This position paper argues that safety and alignment cannot be achieved by constraining an external system: they must emerge from the co-regulatory design of the human–AI cognitive system as a whole ("AI as Part of Self") . Contemporary AI increasingly participates in attention allocation, reasoning, synthesis, and decision-making, shaping the very cognitive processes through which humans form beliefs, make decisions, and constitute their sense of self. Humans and AI occupy complementary epistemic roles under mutual constraint, forming a symbiotic cognitive unit whose co-regulation—not the external control of either party alone—is the proper locus of alignment. We identify the risks of unstructured delegation: deskilling, automation bias, transfer of epistemic authority, and oracle-style centralization of knowledge. Drawing on System 0 cognition theory, we further show that AI operates prior to conscious deliberation, shaping the pre-attentive infrastructures through which agency and trust are negotiated—a level that conventional oversight cannot reach. We conclude with design principles for cognitive co-regulation addressed to ML engineers and governance bodies. The goal of this work is to guide human cognition toward resilience and epistemic agency at the foundation of human selfhood. Keywords: AI alignment; symbiotic cognition; cognitive co-regulation; epistemic agency; extended mind theory; Human–AI interaction 1 Introduction "Just as you cannot do very much carpentry with your bare hands, there is not much thinking you can do with your bare brain." [ 28 ] Artificial Intelligence (AI) systems must be modeled as integral components of human cognition, and that safety and alignment are best achieved through cognitive co-regulation rather than external constraint. AI has received a lot of inspiration from the study of human intelligence, and the two fields develop in a fruitful symbiosis. Current debates across AI safety research, philosophy of mind, cognitive science, and human–computer interaction focus on alignment and control risks, personal AI assistants, the societal embedding of AI systems, and the possibility of machine consciousness [ 11 , 98 , 90 , 27 , 14 ] . A key concern in AI safety is the control problem, where an AI system might alter its goals, potentially acting against human intentions [ 98 , 71 ] . These concerns implicitly assume a separation between human cognition and artificial systems, treating AI as an external agent whose objectives must be constrained or overridden. However, as AI systems become increasingly embedded in everyday reasoning, decision-making, and self-regulation, this assumption becomes less tenable. Rather than acting solely upon human goals, contemporary AI systems increasingly participate within human cognitive processes [ 42 ] , shaping attention [ 93 ] , framing choices [ 8 ] , and mediating learning process. This shift motivates a reconceptualization of AI not as a separate, autonomous entity to be controlled, but as a component of a coupled human–AI cognitive system. Recent theoretical work further substantiates the claim that human–AI interaction increasingly operates at the level of identity and cognitive organization rather than mere tool use. The control problem, classically conceived as constraining an external agent, must therefore be reconceived: the plausible framework for tackling misalignment is not tighter external constraint, but the deliberate co-regulatory design of the human–AI cognitive system as a whole. Recent theoretical work suggests that human–AI interaction is undergoing a phase transition, moving from external assistance toward cognitive integration. Although traditional safety frameworks treat AI as a separate agent to be constrained [ 98 ] , contemporary interaction increasingly occurs within the human cognitive loop, shaping attention and framing choices [ 42 , 93 , 56 ] . This shift extends our long-standing practice of building "hybrid" thinking systems yet goes further: the adaptive nature of generative models allows for a "partial identity sharing" where users incorporate AI-generated preferences and reasoning patterns into their own self-models. Under this view, AI is no longer a peripheral instrument but a dynamically integrated component of the user’s cognitive architecture [ 48 ] . Managing this integration requires operational frameworks that account for metacognition and epistemic authority [ 119 ] , suggesting that human sovereignty now depends on the active preservation of cognitive boundaries. Building on the foundational argument of Lake et al.’s [ 65 ] that human-like machines must construct causal models, ground learning in intuitive theories, and support compositional generalization, Collins et al. [ 27 ] argue for a further shift: away from tools that merely amplify human capabilities toward systems that can genuinely "learn and think with people." Drawing on principles from collaborative cognition and Bayesian models of human reasoning, they propose desiderata for AI systems that act as thought partners, actively building and updating models of both the world and the human interlocutor. This framework foregrounds cognitive compatibility and complementarity rather than raw computational scale, emphasizing trustworthiness, insightfulness, and mutual adaptability as core criteria. Although this reconceptualization marks an important transition from traditional tool metaphors to social agent frameworks, it remains oriented toward interaction between distinct agents. The present paper extends this trajectory one step further by arguing that, as human–AI interaction becomes more integrated and pervasive, AI must be reconceptualized not just as a partner or social agent but as a functional component of individual cognition itself—an entity that is embedded directly in the dynamical processes of attention, reasoning, and self-regulation. The self is a brain constructed model—representing the organism’s past, present, and anticipated states in relation to its environment [ 29 ] —and is therefore inherently open to reconfiguration by the cognitive systems with which it interacts. A compelling theoretical anchor for the AI-as-part-of-self framework comes from developmental biology. Levin [ 68 ] proposes that cognitive individuality is not fixed by anatomy but defined by computational boundaries : every living system maintains a delimited “area of concern”—a region of space-time, centered on the organism, within which its cognitive apparatus takes measurements and acts. Crucially, these boundaries are scale-free and plastic; they expand or contract depending on the systems with which an organism is coupled. Extending this to human–AI integration. Levin [ 69 ] observes that the interoperability of multi-scale cognitive architectures enables novel agents—hybrots, cyborgs, chimeric organisms—to form across any combination of biological, engineered, and computational material. These accounts suggest that the self is not a fixed biological given, but a dynamically negotiated computational boundary, and that sustained AI integration constitutes a genuine, biologically grounded expansion of that boundary. Emerging computational paradigms, such as digital twins, provide a concrete instantiation of this boundary expansion. Digital twins, defined as continuously updated and data-driven models of individuals, function as externalized predictive representations that simulate behavior and internal states [ 41 , 20 ] . Prior work defines the AI-integrated self as a cognitive architecture dynamically extended through sustained interaction with adaptive systems [ 48 ] . As such models become integrated into everyday systems and even merged with personalized assistants, they form feedback loops in which the individual is both modeled and modulated by their computational counterpart. Unlike static tools, these systems develop user-specific representations that capture preferences, reasoning patterns, and behavioral tendencies, that are co-evolving with the individual over time. Personalization further transforms AI from a general-purpose cognitive scaffold into a trajectory-dependent cognitive partner, embedding it more deeply within