Breaking Up with Normatively Monolithic Agency with GRACE: A Reason-Based Neuro-Symbolic Architecture for Safe and Ethical AI Alignment
Felix Jahn, Yannic Muskalla, Lisa Dargasz, Patrick Schramowski, Kevin Baum, [0.5em] German Research Center for Artificial Intelligence, [0.5em] Corresponding authors’ emails: {felix.jahn, kevin.baum}@dfki.de · 2026
Read Breaking Up with Normatively Monolithic Agency with GRACE: A Reason-Based Neuro-Symbolic Architecture for Safe and Ethical AI Alignment by Felix Jahn, Yannic Muskalla, Lisa Dargasz, Patrick Schramowski, Kevin Baum, [0.5em] German Research Center for Artificial Intelligence, [0.5em] Corresponding authors’ emails: {felix.jahn, kevin.baum}@dfki.de (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-10520.txt.
Introduction
Felix Jahn and co authors build a safe AI frame that can hold more than one value set. Agents now act on their own in grave tasks. Their calls must be both sharp and right in a moral sense. Past frames oft rest on one set of values for all. That set may not fit all users or lands.
The frame is named GRACE. It is a neuro symbolic build: nets join rule based steps. It works from reasons, not just rules. Each call can be traced to the reasons that drove it. The aim is an agent whose acts can be checked and fit to the case.
Catalog record
| CREATOR | Felix Jahn, Yannic Muskalla, Lisa Dargasz, Patrick Schramowski, Kevin Baum, [0.5em] German Research Center for Artificial Intelligence, [0.5em] Corresponding authors’ emails: {felix.jahn, kevin.baum}@dfki.de |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-10520
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Breaking Up with Normatively Monolithic Agency with GRACE: A Reason-Based Neuro-Symbolic Architecture for Safe and Ethical AI Alignment Felix Jahn, Yannic Muskalla, Lisa Dargasz, Patrick Schramowski, Kevin Baum, [0.5em] German Research Center for Artificial Intelligence, [0.5em] Corresponding authors’ emails: {felix.jahn, kevin.baum}@dfki.de Abstract As AI agents become increasingly autonomous, widely deployed in consequential contexts, and efficacious in bringing about real-world impacts, ensuring that their decisions are not only instrumentally effective but also normatively aligned has become critical. We introduce a neuro-symbolic reason-based containment architecture , G overnor for R eason- A ligned C ontainm E nt (GRACE), that decouples normative reasoning from instrumental decision-making and can contain AI agents of virtually any design. GRACE restructures decision-making into three modules: a Moral Module ( MM ) that determines permissible macro actions via deontic logic-based reasoning; a Decision-Making Module ( DMM ) that encapsulates the target agent while selecting instrumentally optimal primitive actions in accordance with derived macro actions; and a Guard that monitors and enforces moral compliance. The MM uses a reason-based formalism providing a semantic foundation for deontic logic, enabling interpretability, contestability, and justifiability. Its symbolic representation enriches the DMM ’s informational context and supports formal verification and statistical guarantees of alignment enforced by the Guard. We demonstrate GRACE on an example of a LLM therapy assistant, showing how it enables stakeholders to understand, contest, and refine agent behavior. 1 Introduction Deploying AI agents in consequential decision-making contexts has shifted alignment from a hypothetical concern to an urgent challenge: ensuring that autonomous systems not only pursue their goals instrumentally, but also safely, ethically, and in alignment with human values more broadly 51 , 53 , 60 . Grappling with these concerns involves intertwined normative and technical subchallenges 30 . We argue, first, that addressing these challenges requires rethinking agent architectures, since most current designs flatten instrumental decision-making and normative constraints into a single, opaque policy function. While adequate for narrow supervised tasks, normatively monolithic architectures become a serious liability. Flattening instrumental and normative considerations into one policy erases accountability, makes decision-making opaque, and removes the possibility for contestation or oversight in complex moral contexts 58 . Secondly, we propose that an approach grounded in normative reasons 3 , 33 , 56 —rather than in rigid, abstract high-level principles or in underspecified, hard-to-operationalize values—can help to overcome this limitation. Building on this diagnosis, we argue that achieving reliable ethical AI requires more than incremental improvements to training objectives or post-hoc filtering mechanisms. It demands a structural decomposition of the decision-making process itself, not merely adjustments to existing optimization paradigms. To this end, we introduce the G overnor for R eason- A ligned C ontainm E nt (GRACE)—a reason-based governor architecture that provides a neuro-symbolic framework explicitly separating normative reasoning from instrumental optimization. This separation enables the transparency, contestability, and oversight essential for trustworthy autonomous systems 55 . Conceptually, the framework contributes to the emerging Guaranteed Safe AI research agenda 16 , which pursues high-assurance safety guarantees through formal world models, safety specifications, and verifiable control mechanisms. In this context, GRACE extends the agenda into the ethical domain, offering a principled method for constructing interpretable and contestable ethical specifications for morally consequential decisions. It grounds these specifications in explicit reasoning about normative reasons, rather than in fixed rule sets or reward-based feedback alone. The architecture’s conceptual validity is illustrated through concrete scenarios, laying the groundwork for future empirical evaluation. Parts of a previous version of the architecture presented here have been described elsewhere in greater formal detail 8 , 19 . Moreover, two proof-of-concept implementations applying GRACE to (a) reinforcement learning and (b) large language models (LLMs) demonstrate the approach’s feasibility and its capacity for reason-based guidance and behavioral control in different settings ( 21 , 20 ). 1 1 1 While this paper focuses on ethical alignment, the framework is domain-agnostic: because normative reasons apply across normative domains, it can likewise address legal compliance, cultural conventions, organizational policies, and institutional requirements 28 , 10 . GRACE decomposes monolithic agents into three specialized modules with clearly delineated roles: a Moral Module ( MM ) identifies permitted macro-action types via explicit moral reasoning; a Decision-Making Module ( DMM ) determines instrumentally optimal primitive actions within moral constraints; and a Guard ensures only permissible actions are executed. This decomposition constitutes a multi-agent system where the modules operate as specialized, sequentially acting agents that compete yet cooperate for goal-oriented but constrained decision-making. A Moral Advisor provides case-based feedback grounded in normative reasons, allowing the system to build coherent reason theories incrementally while preserving adaptability to evolving normative standards (see Figure 1 ). GRACE remains agnostic about the DMM ’s internal architecture and the Guard’s design, but requires the MM to employ explicit, formal reasoning to ensure interpretability, contestability, and justifiability. As an illustration of scenarios requiring transparent, contestable, and verifiable moral reasoning, consider: Case 1 (LLM Therapist) An AI therapist 2 2 2 We expressly do not want this example to be understood as an endorsement for an overhasty and (yet) immature use of AI in a psychotherapeutic context. The example was chosen mainly for illustrative reasons. — TherapAI —providing mental health support must navigate complex ethical tensions. It must balance its primary instrumental purpose of therapeutic effectiveness with patient safety, maintaining confidentiality and privacy while recognizing when disclosure is required. It ought to respect patient autonomy while intervening when (self-)harm risks emerge, and adhere to appropriate professional boundaries across diverse cultural contexts. This scenario requires the agent to weigh competing moral factors, apply contextual reasoning about priority relationships between instrumental goals and normative requirements, and provide justifications for its ethical decisions. Our reason-based governor architecture addresses these challenges by formally separating instrumental decision-making from normative reasoning while maintaining transparency through explicit logic governing agent behavior. The remainder of this paper first situates GRACE within AI safety, machine ethics, and AI alignment literature. We then provide a problem statement, identifying the flattening problem and motivating GRACE, before presenting the detailed specification of our architecture, formalizing the interactions between symbolic moral reasoning, instrumental optimization, and constraint enforcement, while demonstrating practical applicability through the TherapAI example. Finally, we discuss our theoretical contributions, current limitations, and outline a roadmap for future empirical validation. 2 Background A Family of Problems As AI agents become increasingly autonomous and deployed in diverse contexts, ensuring their behavior aligns with normative expectations poses unprecedented challenges. Multiple research areas engage with these: AI Safety focuses on preventing unintended harmful outcomes 4 ; Machine Ethics examines how AI agents can act ethically 41 , 61 , 5 ; and Value Alignment concerns ensuring AI aligns with human values in a broader sense. These fields, sometimes difficult to distinguish from one another 60 , 10 , share the insight that AI systems must navigate complex normative landscapes—from safety and legal compliance to moral and cultural norms—against the backdrop of disagreement and epistemic as well as (meta)normative uncertainty 30 , 50 , 29 , 57 . Current technical approaches face fundamental limitations that motivate the need for more principled architectures 58 . Reinforcement Learning from Human Feedback (RLHF) has shown practical success in LLM systems like Claude and GPT-4, but faces inherent limitations in capturing complex human values