A Moral Agency Framework for Legitimate Integration of AI in Bureaucracies

Chris Schmitz, Joanna Bryson · 2025

Read A Moral Agency Framework for Legitimate Integration of AI in Bureaucracies by Chris Schmitz, Joanna Bryson (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-08231.txt.

Introduction

Chris Schmitz and Joanna Bryson set out rules for putting AI into public bureaucracies without losing accountability, in this 2025 paper. Governments want AI's gains, but machine agency can create ethics sinks, spots where blame for bad outcomes dissolves. The authors deny such sinks are forced. They arise, they argue, from design choices in the tool and in the office that adopts it.

Reading AI ethics through the lens of Weber's bureaucracy theory, they propose a three-point framework. Keep clear, just human lines of accountability. Make sure staff can check that the system works right. Add AI only where it does not weaken the office's twin aims of legitimacy and stewardship. Used so, they say, AI can raise transparency rather than erode it.

Catalog record

CREATORChris Schmitz, Joanna Bryson
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-08231

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Moral Agency Framework for Legitimate Integration of AI in Bureaucracies Chris Schmitz, Joanna Bryson Abstract Public-sector bureaucracies seek to reap the benefits of artificial intelligence (AI), but face important concerns about accountability and transparency when using AI systems. In particular, perception or actuality of AI agency might create ethics sinks — constructs that facilitate dissipation of responsibility when AI systems of disputed moral status interface with bureaucratic structures. Here, we reject the notion that ethics sinks are a necessary consequence of introducing AI systems into bureaucracies. Rather, where they appear, they are the product of structural design decisions across both the technology and the institution deploying it. We support this claim via a systematic application of conceptions of moral agency in AI ethics to Weberian bureaucracy. We establish that it is both desirable and feasible to render AI systems as tools for the generation of organizational transparency and legibility, which continue the processes of Weberian rationalization initiated by previous waves of digitalization. We present a three-point Moral Agency Framework for legitimate integration of AI in bureaucratic structures: (a) maintain clear and just human lines of accountability, (b) ensure humans whose work is augmented by AI systems can verify the systems are functioning correctly, and (c) introduce AI only where it doesn’t inhibit the capacity of bureaucracies towards either of their twin aims of legitimacy and stewardship. We suggest that AI introduced within this framework can not only improve efficiency and productivity while avoiding ethics sinks, but also improve the transparency and even the legitimacy of a bureaucracy. 1 Introduction Public sector organizations (PSOs) are increasingly integrating artificial intelligence (AI) systems into their operations, hoping to capture the gains in efficiency, personalization, and worker satisfaction the technology promises. Existing research identifies a wide range of tasks within PSOs potentially addressable using AI technology, including automating routine processes, interacting with citizens, structuring unstructured data, and supporting decision-making ( Wirtz et al., 2019 ; Hjaltalin and Sigurdarson, 2024 ) . Significant capability gains for AI tools have fueled predictions that this range will continue to expand and may soon include the vast majority of tasks currently performed by humans in PSOs. Further, the ability of non-state actors to leverage these capability gains may put PSOs under an imperative to integrate AI systems into their operations to retain their relative capacity ( Bullock et al., 2025 ) . Ideally, the introduction of AI systems should simply continue processes of rationalization that previous waves of digitalization have driven ( Muellerleile and Robertson, 2018 ; Mokander and Schroeder, 2024 ) . Such processes include the generation of organizational transparency, legibility, and legitimacy via encoding processes in a formal logic ( Roehl and Crompvoets, 2025 ) , and retaining complete and searchable digital records of processes, decisions, and accountability. However, at least two narratives of AI technology run counter to this outcome. First, AI is often characterized as ‘necessarily opaque,’ ignoring a vast literature and indeed even established standards on AI transparency ( Winfield et al., 2021 ) . Second, there is debate on whether AI systems can hold responsibility for their actions, a property known as moral agency . Appropriate attribution of moral or at least legal agency within any organization is critically important. Bureaucracies in particular derive their democratic legitimacy from their ability to correctly attribute responsibility and ensure accountability, in order to ensure not only good behavior, but steady improvement ( Gasser and Mayer-Schönberger, 2024 ) . Thus both disputed moral status and more general claims of intransparency have led to concerns about introducing opaqueness, accountability gaps, or an entirely new and largely unaccountable form of agency into bureaucracies. Such concerns can even be self-fulfilling. Nothing about digital systems intrinsically ensures that they produce the records necessary for accountability, or that such records, if produced, are stored immutably. Thus myths of unaccountability could lead to the procurement of AI systems unsuitable for good government. Here, we seek to refute the notion that unresolvable questions of moral agency and accountability are an inevitable consequence of introducing AI into bureaucratic structures. Rather, constructs leading to unattributed accountability in bureaucracies — which we term as “ethics sinks” — are the result of design decisions . It is feasible both institutionally and technically to integrate AI systems within robust and holistic systems of responsibility distribution, and thereby to ensure that AI systems enhance, rather than inhibit, bureaucratic rationality. We postulate that there exist frameworks of design rules, which allow organizations to avoid the misapplication of power, and to ensure the accountability essential for social maintenance and improvement. Indeed, we propose one such framework here. In so doing, we seek to render any institutional design that does afford ethics sinks as evidently negligent. This paper is structured as follows. In Section 2 , we review from established literature the structural promise and purpose of bureaucracy, as relevant for the context of the responsible introduction of AI. We describe the role of moral agency in enabling the dual aims of bureaucracy: legitimate enactment of legislation, and the provision of stewardship that allows social maintenance and improvement. In Section 3 , we review the debate as to whether AI is a tool or a moral subject. We dismantle this false dichotomy in a bureaucratic context by framing AI systems as elements of the institutional structure of Weberian bureaucracy. In systems designed with care, machine intelligence supports the moral agency of individual bureaucrats, without siphoning it off to other organizations, or itself holding moral status. This allows bureaucracies to be grounded in democratic legitimacy, provided that all (human) moral agents are answerable to elected officials. In Section 4 , we propose a three-step moral agency framework (MAF) for integrating AI into bureaucracies. We show that the framework prevents issues of responsibility attribution arising from the use of “ordinary” agents — active entities holding no moral status — by the human network that composes the moral core of a bureaucracy. 2 The Dual Purposes of Bureaucracy Bureaucratic public-sector organizations serve twin purposes. The first is the legitimate enactment, implementation, and enforcement of legislation passed down by the elected legislature. The other is the provision of stewardship, that is: the maintenance of conditions of long-term stability for both the general public, and the government itself. In this section, we establish that the mechanisms by which bureaucracy fulfills each of these purposes presuppose, and even require, the moral agency of human bureaucrats. We further argue that to the extent a trade-off exists between bureaucracy’s twin purposes, the introduction of AI systems — or any other measures impacting the agency of the organization — can aid one purpose while interfering with the other. We argue such a perverse outcome is plausible, but may not be necessary, and should be defended against. Figure 1: Illustration of the “Pareto Frontier” between bureaucracies’ dual aims of stewardship and legitimacy. PSOs not at the frontier can improve in one dimension without necessarily jeopardizing the other. Legitimate Implementation of Legislation In most government systems, public sector organizations (PSOs) have a considerable mandate to interpret, enforce, and uphold legislative will. They are usually granted power to take actions with significant and wide-ranging implications for citizens. This power is, in democracies, also

Read the complete text