Humanwashing - It Should Leave You Feeling Dirty

Ben Wilson, Matimba Swana, Peter Winter, Matt Roach · 2026

Read Humanwashing - It Should Leave You Feeling Dirty by Ben Wilson, Matimba Swana, Peter Winter, Matt Roach (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13723.txt.

Introduction

Ben Wilson and three colleagues argue the phrase human in the loop falsely implies safety for AI choice systems. Human oversight is a popular plan for concerns about bias, misinformation, manipulation and transparency, yet what watch means is rarely asked. The authors ask whether the loop image helps grasp of what is needed and done in a given choice context. Loose use of the image hides steps and results, feeding humanwashing, where writers use words mainly to present systems in the best light.

Catalog record

CREATORBen Wilson, Matimba Swana, Peter Winter, Matt Roach
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22597
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.13723

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Humanwashing - It Should Leave You Feeling Dirty Ben Wilson, Matimba Swana, Peter Winter, Matt Roach Abstract The phrase ‘human in the loop’ is increasingly used to imply a sense of safety in relation to AI decision systems. It shouldn’t. There are contexts where it can be applied appropriately, but these are not in the deployed decision systems we see dominating today. Human oversight of AI decision processes is one of the most popular proposals for addressing concerns, especially about bias, discrimination, misinformation, manipulation, accountability, and transparency. But there is insufficient examination of what human oversight actually means. The question raised in this paper is whether using the metaphor of a loop does anything to assist understanding of what is required and what is achieved in a particular decision context. Indiscriminate use of the loop metaphor obscures both processes and outcomes. It enables ‘humanwashing’, an activity analogous to ‘greenwashing’, where writers and commentators use language primarily aimed at putting systems in the best possible light. keywords Human-Machine Combination, Human-Machine Decision Systems, Human Computer Interaction, Oversight, Assurance and 1 Assuring decision systems AI decision processes are increasingly encountered in our daily lives. We can see around us that responses range from enthusiasm and curiosity to scepticism and aversion. Those who are sceptical or averse seek assurance. Like responsible researchers, they worry especially about bias, discrimination, misinformation, manipulation, accountability, and transparency. One of the most popular proposals from AI developers for addressing concerns is the assurance of human oversight of AI decision processes - most commonly formulated as putting a ‘human in the loop’. This is most evident in regulations and discussion about those regulations within the EU and other jurisdictions. Having a human review machine decisions is seen as protection against system error. But there is insufficient examination of what human oversight actually means [ 17 ] . Eggert raises three problems with the popular notion of ‘meaningful human control’ – compliance, dignity, and responsibility [ 6 , p215] . Though these problems are identified in the context of lethal AI systems, all three are recognisably present in diverse, consequential sectors, such as healthcare AI, finance AI, vehicular AI, and aviation AI. And yet Holzinger et al. argue that modern AI systems demand nuanced oversight mechanisms that are often underdeveloped or even lacking entirely [ 18 ] . The background against which this is being played out is that across Europe, including the UK, authorities and businesses are keen to ‘unleash’ the power of AI. They see it as a means of driving economic growth. The UK government’s pro-innovation white paper published in 2023 defines AI in terms of adaptivity and ‘autonomy’. The latter being the feature possessed by some systems that enables them to ‘make decisions without the express intent or ongoing control of a human.’ [ 5 , p24] The white paper’s miniature case studies contrast chatbot operation having ‘little need for human oversight or intervention’ with healthcare triage in which an AI system makes recommendations to a human [ 5 , p26] . The implication is that human oversight or intervention should provide reassurance. And of course the UK Information Commissioner’s Office insists that ‘human input needs to be meaningful’ in a decision-support process [ 19 ] . But in many academic papers, in supplier promotion and in deployed systems it is rarely made clear how this is to be achieved. Outside of the UK, the EU AI Act (2024) defines an AI system in similar terms – ‘autonomy’ and adaptiveness (Article 3) [ 12 ] - and it states the requirement of effective ‘human oversight’ (Article 14) [ 11 ] . But digging into what this means is complex and not yet clear in legal terms, with no sign of assurance being a foundational concept. Even before it was withdrawn [ 20 ] , the AI Liability Directive was seen as problematic by citizen groups in that it protected commercial secrets rather than claimants’ rights, with many applications not included - leaving the burden of proof of causality a huge obstacle [ 1 ] . The exclusion from this regulation of systems in which a human played a role was an incentive to notionally describe a system as having a ‘human in the loop’ without being any more explicit [ 35 ] . Similarly, the EU’s General Data Protection Regulation (GDPR) stipulates that right of access (Art 15) and right to an explanation (Art 22) only apply where a decision is based ‘solely on automated processing’ [ 10 , 36 ] . It is likely that the vast majority of AI deployments will not fit into this category. But what will we know about those that do have human involvement and hence don’t have any GDPR protection? It could easily be, ‘not much’. The conflation of an information or feedback loop with a control or decision process has grown significantly (see section 3 below). And it has allowed the language of loops to become problematic. Even if the loop is not intended to be taken literally, it has a powerful influence. The language we use about AI frames perception and behaviour [ 3 , p349] And it has implications for how society reflects on consequential outcomes if it allows side-stepping of accountability [ 7 ] . As Green puts it, in spite of the reliance on such unspecified human oversight, the bland invocation to employ this approach rests on ‘an uninterrogated assumption: that people are able to effectively oversee algorithmic decision-making’ [ 17 , p1] . Mention of humans in loops, says Green, ‘may appear to satisfy legal and philosophical principles’ but there is no empirical evidence that improvement follows [ 17 , p2] . Worse still, ‘human oversight policies create a loophole that allows agencies to adopt flawed algorithms and to shirk accountability for any harms that result.’ [ 17 , p9] And these policies serve to ‘legitimize the use of flawed and unaccountable algorithms in government’ [ 17 , p2] . Our ambition should be to improve our understanding of the effects of combining humans and machines in decision-making. 2 Human oversight - ideas and realities A typical definition for ‘human in the loop’ is an AI approach that keeps ‘human input in the algorithmic decision-making process at some level.’ [ 31 , p1] But this is sufficiently vague as to be practically meaningless. Claims that putting a human ‘in the loop’ automatically assures oversight as well as performance improvement are so pervasive online that they dominate AI-generated search summaries of the subject. And such summaries themselves will frequently assert that the claim arises from authoritative sources. But according to work by Vaccaro et al [ 30 ] , human-AI combinations performed significantly worse than the best of humans or AI alone in a survey of over a hundred peer reviewed studies of decision systems [ 30 , p2294] . The authors also found that while there were gains in creation tasks, there were performance losses in decision tasks [ 30 , p2296] . In an intriguing and counter-intuitive result that provides a glimpse into the complexity of combining humans with AI, the authors found that where AI outperformed humans, there was an overall loss

Read the complete text