The promise and perils of AI in medicine

Robert Sparrow, Joshua Hatherley · 2025

Read The promise and perils of AI in medicine by Robert Sparrow, Joshua Hatherley (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-06971.txt.

Introduction

Robert Sparrow and Joshua Hatherley survey what artificial intelligence could do for medicine, and what could go wrong on the way. The clear wins are research muscle in genomics and public health, plus sharper diagnostic help. Less noticed is the grip AI will take on how hospitals organize and bill. The popular hope that AI frees doctors for human care rests, they argue, on rosy views of health system incentives.

Privacy, surveillance, biased data, and blind trust in machines head the worry list. Deskilling, murky reasoning, and shifting power inside institutions follow. Two questions close the paper: what care means when data rivals people, and how much weight machine advice deserves.

Catalog record

CREATORRobert Sparrow, Joshua Hatherley
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-06971

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The promise and perils of AI in medicine Robert Sparrow, Joshua Hatherley Abstract What does Artificial Intelligence (AI) have to contribute to health care? And what should we be looking out for if we are worried about its risks? In this paper we offer a survey, and initial evaluation, of hopes and fears about the applications of artificial intelligence in medicine. AI clearly has enormous potential as a research tool, in genomics and public health especially, as well as a diagnostic aid. It’s also highly likely to impact on the organisational and business practices of healthcare systems in ways that are perhaps under-appreciated. Enthusiasts for AI have held out the prospect that it will free physicians up to spend more time attending to what really matters to them and their patients. We will argue that this claim depends upon implausible assumptions about the institutional and economic imperatives operating in contemporary healthcare settings. We will also highlight important concerns about privacy, surveillance, and bias in big data, as well as the risks of over trust in machines, the challenges of transparency, the deskilling of healthcare practitioners, the way AI reframes healthcare, and the implications of AI for the distribution of power in healthcare institutions. We will suggest that two questions, in particular, are deserving of further attention from philosophers and bioethicists. What does care look like when one is dealing with data as much as people? And, what weight should we give to the advice of machines in our own deliberations about medical decisions? This is a pre-print of: Sparrow, Robert, and Joshua Hatherley. 2019. The promise and perils of AI in medicine. International Journal of Chinese and Comparative Philosophy of Medicine , 17(2): 79-109. 10.24112/ijccpm.171678 1 Introduction AI encompasses a vast range of diverse technologies, and AI research cuts across a variety of disciplines including computer science, philosophy of mind, logic, neuroscience, and theoretical biology. As such, a precise definition is difficult. For our purposes, though, it will suit to suggest that AI deals with the creation of machines capable of acting rationally or intelligently ( Russell and Norvig 2016 ) . Famously, the initiators of the AI research program in the mid-1950s thought that it would only take a few months to bear fruit. After some early successes, the 1970s and 80s saw a significant drop in funding and excitement about AI – the so-called AI winter. However, recent advances in machine learning, and especially “deep learning”, prompted by the increase in available computing power and emergence of large datasets as a result of the Internet, have led to its re-emergence into the foreground of public awareness: an ‘AI spring’ is now blooming. Machine learning involves the creation of machines able to learn (semi-)autonomously from experience. Deep learning is a type of machine learning technique that uses so-called ‘deep’ neural networks (i.e. networks consisting of multiple hidden layers) to generate impressively accurate predictions and classifications. These networks are inspired by the neural architecture of the human brain, in that they consist of a complex network of interconnected ‘neurons’. An important application of deep learning, especially relevant to the applications of AI in medicine, is natural language processing, which involves the creation of models able to identify, process, and perform actions in response to written text and/or to speech. Medicine is one of the areas where there is the most enthusiasm about the application of AI. There are at least four reasons for this. First, AI is heavily reliant upon the availability of large-scale, varied datasets – so-called ‘big’ data. The digitisation of modern healthcare has generated an enormous amount of data that AI can take advantage of. Data currently being stored in electronic health records, for instance, is expected to be the first port of call for large scale developments and applications of medical AI, in addition to the data that has proliferated from wearables (e.g. FitBits), online patient forums (e.g. PatientsLikeMe), even credit card transactions ( Weber et al. 2014 ) . Second, people care about — and are willing to spend money on — their health, meaning that there is money to be made. Technology corporations, small and large, are hoping to capitalise on this new domain of healthcare technology, and so are investing heavily. Third, by improving health, AI has significant potential to help people, so there are many good people passionately dedicating themselves to this end. Finally, governments are very concerned about the size of their healthcare budgets and hope that, by identifying which treatments work and which don’t as well as by discovering new drugs and new treatments, AI might help them reduce the cost of healthcare. 1 1 1 Unfortunately, the economics of healthcare suggests that technological advances in medicine actually contribute to, rather than reduce, the total cost of healthcare, mostly because the total amount governments spend on each individual only increases with life expectancy, as older people have more complex medical needs ( Callahan 2009 ) . 2 The promise of AI in medicine Our purposes here are inevitably, for the most part, critical, in the service of what we hope is the laudable goal of drawing attention to ethical and political problems that need to be addressed in order to maximise the benefits and minimise the risks from the application of AI in healthcare. It is therefore important that we clearly state at the outset our belief that AI does have tremendous promise when it comes to the goals of medicine. In particular, we anticipate that AI will ultimately produce significant benefits in the area of research, diagnosis, and medical administration. In this section, we also consider its potential to “rehumanise” medicine by facilitating more and better communication between physicians and patients. 2.1 AI for research Increasingly, research in biology and medicine involve generating, manipulating, and analysing large datasets. One of AI’s primary strengths is its ability to identify patterns in data, where these might escape human beings, and for this reason AI has extraordinary potential as a tool for medical research. AI is already being applied in research application in genomics, drug discovery and design, and to data mine EHR systems to identify novel and clinically useful phenotypes and biomarkers of illness. Research on genomics is highly reliant on big data and sophisticated algorithms play a crucial role in genetic sequencing as well as in genome wide association studies. AI is being used to assist in the development of new drug compounds, through the prediction and identification of potentially productive and efficacious molecules. For instance, Deep Mind’s “Alphafold” AI uses machine learning to generate models of proteins based on their genetic sequences ( AlQuraishi 2019 ) . Additionally, AI has been applied for the purpose of data mining EHR systems to discover information relevant to individual patients as well as information about populations ( Chen et al. 2017 ) . There is also significant potential for AI to use novel sources of data, including that generated by mobile devices and individuals’ activity online, to generate new findings in public health. The uptake of AI for medical research has been more rapid than in clinical practice, due the more demanding regulatory regime that governs clinical applications of new technologies. The

Read the complete text