Street-Level AI: Are Large Language Models Ready for Real-World Judgments?

Gaurab Pokharel, Shafkat Farabi, Patrick J. Fowler Sanmay Das · 2025

Read Street-Level AI: Are Large Language Models Ready for Real-World Judgments? by Gaurab Pokharel, Shafkat Farabi, Patrick J. Fowler Sanmay Das (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-08193.txt.

Introduction

Gaurab Pokharel, Shafkat Farabi, Patrick Fowler, and Sanmay Das ask in 2025 if large language models are ready to help assign scarce social aid. Staff who make such calls face hard choices shaped by local justice norms. The test case is housing aid for people without homes, scored by set need scales.

With real case data kept private on local models, the model rankings proved unstable across runs and across models. They also clashed with the set need scales in use. In pair tests the models did match lay human choices in broad terms, a split the authors say bars naive use.

Catalog record

CREATORGaurab Pokharel, Shafkat Farabi, Patrick J. Fowler Sanmay Das
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-08193

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Street-Level AI: Are Large Language Models Ready for Real-World Judgments? Gaurab Pokharel, Shafkat Farabi, Patrick J. Fowler Sanmay Das Abstract A surge of recent work explores the ethical and societal implications of large-scale AI models that make “moral” judgments. Much of this literature focuses either on alignment with human judgments through various thought experiments or on the group fairness implications of AI judgments. However, the most immediate and likely use of AI is to help or fully replace the so-called street-level bureaucrats, the individuals deciding to allocate scarce social resources or approve benefits. There is a rich history underlying how principles of local justice determine how society decides on prioritization mechanisms in such domains. In this paper, we examine how well LLM judgments align with human judgments, as well as with socially and politically determined vulnerability scoring systems currently used in the domain of homelessness resource allocation. Crucially, we use real data on those needing services (maintaining strict confidentiality by only using local large models) to perform our analyses. We find that LLM prioritizations are extremely inconsistent in several ways: internally on different runs, between different LLMs, and between LLMs and the vulnerability scoring systems. At the same time, LLMs demonstrate qualitative consistency with lay human judgments in pairwise testing. Findings call into question the readiness of current generation AI systems for naive integration in high-stakes societal decision-making. 1 Introduction Large language models (LLMs) have captured public attention and have been broadly touted for their ability to reduce and streamline human work. A question of particular interest of late has been how the moral judgments of LLMs compare with those of humans. This has been engaged in the context of philosophical moral dilemmas ( Kim et al. 2025 ; Jha et al. 2024 ; Rathje 2024 ; Dillion et al. 2025 ) , organ transplantation ( Murray et al. 2025 ; Hasjim et al. 2024 ) , and fair division ( Hosseini and Khanna 2025 ) , among other domains. With the exception of organ transplantation, most research attends to general conceptions of ethical judgment or definitions of fairness from the fair division community. The central questions of these lines of research have been in trying to understand which general theories of ethics or definitions of fairness LLMs appear to satisfy or whether they replicate certain aspects of human behavior. However, LLMs are likely to see rapid uptake in domains that involve the allocation of scarce societal resources. The stakes will be more immediate and higher than in toy examples or constructed moral dilemmas, given the scale enabled by AI and the potential number of people affected by such decision-making in high-stakes domains like homelessness services, post-disaster medical triage, and organ transplantation. By analogy to “vibe coding,” those working in these domains may feel pressure to use AI to make “vibe prioritization” decisions. Such social and health service settings share key features uniquely relevant for adapting AI applications. First, current delivery reflects local justice principles and prioritization practices that emerged to fit the specific contexts over time ( Elster 1992 ) . Scarcity requires the adoption of agreed upon rules of who should get what, when, and how. For example, homelessness services – the focus of the present study – currently use a “vulnerability first” prioritization, where households deemed to be at greatest risk receive highest priority for resource allocation ( Kube, Das, and Fowler 2023 ) . Medical triage, by contrast, often prioritizes based on maximum expected improvement from receiving the resource. Prioritization frameworks are not inherent and rather emerge from complex social and political processes at play in many countries’ social safety net contexts. For homelessness, implementation involves the use of point systems based on questionnaire responses administered to at-risk households upon contact with the system (often in so-called “coordinated entry” settings). Point systems are what we refer to as bureaucratic scoring systems frequently observed in other domains, like public housing and prioritization for liver transplant ( Johnson and Zhang 2022 ; Been et al. 2018 ; Cholongitas, Germani, and Burroughs 2010 ) . Second, actual allocation decisions occur in the province of street-level bureaucrats – civil servants and caseworkers allowed to use their experience to exercise discretion in decision making ( Lipsky 1980 ) . Bureaucratic scoring systems often inform, but do not determine, decisions. Bureaucrats themselves bring considerable domain knowledge and expertise from interacting directly with those who ultimately face the outcomes of decisions. Given the embedding within local contexts, street-level judgments likely differ from those of lay humans. Importantly, it is these frontline workers who are likely to be replaced or supplemented by LLMs or “vibe prioritization.” It is crucial to understand how LLMs would make decisions in such domains and to be as close to reality as possible. Prior work on organ transplantation appears to come closest to doing so. Murray et al. 2025 examine the abilities of LLMs to assess medical compatibility in kidney transplantation, as well as the group fairness implications of LLM prioritization. Likewise, Hasjim et al. 2024 investigate the abilities of LLMs to predict medical benefits and risks of liver transplantation. Yet, neither paper compares LLM prioritization with an established human system of prioritization. This is the gap that we seek to fill. By systematically querying LLMs, we show that they behave in ways that are qualitatively similar to lay humans, as evidenced by a different set of pairwise comparison experiments. Moreover, using a novel dataset of households experiencing homelessness in a major metro area, we compare LLM prioritization with two different standard bureaucratic prioritization methods and assess how well each method predicts the actual allocation decisions of homeless service providers. In contrast with their similarities to lay humans in the simulated task, we find that LLMs are (1) internally inconsistent in the rankings they generate across different runs; (2) inconsistent with the rankings generated by bureaucratic ranking systems; and (3) worse at predicting the allocation decisions of caseworkers (although the scoring systems themselves are not great at this). Taken together, the results seriously question the replacement of street-level bureaucrats with AI in high-stakes societal allocation domains and emphasize the importance of understanding the behavior of front-line workers interacting with the uncertainties inherent in homeless service provision. 2 Background In just the past few years, public interest in LLMs has surged remarkably, and researchers have explored their potential to make moral judgments and guide fair resource allocation. In particular, abstract allocation tasks – where agents distribute indivisible goods and, optionally, monetary compensation among individuals with heterogeneous valuations – have assessed LLM behavior against foundational fairness axioms such as equitability and envy‐freeness. Hosseini and Khanna 2025 show that although LLMs can sometimes satisfy single fairness criteria, their choices often diverge from human distributional preferences and are sensitive to prompt phrasing and persona assignments. Complementing these findings, Kim et al. 2025 document substantial variance in moral reasoning when models adopt different sociodemographic personas, with politically charged framings exacerbating bias and polarization. At the same time, LLMs hold the promise of articulating trade-offs and justifying their decisions in rich natural language rationales – fueling an emerging concern: do these “toy” successes hold up under the pressures of real-world stakes? Such stylized experiments, whether

Read the complete text