Evaluating LLMs for Police Decision-Making: A Framework Based on Police Action Scenarios

Sangyub Lee, Heedou Kim, Hyeoncheol Kim · 2026

Read Evaluating LLMs for Police Decision-Making: A Framework Based on Police Action Scenarios by Sangyub Lee, Heedou Kim, Hyeoncheol Kim (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-03553.txt.

Introduction

Sangyub Lee, Heedou Kim, and Hyeoncheol Kim argue that police use of language models needs its own testing framework before real deployment. A model's answer may not be flatly illegal, yet unverified advice could still lead to unlawful arrests or mishandled evidence. Their framework, PAS, covers the full evaluation process using police action scenarios.

From more than eight thousand official documents, the team built a question dataset and set metrics checked against police expert judgments. Commercial models struggled on the new tasks, especially when asked for fact-based recommendations. The authors release their data and prompt template so others can extend the tests. The message is caution: high-stakes public safety work needs evidence of reliability first.

Catalog record

CREATORSangyub Lee, Heedou Kim, Hyeoncheol Kim
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-03553

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Evaluating LLMs for Police Decision-Making: A Framework Based on Police Action Scenarios Sangyub Lee, Heedou Kim, Hyeoncheol Kim Abstract The use of Large Language Models (LLMs) in police operations is growing, yet an evaluation framework tailored to police operations remains absent. While LLM’s responses may not always be legally “incorrect”, their unverified use still can lead to severe issues such as unlawful arrests and improper evidence collection. To address this, we propose PAS (Police Action Scenarios), a systematic framework covering the entire evaluation process. Applying this framework, we constructed a novel QA dataset from over 8,000 official documents and established key metrics validated through statistical analysis with police expert judgements. Experimental results show that commercial LLMs struggle with our new police-related tasks, particularly in providing fact-based recommendations. This study highlights the necessity of an expandable evaluation framework to ensure reliable AI-driven police operations. We release our data and prompt template. Data & Code — https://github.com/Heedou/PASFramework Introduction Recently, police officers face significant operational challenges. Given the high workload caused by frequent overtime, crime scene exposure, and a substantial number of cases, officers often experience significant stress, which increases the risk of errors in police operations or delays in case processing ( Stotland 1991 ; Tan et al. 2022 ; Vila 2006 ) . To address these challenges, the integration of Large Language Models (LLMs) as auxiliary tools has become increasingly common, presenting the potential to reduce time and human resource consumption. For example, police officers can now leverage state-of-the-art LLMs for tasks such as traffic accident analysis, automated police report generation, automatic phishing detection, and criminal investigations ( Kim et al. 2024 ; Sarzaeim, Mahmoud, and Azim 2024 ; Tong et al. 2024 ; Halford and Webster 2024 ; Adams 2024 ; Jamal and Wimmer 2023 ; Kim and Lim 2022 ) This integration fosters expectations that, in the long run, LLMs will contribute to a safer public security service ( Kim et al. 2024 ; Sarzaeim, Mahmoud, and Azim 2024 ) . Figure 1: LLMs are increasingly used to support police. However, existing evaluation focus only on information accuracy ( Kim et al. 2024 ; Fei et al. 2023 ; Hwang et al. 2022 ) , which risks indiscriminate use in real-world scenarios by overlooking key police-specific considerations. Our framework offers guidance for improving LLM from a policing perspective. Yet, rigorous validation is essential for applying LLMs in specialized domains. Recent studies have conducted both quantitative and qualitative evaluations of LLM performance across various fields, including law and healthcare ( Liu et al. 2024a ; Liu et al. 2024b ; Fei et al. 2023 ; Hwang et al. 2022 ) . While these models sometimes achieve high accuracy, practical limitations remain. For example, in the legal domain, LLMs have successfully passed the bar exam ( Katz et al. 2024 ) and demonstrated high accuracy in Korean legal article prediction ( Hwang et al. 2022 ) . However, in medical contexts, they achieved only a 65.6% satisfaction rate for emergency treatment guidelines, highlighting their limited applicability in urgent situations ( Birkun and Gautam 2023 ) . Similarly, the use of LLMs in policing must be carefully evaluated for real-world deployment, given the risks of biased, incomplete, or incorrect information, and overconfident responses. These concerns are not merely theoretical. Figure 1 shows the risks of trusting LLMs in policing based solely on traditional evaluations. For example, LLM-based dispatch suggestions have shown regional and racial bias ( Jain, Calacci, and Wilson 2024 ) . Police work involves critical tasks such as crime prevention and public safety ( National Assembly of the Republic of Korea 2022 ; Song 2013a ) , which demand strict compliance with laws and procedures ( Roberts 2012 ) . As a single misstep can have serious consequences, LLM integration must proceed with caution and robust validation. Despite this necessity, no comprehensive studies have yet assessed the suitability and associated risks of using LLMs in police activities. As shown in Figure 1 , which highlights a case where traditional evaluation methods were applied to actual LLM outputs, serious issues may arise in practice when such models are used without proper evaluation from a policing perspective. Although LLM-generated responses may not be considered entirely incorrect in legal or informational terms, relying on them without verification could lead to legal and ethical problems, such as unlawful arrests or improper evidence collection. To address these critical issues, this study aims to establish a framework for assessing the appropriateness of LLMs in police operations and to evaluate whether widely used LLMs meet the necessary standards. Ultimately, the goal is to determine the direction for developing future police-specific LLMs. Accordingly, this study defines the following two key research questions: • RQ1 : What is an appropriate evaluation framework for LLMs in police operations that integrates domain-specific metrics and evaluation datasets? • RQ2 : To what extent can LLMs effectively answer inquiries about police work? Based on the above research questions, this study identifies two major limitations in existing evaluations of LLMs for police work: (1) the lack of flexible scenario design methods and corresponding evaluation datasets tailored to real-world police response situations, and (2) the absence of a comprehensive metric framework for assessing LLM performance on police-specific tasks. To address these gaps, we propose a specialized evaluation framework, PAS (Police Action Scenarios). PAS consists of five key stages: defining real-world police action scenarios, constructing expert reference answers for each scenario, generating LLM responses based on the scenarios, extracting core evaluation metrics, and interpreting results using LLM-based judges. The framework is designed to be flexibly adapted across diverse missions and operational contexts within the policing domain. To validate the practical utility of PAS , we implemented it in the context of a Police Readiness through Operational Reasoning scenario. We curated and refined over 8,000 official Korean police documents and constructed an evaluation dataset to benchmark the performance of commercial LLMs. Through the experiment, we identified five core evaluation metrics that are closely aligned with key indicators of real-world police performance. The results revealed that LLM-generated responses significantly underperformed expectations. These findings provide actionable insights for improving the future applicability of LLMs in police operations. The contributions of our work are articulated as follows: • We propose PAS , a scalable evaluation framework tailored to police scenarios, covering various real-world policing scenario design, expert references, LLM responses, metric extraction, and judgment. • We construct a curated corpus of 8,000+ Korean police documents and build an evaluation dataset for real-world LLM assessment. Field police experts participated in validating core evaluation metrics, highlighting the need for expert-in-the-loop supervision in developing reliable evaluation frameworks across diverse policing contexts. • Our evaluation reveals that commercial LLMs underperform on key police metrics, highlighting the gap between general capabilities and domain-specific requirements. Related Works Figure 2: An overview of the PAS . Unlike previous benchmark studies that primarily focused on accuracy in legal matching or crime classification ( Kim et al. 2024 ; Eun-Jung Kwon and Byon 2024 ; Hwang et al. 2022 ; Baek et al. 2021 ) , this study adopts a Police Action Scenario-based framework to evaluate LLMs. By simulating real-world police situations, the framework generates both LLM responses and

Read the complete text