CrimeMind: Simulating Urban Crime with Multi-Modal LLM Agents

Qingbin Zeng, Ruotong Zhao, Jinzhu Mao, Haoyang Li, Fengli Xu, Yong Li · 2025

Read CrimeMind: Simulating Urban Crime with Multi-Modal LLM Agents by Qingbin Zeng, Ruotong Zhao, Jinzhu Mao, Haoyang Li, Fengli Xu, Yong Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-05981.txt.

Introduction

Qingbin Zeng and five co-authors simulate city crime with language model agents that can see their surroundings. Their paper appeared in two thousand twenty-five. Rule-based agent models explain mechanisms but predict poorly. Deep learning predicts better yet stays opaque and data hungry. Neither adapts well when the city changes. Their CrimeMind framework aims for all three virtues.

Routine Activity Theory structures how the agents act. Offenders, targets, and guardians meet in simulated urban scenes. Visual, social, and cultural cues feed the agents' choices. The agents reason flexibly as conditions shift. City simulations gain a cognitive layer over classic agent models. Urban safety research gets a new sandbox.

Catalog record

CREATORQingbin Zeng, Ruotong Zhao, Jinzhu Mao, Haoyang Li, Fengli Xu, Yong Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-05981

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CrimeMind: Simulating Urban Crime with Multi-Modal LLM Agents Qingbin Zeng, Ruotong Zhao, Jinzhu Mao, Haoyang Li, Fengli Xu, Yong Li Abstract Modeling urban crime is an important yet challenging task that requires understanding the subtle visual, social, and cultural cues embedded in urban environments. Previous work has predominantly focused on rule-based agent-based modeling (ABM) and deep learning methods. ABMs offer interpretability of internal mechanisms but exhibit limited predictive accuracy. In contrast, deep learning methods are often effective in prediction but are less interpretable and require extensive training data. Moreover, both lines of work lack the cognitive flexibility to adapt to changing environments. Leveraging the capabilities of large language models (LLMs), we propose CrimeMind , a novel LLM-driven ABM framework for simulating urban crime within a multi-modal urban context. A key innovation of our design is the integration of the Routine Activity Theory (RAT) into the agentic workflow of CrimeMind, enabling it to process rich multi-modal urban features and reason about criminal behavior. However, RAT requires LLM agents to infer subtle cues in evaluating environmental safety as part of assessing guardianship, which can be challenging for LLMs. To address this, we collect a small-scale human-annotated dataset and align CrimeMind’s perception with human judgment via a training-free textual gradient method. More importantly, we leverage the commonsense reasoning capabilities of LLMs, which enable CrimeMind to conduct counterfactual simulations. Experiments across four major U.S. cities demonstrate that CrimeMind outperforms both traditional ABMs and deep learning baselines in crime hotspot prediction and spatial distribution accuracy, achieving up to a 24% improvement over the strongest baseline. Furthermore, we conduct counterfactual simulations of external incidents (e.g., Black Lives Matter protests) and policy interventions (e.g., the Dallas Police Redistribution Plan). CrimeMind successfully captures the expected changes in crime patterns, demonstrating its ability to reflect counterfactual scenarios. Overall, CrimeMind enables fine-grained modeling of individual behaviors and facilitates evaluation of real-world interventions. Our code is open-source at https://anonymous.4open.science/r/CrimeMind-EB3E . 1 Introduction Understanding and simulating urban crime is a central challenge at the intersection of computational science, criminology, and urban planning [ 1 ] . As cities grow in population, density, and inequality, crime increasingly reflects not only socioeconomic disparities but also complex interactions between individuals and their physical surroundings. Predicting where and why crimes happen requires models that account for subtle cues in the built environment—such as visual disorder, perceived safety, and social activity patterns, as well as the behaviors and intentions of individuals. These demands go far beyond simple statistical correlations or historical trend extrapolation, making urban crime modeling a uniquely difficult and socially impactful task. Existing approaches generally fall into two categories: data-driven supervised learning and rule-based agent-based models (ABMs). Supervised models are often effective at forecasting crime hotspots [ 2 , 3 , 4 ] , but they rely heavily on historical data, lack interpretability, and cannot simulate interventions or unseen scenarios. In contrast, ABMs offer interpretability and support counterfactual analysis [ 5 , 6 ] , but often rely on hand-crafted heuristics that exhibit limited predictive accuracy. Importantly, neither paradigm offers the cognitive flexibility needed to capture the situated, adaptive nature of criminal decision-making in complex and evolving urban contexts. Recent advances in large language models (LLMs) provide a potential way to overcome these limitations. LLMs demonstrate strong capabilities in commonsense reasoning and role-playing [ 7 ] , and recent work has used LLM-based agents to simulate macroeconomic trends [ 8 ] , cultural evolution [ 9 ] , and opinion polarization [ 10 ] . However, current LLM-based generative agent frameworks typically focus on general planning or social routines, and lack integration with domain-specific social theories. More importantly, they struggle to interpret multi-modal urban environments, which are critical for modeling real-world criminal behavior. To bridge these gaps, we introduce CrimeMind , an LLM-driven agent-based framework for simulating urban crime in multimodal contexts. A key innovation of our approach is the integration of Routine Activity Theory (RAT) [ 11 ] into the cognitive architecture of LLM-powered agents, enabling theory-grounded and context-aware decision-making. Incorporating RAT into agent behavior allows for interpretable, theory-consistent reasoning about crime events. However, applying RAT in practice requires agents to infer subtle environmental cues to assess guardianship and situational risk—an ability that remains challenging for LLMs due to their limited perceptual grounding. To address this, we collect a small-scale human-annotated dataset and employ a training-free textual gradient alignment method based on TextGrad [ 12 ] , aligning the visual perception of agents with human judgments. This alignment significantly improves the correlation between predicted and human-rated safety scores, increasing from 42% to 79%. Criminal agents reason dynamically over RAT—identifying targets, estimating risks, and adapting behavior—guided by in-context LLM inference. This design enables CrimeMind not only to replicate real-world crime distributions but also to simulate counterfactual scenarios by leveraging the commonsense reasoning capabilities of LLMs. Extensive experiments across four major U.S. cities demonstrate that CrimeMind outperforms traditional agent-based models and deep learning baselines in both hotspot prediction and distributional accuracy, achieving over 24% relative enhancement on average. Our ablation studies further reveal the critical contributions of theory-guided reasoning, multimodal urban context, and the general reasoning abilities of the LLM. Moreover, we conduct counterfactual simulations of external shocks (e.g., Black Lives Matter protests) and policy interventions (e.g., the Police Redistribution Plan in Dallas). CrimeMind successfully captures expected changes in crime patterns, demonstrating its ability to reflect counterfactual scenarios, enabling “what-if” analyses for urban safety planning. In summary, the main contributions of this work include: • We propose the first generative agent-based crime simulation framework that explicitly integrates criminological theory into cognitive architecture of LLM agents, enabling interpretable and realistic modeling of criminal behavior in complex urban environments. • We calibrate agents’ perception of visual safety with human judgments via a training-free textual gradiant approach. This alignment allows agents to infer subtle environmental cues necessary for reproducing more human-like crime patterns. • Through extensive experiments, we demonstrate that CrimeMind outperforms existing baselines in crime simulation, and more importantly, it enables counterfactual simulations under social shocks and policy interventions, offering a valuable tool for urban safety evaluation and planning. 2 Related Work Crime Simulation Recent studies have shown that understanding and predicting urban crime is a significant social and scientific challenge [ 1 , 13 ] . Deep learning approaches, such as the Granger Network [ 3 ] and DiffCrime [ 4 ] , have demonstrated strong performance, but the black-box nature limits the interpretability and counterfactual reasoning. In contrast, traditional ABMs simulate criminal behavior by encoding decision-making rules derived from criminological theories such as Routine Activity Theory [ 11 ] or Rational Choice Theory [ 14 ] . These models provide more interpretable simulations and applications in burglary prevention [ 5 ] and police strategy [ 15 , 6 ] . However, these models often oversimplify agent cognition, ignoring bounded rationality, perceptual cues, and agent heterogeneity. To address these limitations, we propose an LLM-driven agent-based framework that is grounded in criminological theory and enriched with urban context. This approach enhances both the realism and the interpretability of simulated crimes by capturing complex, context-aware dynamics. Generative Agents in Social Simulation With the emergent role-play and reasoning capabilities of LLMs [ 16 ] , generative agents have emerged as

Read the complete text