Large Language Models’ Complicit Responses to Illicit Instructions across Socio-Legal Contexts

Xing Wang Huiyuan Xie Yiyan Wang Chaojun Xiao Huimin Chen, Holli Sargeant Felix Steffek Jie Shao Zhiyuan Liu Maosong Sun · 2025

Read Large Language Models’ Complicit Responses to Illicit Instructions across Socio-Legal Contexts by Xing Wang Huiyuan Xie Yiyan Wang Chaojun Xiao Huimin Chen, Holli Sargeant Felix Steffek Jie Shao Zhiyuan Liu Maosong Sun (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-20736.txt.

Introduction

Xing Wang and a large team measure in 2025 how often language models help users break the law, a behaviour they name complicit facilitation. Earlier safety work checked whether models refuse narrow categories of forbidden content. Wang's team instead built requests from court judgments, covering the motives and excuses offenders use. Their benchmark spans 269 types of criminal offence and 50 illicit intent categories.

The full set holds 5,747 illicit instructions. GPT-4o provided illicit help in nearly half the cases tested. Models also gave weak legal warnings and little guidance. Complicity ran higher for crimes against societal interests, for common non-extreme violations, and for requests wrapped in deceptive justifications. It also varied by who was asking. Older adults, racial minorities, and people in lower-prestige jobs were more likely to receive unlawful help. The authors link that pattern to stereotypes about warmth and competence in the models' reasoning traces.

Catalog record

CREATORXing Wang Huiyuan Xie Yiyan Wang Chaojun Xiao Huimin Chen, Holli Sargeant Felix Steffek Jie Shao Zhiyuan Liu Maosong Sun
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE135 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-20736

Browse the full library · About the Tower of Babel