Knowledge Graph Analysis of Legal Understanding and Violations in LLMs
Abha Jha, Abel Salinas, Fred Morstatter · 2025
Read Knowledge Graph Analysis of Legal Understanding and Violations in LLMs by Abha Jha, Abel Salinas, Fred Morstatter (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08593.txt.
Description
Abha Jha, Abel Salinas, and Fred Morstatter examine a tension in language models: the same systems that can parse hard laws can also output dangerous instructions. Their test case is the federal statute on biological weapons, Title 18 Section 175 of the United States Code.
The method builds a knowledge graph from the law and pairs it with retrieval-augmented generation to probe the models in a structured way. Experiments check whether models can spot violations, judge unlawful intent, and resist producing banned instructions in bioweapon scenarios. The authors find real gaps in legal reasoning and safety behavior. They argue that stronger safeguards plus better legal reasoning could let models guard the law instead of enabling its breach.
Catalog record
| CREATOR | Abha Jha, Abel Salinas, Fred Morstatter |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-08593