OrgForge-IT: A Verifiable Synthetic Benchmark for LLM-Based Insider Threat Detection Multi-Surface Behavioral Telemetry with Deterministic Ground Truth and a Multi-Model Leaderboard
Jeffrey Flynt · 2026
Read OrgForge-IT: A Verifiable Synthetic Benchmark for LLM-Based Insider Threat Detection Multi-Surface Behavioral Telemetry with Deterministic Ground Truth and a Multi-Model Leaderboard by Jeffrey Flynt (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-22499.txt.
Description
Flynt presents OrgForge-IT, a synthetic benchmark for testing language models on insider threat detection. Fake data often contradicts itself, so a fixed simulation engine holds the ground truth while models write only the surface prose. The corpus spans 51 days of records that are more than nine tenths noise. Ten models are ranked on four scenarios built to defeat quick, single-day triage. The results split sharp verdicts from noisy ones and expose weak spots like blaming the wrong victim.
Catalog record
| CREATOR | Jeffrey Flynt |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70905 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.22499