OrgForge-IT: A Verifiable Synthetic Benchmark for LLM-Based Insider Threat Detection Multi-Surface Behavioral Telemetry with Deterministic Ground Truth and a Multi-Model Leaderboard

Jeffrey Flynt · 2026

Read OrgForge-IT: A Verifiable Synthetic Benchmark for LLM-Based Insider Threat Detection Multi-Surface Behavioral Telemetry with Deterministic Ground Truth and a Multi-Model Leaderboard by Jeffrey Flynt (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-22499.txt.

Description

Flynt presents OrgForge-IT, a synthetic benchmark for testing language models on insider threat detection. Fake data often contradicts itself, so a fixed simulation engine holds the ground truth while models write only the surface prose. The corpus spans 51 days of records that are more than nine tenths noise. Ten models are ranked on four scenarios built to defeat quick, single-day triage. The results split sharp verdicts from noisy ones and expose weak spots like blaming the wrong victim.

Catalog record

CREATORJeffrey Flynt
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70905
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.22499

Browse the full library · About the Tower of Babel