Access Denied Inc : The First Benchmark Environment for Sensitivity Awareness
Dren Fazlija, Arkadij Orlov, Sandipan Sikdar · 2025
Read Access Denied Inc : The First Benchmark Environment for Sensitivity Awareness by Dren Fazlija, Arkadij Orlov, Sandipan Sikdar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00964.txt.
Description
Dren Fazlija, Arkadij Orlov, and Sandipan Sikdar build the first benchmark for sensitivity awareness in language models in a 2025 paper. Companies increasingly let models answer questions over internal documents. A model that ignores access rights can leak secrets to staff who should never see them. Simple filters by clearance level, though, can hurt both usefulness and privacy.
Their concept, sensitivity awareness, asks the model itself to respect access rules while it talks. Their test environment, styled as a fictional firm named in the title, Access Denied Inc, throws both forbidden and legitimate requests at models. Results varied widely across models: some leaked, some refused too much. The benchmark gives builders a shared yardstick for a skill that corporate deployment cannot skip.
Catalog record
| CREATOR | Dren Fazlija, Arkadij Orlov, Sandipan Sikdar |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-00964