Access Denied Inc : The First Benchmark Environment for Sensitivity Awareness

Dren Fazlija, Arkadij Orlov, Sandipan Sikdar · 2025

Read Access Denied Inc : The First Benchmark Environment for Sensitivity Awareness by Dren Fazlija, Arkadij Orlov, Sandipan Sikdar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00964.txt.

Description

Dren Fazlija, Arkadij Orlov, and Sandipan Sikdar build the first benchmark for sensitivity awareness in language models in a 2025 paper. Companies increasingly let models answer questions over internal documents. A model that ignores access rights can leak secrets to staff who should never see them. Simple filters by clearance level, though, can hurt both usefulness and privacy.

Their concept, sensitivity awareness, asks the model itself to respect access rules while it talks. Their test environment, styled as a fictional firm named in the title, Access Denied Inc, throws both forbidden and legitimate requests at models. Results varied widely across models: some leaked, some refused too much. The benchmark gives builders a shared yardstick for a skill that corporate deployment cannot skip.

Catalog record

CREATORDren Fazlija, Arkadij Orlov, Sandipan Sikdar
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-00964

Browse the full library · About the Tower of Babel