Policy-Aware Generative AI for Safe, Auditable Data Access Governance

Shames Al Mandalawi, Muzakkiruddin Ahmed Mohammed, Hendrika Maclean, Mert Can Cakmak, John R. Talburt · 2025

Read Policy-Aware Generative AI for Safe, Auditable Data Access Governance by Shames Al Mandalawi, Muzakkiruddin Ahmed Mohammed, Hendrika Maclean, Mert Can Cakmak, John R. Talburt (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-23474.txt.

Introduction

Shames Al Mandalawi and four co-authors present a policy-aware generative AI controller that governs enterprise data access safely and auditably. Firms need access decisions that honor least privilege, satisfy regulations, and leave an audit trail. Their system uses a large language model, Gemini 2.0 Flash, to read natural language requests against written policies and metadata, never raw data.

A six-stage reasoning framework runs from context interpretation to risk synthesis, with hard policy gates early and deny-by-default. Outputs are approve, deny, or conditional, with reasons attached. The design aims for access governance that auditors can replay and trust.

Catalog record

CREATORShames Al Mandalawi, Muzakkiruddin Ahmed Mohammed, Hendrika Maclean, Mert Can Cakmak, John R. Talburt
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-23474

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Policy-Aware Generative AI for Safe, Auditable Data Access Governance Shames Al Mandalawi, Muzakkiruddin Ahmed Mohammed, Hendrika Maclean, Mert Can Cakmak, John R. Talburt Abstract Enterprises need access decisions that satisfy least privilege, comply with regulations, and remain auditable. We present a policy aware controller that uses a large language model (LLM) to interpret natural language requests against written policies and metadata, not raw data. The system, implemented with Google Gemini 2.0 Flash, executes a six-stage reasoning framework (context interpretation, user validation, data classification, business purpose test, compliance mapping, and risk synthesis) with early hard policy gates and deny by default. It returns APPROVE, DENY, CONDITIONAL together with cited controls and a machine readable rationale. We evaluate on fourteen canonical cases across seven scenario families using a privacy preserving benchmark. Results show Exact Decision Match improving from 10/14 to 13/14 (92.9%) after applying policy gates, DENY recall rising to 1.00, False Approval Rate on must-deny families dropping to 0, and Functional Appropriateness and Compliance Adherence at 14/14. Expert ratings of rationale quality are high, and median latency is under one minute. These findings indicate that policy constrained LLM reasoning, combined with explicit gates and audit trails, can translate human readable policies into safe, compliant, and traceable machine decisions. I Introduction Enterprises make continual data access decisions that must satisfy least privilege, comply with multiple regulations, and remain auditable. Manual review is slow and inconsistent, while rule based systems are brittle when policies interact, request intent is ambiguous, or context shifts across teams and jurisdictions. Errors in either direction create cost: unsafe approvals increase risk, and unnecessary denials impede operations. These pressures motivate a governance approach that combines the nuance of human reasoning with the scale and consistency of automation. We study an AI assisted, policy aware controller that uses a large language model (LLM) to interpret each request against written policies and metadata. The controller executes a six stage reasoning flow, applies non negotiable policy gates early, and follows deny by default when identity or policy context is missing. It returns { APPROVE , DENY , CONDITIONAL } with a concise rationale and enforceable controls, and records a machine readable audit trail suitable for compliance review. We use Google Gemini 2.0 Flash, a generative AI large language model, to perform the policy interpretation; hereafter we refer to this component as the LLM. To evaluate this approach, we investigated the following research questions: • RQ1: Does an LLM based, policy aware controller make access decisions as well as or better than manual review and rule based engines? • RQ2: Can it meet regulatory requirements while reducing decision time? • RQ3: Are the generated rationales clear and useful for audit and governance? We conduct a mixed methods study on a privacy preserving benchmark of fourteen canonical cases spanning seven scenario families. The evaluation focuses on the controller itself and reports Exact Decision Match, class wise precision and recall, Functional Appropriateness, Compliance Adherence, safety metrics for must deny families, and latency percentiles. A key design choice is to confine the LLM to organization provided policies and metadata rather than raw data, and to embed safety through hard policy gates and explicit conditional semantics. Together, these choices turn human readable policies into auditable machine decisions while aligning with privacy and compliance expectations. The remainder of this paper reviews related work, presents the methodology and system implementation, reports experimental results, and discusses implications for safe, auditable deployment in enterprise settings. II Literature Review Generative AI has accelerated interest in data governance by promising richer policy interpretation and automation while introducing new risks. Foundational work on AI enabled governance highlights both opportunity and responsibility. Sugureddy [ 1 ] shows how AI/ML can strengthen enterprise governance beyond static controls, and Janssen et al. [ 2 ] formalize trustworthy AI through design principles for Big Data Algorithmic Systems. Recent GenAI specific frameworks map lifecycle risks and enterprise needs: Yuan et al. [ 3 ] propose an Enterprise GenAI Data Governance Framework with seven lifecycle components, and the studies [ 4 , 5 , 6 ] frames GenAI governance as a complex adaptive system with joint accountability. Sector studies underline domain constraints. In healthcare, Pahune et al. [ 7 ] advocate governance across LLM lifecycles, and Athanasopoulou [ 8 ] analyzes GDPR compliance gaps with conversational models. In finance, Xu [ 9 ] surveys phased GenAI adoption, while Mhammad et al. [ 10 ] combine generative methods with differential privacy for AML. For the public sector, Chun and Noveck [ 20 ] describe Government 4.0 patterns, and Popovski [ 21 ] compares practices across multiple industries. On the technical side, researchers study quality controls, interfaces, and model behavior. Yandrapalli [ 11 ] automates data quality using statistical and ML detectors; Mani and Vanitha [ 12 ] integrate GPT 4 style analytics under security guardrails; Prasad and Paripati [ 13 ] address cloud governance with automated discovery and monitoring. At the model layer, the studies [ 14 , 15 ] benchmark LLM syntactic and behavioral understanding and call for verification, and Cheng et al. [ 16 ] show that leveraging linguistic structure improves extraction and topical fidelity. Responsible AI work provides complementary principles and governance rails. Thomas [ 17 ] articulates five practice oriented principles for LLM use; Oladosu et al. [ 18 ] integrate privacy and fairness with business optimization; Gupta and Parmar [ 19 ] emphasize sustainable operations with automated compliance monitoring. Parallel streams explore new governance models and organizational readiness: Symeonidis and Nikiforova [ 22 ] discuss GenAI in public data ecosystems; Micheli et al. [ 23 ] survey data trusts, cooperatives, and sovereignty models; Duzha et al. [ 24 ] propose DGaaS; and Kongsten and Kathirgamadas [ 25 ] derive maturity and implementation frameworks from expert interviews. Regulatory alignment remains central: Fischer and Piskorz Ryń [ 26 ] examine the European Data Governance Act context, and Gudepu and Eichler [ 27 ] outline GDPR and CCPA aligned operating practices with risk based assessments and third party oversight. Across this literature, three gaps remain. First, most works articulate governance principles or components, but few demonstrate a system level controller that converts human readable policies into auditable machine decisions with explicit conditional semantics. Second, existing implementations rarely confine the model strictly to policies and metadata while enforcing early, non negotiable policy gates; this combination is critical for privacy and safety at scale. Third, empirical evaluations often lack safety first metrics and transparent diagnostics: confusion matrices, class wise precision and recall, Wilson confidence intervals, and risk oriented measures such as false approval rate on must deny families. Our study directly addresses these gaps. We present a policy aware controller that runs a six stage reasoning flow, evaluates hard policy gates before aggregation, follows deny by default, and outputs { APPROVE , DENY , CONDITIONAL } with enforceable controls and machine readable audit trails. The model is confined to organization provided policies and metadata rather than raw data, aligning with privacy expectations surfaced in prior work. We provide a mixed methods evaluation on a privacy preserving benchmark and report system level results with safety metrics, side by side confusion matrices, confidence intervals, and representative cases. In short, whereas prior studies define

Read the complete text