Knowledge Graph Representations for LLM-Based Policy Compliance Reasoning

Wilder Baldwin, Sepideh Ghanavati · 2026

Read Knowledge Graph Representations for LLM-Based Policy Compliance Reasoning by Wilder Baldwin, Sepideh Ghanavati (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-27713.txt.

Introduction

Baldwin and Ghanavati present an agentic framework that builds knowledge graphs from AI policy documents and fetches policy-relevant information for answering questions. They build graphs from three AI risk-related policies under two ontology schemas and test five language models on 42 policy questions spanning six reasoning types. Graph augmentation lifts scores across all five models, and an open schema found by models matches or beats the formal ontology. The work links policy documents to answers through structured, retrievable knowledge.

Catalog record

CREATORWilder Baldwin, Sepideh Ghanavati
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32486
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.27713

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Knowledge Graph Representations for LLM-Based Policy Compliance Reasoning Wilder Baldwin, Sepideh Ghanavati Abstract The risks posed by AI features are increasing as they are rapidly integrated into software applications. In response, regulations and standards for safe and secure AI have been proposed. In this paper, we present an agentic framework that constructs knowledge graphs (KGs) from AI policy documents and retrieves policy-relevant information to answer questions. We build KGs from three AI risk-related polices under two ontology schemas, and then evaluate five LLMs on 42 policy QA tasks spanning six reasoning types, from entity lookup to cross-policy inference, using both heuristic scoring and an LLM-as-judge. KG augmentation improves scores for all five models, and an open, LLM-discovered schema matches or exceeds the formal ontology. 1 Introduction AI governance frameworks such as the EU AI Act ( 12 ) , the NIST AI RMF ( 33 ) , and the OWASP Top 10 for LLM Applications ( 26 ) impose overlapping requirements on the development and deployment of AI systems. Practitioners must navigate these evolving and often cross-referencing obligations, creating a need for automated tools that can identify policy, security, and privacy risks in AI systems. Large language models (LLMs) are increasingly applied to related tasks, from extracting obligations from legislative text ( 13 ) to verifying code-level compliance ( 7 ) . Knowledge graphs (KGs) pair well with LLMs to decompose dense policy texts into typed entities and relations that preserve the structure and provenance of policy requirements. Recent work shows that KG-augmented LLM systems outperform text-only baselines on compliance tasks ( 7 ) , and the method of structuring the KG and presenting it to an LLM—from ontology design to serialization format— affects reasoning quality ( 24 ) . However, these findings were established on general-purpose KGs (Wikidata, Freebase) and open-domain QA. In this paper, we propose an agentic AI framework that includes KGs from three AI governance documents using an end-to-end pipeline: an LLM chunking agent segments policy text via a scan-and-review process, a schema-constrained extractor produces typed entities and relations, then an agentic retrieval engine traverses the resulting graph to curate evidence for answer synthesis. We evaluate different ontology schemas—a closed standards-derived schema grounded in the AI Risk Ontology (AIRO) ( 15 ) , and an open schema with emergent type labels—across three retrieval conditions (no context, full graph serialization, and agent-curated traversal) on 42 policy QA tasks spanning six reasoning types. Our evaluation is grounded in both KG comprehension benchmarks ( 24 ) and legal NLP task taxonomies ( 16 ) , ranging from single-hop entity lookup (T1) to cross-policy reasoning (T6). Evaluation uses both heuristic metrics matched to each task type and a multi-criteria LLM-as-Judge pipeline 18 ; 21 . We center our findings around two research questions: - RQ1 Can KGs integrate with LLMs to improve their ability to answer policy-related questions about risk in AI systems? We find that KG augmentation improves judge scores across all five models (+0.17 to +0.55), with the largest gains on tasks requiring verbatim policy citations, which LLMs cannot reliably produce from parametric knowledge alone. - RQ2: How can we optimize the KG creation and retrieval process for agentic Q&A in this domain? We find that an open, LLM-discovered ontology matches or exceeds a formal standards-derived schema, but agentic graph traversal degrades performance for smaller models. 2 Related Work 2.1 LLM-Based Knowledge Graph Construction and Retrieval Recent work demonstrates that LLMs can automate KG construction through multi-stage pipelines (i.e., extracting open triples, defining schemas, and canonicalizing entities) 40 ; 25 ; 5 , with CoDe-KG achieving 92.4% F1 on gold-annotated triples 5 . 41 evaluate LLMs across eight KG tasks and introduce AutoKG, a multi-agent approach that coordinates extraction and reasoning stages, finding that LLMs are better suited as inference assistants than zero-shot extractors. For LLM-augmented KG-retrieval, Graph RAG 11 pregenerates community summaries over entity graphs for query-time consolidation. RoG 22 generates relation paths grounded in KG structure for multi-hop inference, while SubgraphRAG 20 retrieves lightweight subgraphs via parallel triple scoring without fine-tuning. 23 survey the KG+LLM landscape and conclude that KG integration mitigates core LLM limitations, including poor multi-hop reasoning, outdated knowledge, and hallucination. An open question is how to represent graph-structured knowledge as text. 24 evaluate five serialization strategies on KG comprehension tasks and find that structured JSON is optimal. 10 find that linearized triples outperform natural language descriptions for fact-intensive KG questions, and 37 show that code-based KG representations improve complex reasoning over both natural language and triple formats. 2.2 Regulatory Compliance and NLP A growing body of work applies structured representations to regulatory compliance QA. GraphCompliance 7 decomposes regulatory text into policy graphs encoding compliance units as subject-constraint-context-condition tuples. RAGulating Compliance 1 extracts ontology-free SPO triplets and uses orchestrated agents with triplet-level retrieval. 19 compare naive versus graph-based RAG for EU AI Act compliance, and PrivComp-KG 14 combines a GDPR KG with SWRL rule checks. These frameworks validate graph-based approaches to compliance but evaluate them on single policies; our work extends to cross-policy reasoning across three frameworks. In the legal and policy domain, 13 apply LLaMA 3.3 70B with traditional NLP in a four-stage pipeline to extract obligations from the EU AI Act, constructing searchable KGs. 8 develop a platform combining legislative KGs with LLMs for Italian legislation, and observe that KGs provide the structured legal information LLMs need to avoid hallucinations. 9 extract KGs from privacy policies, identify 40% more data collection statements than prior methods, and enable contradiction detection. Several corpora and benchmarks support policy NLP research. OPP-115 36 provides 23K annotated privacy policy data practices, extended by PolicyQA 2 for reading comprehension and PolicyIE 3 for structured extraction. Domain-specific pretraining consistently improves performance: PrivaSeer 31 and PrivacyGLUE 29 confirm that privacy policies constitute a distinct language domain requiring specialized models. LegalBench 16 provides 162 tasks covering six types of legal reasoning. Our taxonomy draws on both KG comprehension benchmarks 24 and extends these legal NLP taxonomies, with cross-policy reasoning tasks (T6) not previously addressed. 3 Methodology We develop a four-stage pipeline—chunking, extraction, retrieval, and answer synthesis—to investigate whether grounding LLM answers in a policy-derived KG improves accuracy in question-answering tasks, and if a formal ontology outperforms an emergent one. Figure 1 shows an overview of our proposed framework. Our framework is exposed as a Model-Context-Protocol (MCP) server providing 16 tools, 7 resources, and 8 prompts, enabling integration with any MCP-compatible client. We provide a complete replication package with the MCP server, all prompts and evaluation question, as well as the results we report on in our anonymous GitHub repository. 1 1 1 https://anonymous.4open.science/r/LLM-Policy-Graph-MCP Figure 1: Agentic framework overview. Policy documents are segmented by chunking agent, structured into KG by extraction agent, then traversed by a retrieval agent to synthesize policy-grounded answers. 3.1 Document Chunking Policy documents must be segmented into chunks small enough for the LLM’s context window while preserving logical structure. Past work shows that structure-aware segmentation—splitting along logical boundaries rather than at fixed token counts—significantly improves retrieval accuracy and downstream QA performance 35 ; 4 ; 28 . Following these findings, we implement a chunking agent that identifies natural split boundaries using a two-phase scan + review design. In

Read the complete text