Can We Trust AI to Govern AI? Benchmarking LLM Performance on Privacy and AI Governance Exams
Zane Witherspoon, Thet Mon Aye, YingYing Hao · 2025
Read Can We Trust AI to Govern AI? Benchmarking LLM Performance on Privacy and AI Governance Exams by Zane Witherspoon, Thet Mon Aye, YingYing Hao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-09036.txt.
Introduction
Zane Witherspoon, Thet Mon Aye, and YingYing Hao test ten leading language models on professional exams in privacy and AI governance. Privacy staff need to know if these tools can be trusted on law, program management, and technical controls. The exams used are the standard tests for human certification in this field.
Each model took official sample exams with no outside help, and scores were set against human pass marks. Several top models cleared those marks by a clear margin, showing strong grasp of privacy law and governance. Gaps remained in some areas. The study offers a human-based yardstick for judging AI help in high-stakes compliance work.
Catalog record
| CREATOR | Zane Witherspoon, Thet Mon Aye, YingYing Hao |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-09036
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Can We Trust AI to Govern AI? Benchmarking LLM Performance on Privacy and AI Governance Exams Zane Witherspoon, Thet Mon Aye, YingYing Hao Abstract The rapid emergence of large language models (LLMs) has raised urgent questions across the modern workforce about this new technology’s strengths, weaknesses, and capabilities. For privacy professionals, the question is whether these AI systems can provide reliable support on regulatory compliance, privacy program management, and AI governance. In this study, we evaluate ten leading open and closed LLMs, including models from OpenAI, Anthropic, Google DeepMind, Meta, and DeepSeek, by benchmarking their performance on industry-standard certification exams: CIPP/US, CIPM, CIPT, and AIGP from the International Association of Privacy Professionals (IAPP). Each model was tested using official sample exams in a closed-book setting and compared to IAPP’s passing thresholds. Our findings show that several frontier models such as Gemini 2.5 Pro and OpenAI’s GPT-5 consistently achieve scores exceeding the standards for professional human certification - demonstrating substantial expertise in privacy law, technical controls, and AI governance. The results highlight both the strengths and domain-specific gaps of current LLMs and offer practical insights for privacy officers, compliance leads, and technologists assessing the readiness of AI tools for high-stakes data governance roles. This paper provides an overview for professionals navigating the intersection of AI advancement and regulatory risk and establishes a machine benchmark based on human-centric evaluations. 1 Introduction Consumers of large language model (LLM) technologies currently face a broad array of models to consider when making purchasing decisions. Informed consumers typically weigh many factors, but a primary concern in non-deterministic systems is comparative performance. To address this, several prominent LLM benchmarks have emerged. Notable multidisciplinary benchmarks include LiveBench [ 1 ] , SuperGLUE [ 2 ] , and Big-Bench [ 3 ] . In addition, various domain-specific benchmarks are available: MultiMedQA [ 4 ] for the healthcare domain, FinBen [ 5 ] for financial knowledge, and LegalBench [ 6 ] for evaluating an LLM’s ability to assess legal attributes. Results from these benchmarks indicate considerable latent capability for legal and regulatory reasoning in LLMs, but also raise pressing questions about model competence in specialized, high-stakes professional domains. Concurrently, the proliferation of data privacy and artificial intelligence (AI) governance regulations, such as the EU’s General Data Protection Regulation (GDPR) [ 7 ] and the California Consumer Privacy Act (CCPA) [ 8 ] , has created an increasing demand for expertise in regulatory compliance. Recent studies continue to demonstrate the difficulties businesses face in operationalizing the practical and legal complexities facing organizations, underlining the real-world importance of specialized data privacy expertise [ 9 ] . These laws, along with emerging frameworks like the EU AI Act [ 10 ] , necessitate specialized knowledge to navigate intersecting legal, technical, and ethical requirements. The International Association of Privacy Professionals (IAPP) is an independent, not-for-profit trade association that provides highly regarded privacy and AI governance certification exams, such as the Certified Information Privacy Professional - US (CIPP/US) and Artificial Intelligence Governance Professional (AIGP) [ 11 ] . These exams are widely considered among the most comprehensive assessments of privacy and AI governance expertise currently available. In this paper, we leverage the existing standards for human expertise in the privacy and AI governance domain to benchmark ten prominent LLMs. Our evaluation spans both open and closed-source models, developed by multiple organizations. By evaluating each model’s performance on certification-style exams, we aim to identify current strengths and limitations of LLM technologies and inform prospective consumers. Further, we analyze domain cross-correlations - such as whether legal reasoning capability aligns with management knowledge. The overarching goal is to elucidate the alignment (or misalignment) between LLM training and the human expertise benchmarks recognized in privacy and AI governance. These findings may guide future development and adoption of LLMs in regulated, high-stakes contexts. 2 Data We tested the LLMs on four different IAPP Sample Exams: CIPP/US, CIPM, CIPT, and AIGP. The sample exams were purchased from the IAPP website on April 18th, 2025. The sample exams are not identical to the official certification exams, but are designed to give the test taker an evaluation of how they might perform on the actual exam. The IAPP periodically updates the exams to adapt to changes in regulations and industry practices. The CIPP/US, CIPM, and CIPT exams contained 90 multiple-choice questions. The AIGP exam contained 100 questions. The exams are scored by the IAPP on an undisclosed, weighted scale out of 500 where 300 represents a passing score. While the precise scoring algorithm is secret, it is generally understood that answering 85 percent of the questions correct will result in a passing score regardless of which questions were correct. [ 12 ] The four certifications are generally considered the industry standard in Privacy and AI Governance expertise and span a wide spectrum of practice, from foundational U.S. statutes to program management, technical implementation, and responsible-AI oversight. In most of the exams, each question is categorized under a subdomain of the exam’s domain. In some questions, a scenario is provided as well as the question and answer choices. The IAPP is an ANAB-accredited certification body. Their CIPP/US, CIPM and CIPT exams are accredited under ISO standard 17024:2012. This standard is meant to assure the credibility and integrity of the exam. 2.1 CIPP/US – Certified Information Privacy Professional/United States The CIPP/US is the IAPP’s foundational legal certification for U.S. privacy law and policy. It establishes subject-matter competence in key regulatory frameworks, including the U.S. Constitution, sectoral laws (e.g., HIPAA, GLBA, COPPA), state-level privacy regimes (notably the California Consumer Privacy Act and its successors), and federal enforcement bodies like the FTC. The exam emphasizes not only black-letter law but also the practical application of compliance strategies across business sectors. The CIPP/US serves as a de facto credential for privacy attorneys, compliance officers, and legal technologists operating in U.S.-based or U.S.-impacted environments. Subdomain Title Number of Questions Domain I Introduction to the U.S. Privacy Environment 35 Domain II Limits on Private-sector Collection and Use of Data 25 Domain III Government and Court Access to Private-sector Information 6 Domain IV Workplace Privacy 10 Domain V State Privacy Laws 14 Table 1: Subdomains of the CIPP/US Certification Exam 2.2 CIPM – Certified Information Privacy Manager The CIPM certification is managerial in scope, focusing on the operationalization of privacy within organizations. It examines the development, implementation, and management of privacy programs, integrating governance structures, risk management, data mapping, vendor management, breach response, and monitoring frameworks. The exam reflects a privacy-by-design ethos, requiring test-takers to demonstrate fluency in building and maintaining accountability mechanisms, aligning with regulatory expectations like those under the GDPR and ISO/IEC 27701. The CIPM is often pursued by privacy program managers, data protection officers, and compliance leads. Subdomain Title Number of Questions Domain I Privacy Program: Developing a Framework 18 Domain II Privacy Program: Establishing Program Governance 14 Domain III Privacy Operational Life Cycle: Assessing Data 20 Domain IV Privacy Operational Life Cycle: Protecting Personal Data 15 Domain V Privacy Operational Life Cycle: Sustaining Program Governance 6 Domain VI Privacy Operational Life Cycle: Responding to Requests and Incidents 17 Table 2: Subdomains of the CIPM Certification Exam 2.3 CIPT – Certified Information Privacy Technologist The CIPT credential is