Making AI-Assisted Grant Evaluation Auditable without Exposing the Model

Kemal Bicakci · 2026

Read Making AI-Assisted Grant Evaluation Auditable without Exposing the Model by Kemal Bicakci (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-25200.txt.

Introduction

Bicakci proposes a trusted execution architecture for grant evaluation with AI, auditable with model hidden. Agencies face a bind: model and rubric must not leak to applicants, yet evaluation must stay open to audit and challenge. Remote attestation lets a verifier check the model, rubric, prompt and input form used, without revealing weights or scoring logic. The artifact is a signed, timestamped record linking submission and input hashes with model and rubric measurement and output. A sanitization layer guards against prompt injection, and attestation verifies process, not fairness or correctness.

Catalog record

CREATORKemal Bicakci
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41176
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.25200

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Making AI-Assisted Grant Evaluation Auditable without Exposing the Model Kemal Bicakci Abstract Public agencies are beginning to consider large language models (LLMs) as decision-support tools for grant evaluation. This creates a practical governance problem: the model and scoring rubric should not be exposed in a way that allows applicants to optimize against them, yet the evaluation process must remain auditable, contestable, and accountable. We propose a TEE-based architecture that helps reconcile these requirements through remote attestation . The architecture allows an external verifier to check which model, rubric, prompt template, and input representation were used, without exposing model weights, proprietary scoring logic, or intermediate reasoning to applicants or infrastructure operators. The main artifact is an attested evaluation bundle : a signed, timestamped record linking the original submission hash, the canonical input hash, the model-and-rubric measurement, and the evaluation output. The paper also considers a scenario-specific prompt injection risk: applicant-controlled documents may contain hidden or indirect instructions intended to influence the LLM evaluator. We therefore include a canonicalization and sanitization layer that normalizes document representations and records suspicious transformations before inference. We position the design relative to confidential AI inference, attestable AI audits, zero-knowledge machine learning, algorithmic accountability, and AI-assisted peer review. The resulting claim is deliberately narrow: remote attestation does not prove that an evaluation is fair or scientifically correct, but it can make part of the evaluation process externally verifiable. Keywords: remote attestation, trusted execution environment, confidential AI inference, grant evaluation, algorithmic accountability, prompt injection, verifiable machine learning, human oversight. 1. Introduction Public funding agencies such as national science foundations routinely evaluate large numbers of grant proposals. The evaluation workload is substantial: each proposal may require several expert reviewers, panels must harmonize scores across heterogeneous disciplinary backgrounds, and turnaround expectations are often tight. Against this backdrop, there is growing interest in using large language models as decision-support tools—not to replace human judgment, but to assist with preliminary scoring, rubric compliance checking, identifying missing information, and flagging inconsistencies across reviewer assessments [ 7 ] . The motivation for this work comes from a practical governance question: if a public agency uses an AI model to assist grant evaluation, how can applicants and auditors trust that the declared model was actually used, while preventing applicants from reverse-engineering or gaming the evaluation procedure? This question creates a tension between two legitimate requirements: • Model confidentiality. If the model’s scoring criteria, rubric details, and behavioral tendencies are publicly known, sophisticated applicants can over-optimize their proposals for the model rather than for genuine scientific merit—a form of Goodhart’s Law applied to automated evaluation. The integrity of the funding process depends on keeping the model and its policy partially opaque to applicants. • Process auditability. Public funding decisions must be explainable, contestable, and subject to independent oversight. Applicants, funding agencies, and external auditors must be able to verify that the declared model and declared rubric were actually used, that the submission was not silently modified before evaluation, and that the output was not tampered with after generation. In practice, this tension is often handled through policy and institutional trust: agencies may disclose high-level principles while keeping implementation details internal. That may be reasonable in some settings, but it leaves a technical gap. Applicants and auditors may still need evidence that the declared model, rubric, and input representation were actually used. This gap is closely related to the normative requirements of algorithmic accountability in public sector decision making [ 8 , 9 ] . This paper explores one technical way to reduce that gap. Drawing on the hardware-rooted trust model of confidential computing , we show how remote attestation can provide evidence that a specific, approved evaluation pipeline was launched and used—without requiring the auditor to trust the infrastructure operator, the cloud provider, or every software layer in the agency’s environment. The key distinction, which we use throughout the paper, is: Remote attestation does not certify that the model made a good decision. It certifies that the correct model, in the correct environment, with the correct version of the rubric, processed the unmodified input and that the output was not subsequently altered. This is a narrower claim than full fairness or correctness, but it is still useful: it turns one part of the process into something externally verifiable. It should be complemented by separate validation processes—model audits, bias analyses, and human review panels—that address the quality and legitimacy of the evaluation itself. The paper makes four main contributions: 1. We frame AI-assisted public grant evaluation as a confidentiality-auditability problem: the evaluation logic should remain protected, while the process should still be independently checkable (§ 2 ). 2. We propose a TEE-based architecture that produces an attested evaluation bundle per submission, binding the submission hash, canonical input hash, model-and-rubric measurements, inference timestamp, and signed output (§ 5 ). 3. We analyze prompt-injection and input-canonicalization issues that arise when applicant-controlled documents are processed by an LLM evaluator (§ 5 and § 6 ). 4. We discuss the limitations of the approach and compare it with stronger, but currently less practical, cryptographic alternatives such as ZK-ML, FHE, and MPC (§ 4 and § 7 ). The rest of the paper is organized as follows. Section 2 defines the problem setting, requirements, and threat model for AI-assisted grant evaluation. Section 3 provides background on trusted execution environments and remote attestation. Section 4 presents the proposed attestation-based architecture and the attested evaluation bundle. Section 5 discusses the security properties and limitations of the approach. Section 6 reviews related work on confidential computing, verifiable computation, and AI-assisted evaluation. Finally, Section 7 concludes the paper and outlines directions for future work. 2. Problem Statement and Threat Model 2.1. Setting We consider a grant evaluation agency (GEA) that uses an AI-assisted evaluation pipeline as a component in its proposal review process. The pipeline takes a structured applicant submission as input and produces a structured evaluation report: numerical scores on multiple rubric dimensions, natural-language justifications, uncertainty flags, and reviewer attention cues. The AI output feeds into a human review panel that makes the final funding decision. 2.2. Principals and Roles Four principals participate in the system: • Applicant (A). Submits a proposal. Has an interest in receiving a high score. Is aware that AI evaluation is used. • Agency (GEA). Operates the evaluation process. Wants evaluations to be consistent, rubric-compliant, and defensible. Holds the model and rubric as confidential internal policy. • Model provider (MP). Provides the model weights and inference infrastructure. In practice this role may be filled by a separate commercial AI service, or by the agency itself operating an in-house or open-weight model. In the latter case MP and GEA collapse into a single principal, which simplifies the trust structure but does not change the core attestation requirements. • Auditor / Appellate board (AUD). An independent body entitled to verify that a specific evaluation was conducted as claimed. May act on behalf of an aggrieved applicant or as a systemic regulator. Figure 1 illustrates the four principals and their key interactions. Applicant (A) Agency (GEA) Auditor / Board (AUD) Model Provider (MP) submits proposal score report model deployment / inference API appeal request attestation report \mathcal{A} attested bundle \mathcal{B} verification result Figure

Read the complete text