Principles and Guidelines for Randomized Controlled Trials in AI Evaluation

Christopher Kelly †‡, Angelica Chowdhury ‡, Alexandra Campili ‡, Bimpe Ayoola §, Devin Barbour §, Thomas Chen Dawson §, Ze Shen Chin ∘ \circ, Rokas Gipiškis ∘ \circ · 2026

Read Principles and Guidelines for Randomized Controlled Trials in AI Evaluation by Christopher Kelly †‡, Angelica Chowdhury ‡, Alexandra Campili ‡, Bimpe Ayoola §, Devin Barbour §, Thomas Chen Dawson §, Ze Shen Chin ∘ \circ, Rokas Gipiškis ∘ \circ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-02050.txt.

Introduction

Christopher Kelly and colleagues set out principles and guidelines for randomised controlled trials that evaluate artificial intelligence. Such trials, also called human uplift studies, test whether a tool truly helps people, but the field lacks shared standards. The authors draw on trial practice from software, economics, health, and psychology to build a common frame.

They synthesise five principles from validity and open-science standards on transparency, repeatability, and verification. Those principles support thirty-three actionable guidelines, each given as a requirement with a rationale, steps, and evidence. The set is meant as a design tool for new studies, a rubric for judging past work, and a blueprint as field norms settle.

Catalog record

CREATORChristopher Kelly †‡, Angelica Chowdhury ‡, Alexandra Campili ‡, Bimpe Ayoola §, Devin Barbour §, Thomas Chen Dawson §, Ze Shen Chin ∘ \circ, Rokas Gipiškis ∘ \circ
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE88 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.02050

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Principles and Guidelines for Randomized Controlled Trials in AI Evaluation Christopher Kelly †‡, Angelica Chowdhury ‡, Alexandra Campili ‡, Bimpe Ayoola §, Devin Barbour §, Thomas Chen Dawson §, Ze Shen Chin ∘ \circ, Rokas Gipiškis ∘ \circ Abstract This work establishes a foundational framework for standardizing AI evaluation RCTs (sometimes called human uplift studies). Drawing on established experimental practices from disciplines with established RCT traditions, including software engineering, economics, clinical and health sciences, and psychology, we adopt the ( 29 ) four-validity framework and extend it with a fifth principle on transparency, repeatability, and verification adapted from the Transparency and Openness Promotion (TOP) Guidelines ( 8 ) . We operationalize all five principles into 33 guidelines adapted for AI evaluation RCT contexts, expressed as requirements with rationales, implementation instructions, and evidence bases. We position the principles and guidelines as serving three key roles for AI evaluation RCTs: a design tool for planning studies, an evaluation rubric for assessing existing work, and a blueprint for standard setting as the field converges on norms. Our framework extends prior work by centering evaluation on human performance rather than model output alone, formalizing causal inference through RCT methodology for AI contexts, integrating heterogeneity analysis and practical significance assessment, implementing a graded transparency and repeatability framework, and addressing AI-specific challenges including model versioning, human-AI interaction dynamics, contamination and spillover effects, and equitable impact assessment. † † affiliationnotice: † Primary Author, writing the original draft and core contribution; ‡ Guidelines Contributor, contributing to guideline development; § Project Participant, providing feedback and participating in SPAR (Supervised Program for Alignment Research) meetings; \circ Project Mentor. 1 Introduction The credibility of empirical research has come under sustained scrutiny over the past decade. Large-scale replication efforts in psychology found that fewer than half of published findings could be reproduced ( 22 ) . Systematic reviews in medicine have documented pervasive heterogeneity in trial designs, small sample sizes, lack of randomization, and inadequate transparency ( 38 ) . Software engineering has grappled with similar challenges, prompting the development of community standards to codify methodological requirements for experimental studies ( 1 ) . These problems are not limited to any single field. They reflect structural incentives and institutional gaps that undermine the production of reliable knowledge across the sciences. Against this backdrop, the evaluation of advanced AI systems 1 1 1 Throughout this paper we use AI to refer to advanced general-purpose AI systems, as these motivate our examples and framing. The literature uses several terms for this category, including general-purpose AI (GPAI) ( 25 ; 33 ) , frontier AI ( 3 ; 36 ; 7 ) , foundation models ( 5 ) , and large language models (LLMs) ( 37 ) . However, the principles and guidelines themselves are methodological rather than system-specific: they apply to RCTs evaluating any AI system, whether general-purpose or domain-specific, and whether the object of evaluation is a model or a broader system ( 30 ) ; our framework applies across these usages. has emerged as a domain with virtually no established standards of best practice ( 33 ) . Benchmark evaluations, leaderboards, and audits do not amount to a robust evaluation ecosystem, and they fail to provide assurances regarding AI system performance across different domains or for different user groups ( 35 ) . The machine learning field has historically overlooked the importance of evaluation practices, and the rate at which general-purpose AI capabilities are progressing compounds this problem by increasing the risk of unbalanced assessments ( 35 ) . Overestimating AI capabilities can lead to frayed trust, hasty deployment, and over-reliance on systems whose performance has not been sufficiently verified. Underestimating them can result in complacency, underinvestment in safety, and missed opportunities for beneficial applications. The problem is further complicated by the use of inconsistent terminology. In the scholarly domain, the concept of “uplift” is formally defined and operationalized differently across disciplines. Sometimes it is confused with “treatment effect” ( 11 ) , “incremental impact” ( 13 ) , “performance evaluation” ( 34 ) , and “gain” ( 15 ) . Although these terms are frequently used interchangeably, they do not mean exactly the same thing and have important differences. A treatment effect can indicate negative, null, or positive change, whereas uplift implies improvement and therefore carries a positive directional meaning. “Program Evaluation” often refers to a much less rigorous version of evaluation than an RCT or quasi-experiment and does not reference treatment effects, and it is more akin to a simple before and after. Among leading AI organizations, definitions contradict one another. The RAND GPAI paper employs a broad definition encompassing any increases in human performance from AI access ( 25 ) , while the UK AI Safety Institute frames uplift studies as assessing how AI systems might be used by bad actors to carry out real-world harmful tasks ( 33 ) . Anthropic’s usage parallels this focus on CBRN risks but lacks a methodological definition ( 4 ) . OpenAI rarely employs the term and uses it differently when it does, describing changes in model performance across model versions rather than changes in human performance ( 24 ) . This terminological inconsistency undermines the interdisciplinary research and policy conversations that are essential for AI safety and governance. The consequences extend beyond academic confusion. Without clear standards, we risk inconsistent methodologies and unverified claims that limit the validity of conclusions and make it difficult to reproduce results ( 19 ) . Policymakers and governance bodies cannot aggregate findings across studies when those studies use different definitions, different outcome measures, and different analytical approaches. Technical governance decisions about deployment thresholds, capability assessments, and safety requirements depend on evidence that cannot be trusted if the underlying studies are underpowered, poorly designed, or inadequately documented. The CSET explainer on AI safety evaluations acknowledges the inherent difficulty in performing contextual safety evaluations due to hard-to-standardize human variables, such as tester expertise, which can complicate establishing clear cause-and-effect relationships and comparing results across different studies ( 12 ) . In this work, we define an AI evaluation RCT as a randomized controlled trial measuring the causal effect of AI access or use on a given outcome. Unlike benchmark evaluations, which assess model outputs against fixed test sets, AI evaluation RCTs randomize human participants to AI-access conditions and measure causal effects on human behavior, performance, or wellbeing. We focus specifically on human performance outcomes because many capability thresholds currently use ambiguous language about increasing human capabilities or automating expert-level work without specifying whether the human baseline is AI-assisted ( 25 ) . Our framework is domain-agnostic and applies across task domains and settings, though our focus is specifically on experimental designs that enable causal inference. This project adopts the Shadish-Cook-Campbell four-validity framework ( 29 ) , extends it with a fifth principle on transparency and repeatability adapted from the TOP Guidelines ( 8 ) , and operationalizes all five into 33 guidelines adapted for AI evaluation RCT contexts, drawing on established standards across multiple disciplines. 2 Related Work and Gaps Several efforts have attempted to establish standards for AI evaluation, though none adequately address the unique challenges of AI evaluation RCTs. STARE-HI ( 31 ) represents an

Read the complete text