AMEND++ : Benchmarking Eligibility Criteria Amendments in Clinical Trials

Trisha Das, Mandis Beigi, Jacob Aptekar, Jimeng Sun · 2026

Read AMEND++ : Benchmarking Eligibility Criteria Amendments in Clinical Trials by Trisha Das, Mandis Beigi, Jacob Aptekar, Jimeng Sun (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-06300.txt.

Introduction

Rules on who can join a drug trial change a lot. Each change costs time and cash. Trisha Das and 3 co-authors ask if we can guess which rules will change in a 2026 paper. That guess task is new. It could help teams draft rules that last.

Their test set, AMEND++, holds two data sets drawn from past trials in the open. One tracks each draft of the join rules and marks which ones changed. A cleaned twin set keeps just the big, real changes, sifted with help from a language model. A new pre-training step learns from old edits, so the model grows alert to change-prone text. Across a range of base tools, that step lifted the guess rate. The team says the gain points to trials that cost less and run with less drag.

Catalog record

CREATORTrisha Das, Mandis Beigi, Jacob Aptekar, Jimeng Sun
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-06300

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AMEND++ : Benchmarking Eligibility Criteria Amendments in Clinical Trials Trisha Das, Mandis Beigi, Jacob Aptekar, Jimeng Sun Abstract Clinical trial amendments frequently introduce delays, increased costs, and administrative burden, with eligibility criteria being the most commonly amended component. We introduce eligibility criteria amendment prediction , a novel NLP task that aims to forecast whether the eligibility criteria of an initial trial protocol will undergo future amendments. To support this task, we release AMEND++ , a benchmark suite comprising two datasets: AMEND , which captures eligibility-criteria version histories and amendment labels from public clinical trials, and AMEND_LLM , a refined subset curated using an LLM-based denoising pipeline to isolate substantive changes. We further propose Change-Aware Masked Language Modeling (CAMLM), a revision-aware pretraining strategy that leverages historical edits to learn amendment-sensitive representations. Experiments across diverse baselines show that CAMLM consistently improves amendment prediction, enabling more robust and cost-effective clinical trial design. 1 1 1 We will publicly release code and data once the paper is accepted. 1 Introduction Clinical trial protocols define the scientific and operational blueprint of a study and must be followed exactly as approved by regulatory authorities. In practice, however, many trials undergo post-approval modifications (i.e., protocol amendments) to address emerging scientific questions, operational challenges, or regulatory feedback. While often necessary, amendments introduce substantial burdens by delaying timelines, requiring extensive coordination across investigators and sites, and generating high additional costs for sponsors and regulatory bodies. A prior study from the Tufts Center for the Study of Drug Development has shown that amendments are both frequent and increasingly complex, with a growing proportion triggered by design deficiencies or changes in eligibility criteria Getz et al. 2016 . More recent analyses indicate a rise in amendment prevalence and longer implementation cycles Getz et al. 2024 , reflecting the intensification of regulatory expectations and operational demands. Regulatory agencies face similar pressures, processing large volumes of amendments each year, often with multi-week review periods. These findings underscore that many amendments could be anticipated earlier if potential issues in the initial protocol were detected proactively. Table 1: Summary of existing studies on clinical trial protocol amendments and dataset availability. None of the prior studies released a public dataset suitable for machine learning tasks. Study Data Source # of Trials Focus / Contribution Public Dataset ( Getz et al. 2016 ) 15 pharmaceutical companies and CROs (Tufts CSDD collaboration) 836 Quantified prevalence, causes, and costs of protocol amendments across commercial trials. ✗ ( Getz et al. 2024 ) 16 pharmaceutical companies and CROs 950 Updated benchmark analysis on amendment frequency and impact on study performance. ✗ ( Botto et al. 2024 ) ( Getz et al. 2024 ) 950 Compared amendment prevalence and completion outcomes in oncology vs. non-oncology trials. ✗ ( Joshi 2023 ) 53 NHS-sponsored trials (UK) 53 Mixed-methods study identifying common amendment reasons and avoidability patterns. ✗ AMEND (ours) https://clinicaltrials.gov 161970 Prepared an ML-ready benchmark dataset containing all versions of eligibility criteria and amendment labels. ✓ AMEND_LLM (ours) https://clinicaltrials.gov 64641 Subset of AMEND dataset with denoised amendment labels using LLMs. ✓ Eligibility criteria (EC) 2 2 2 Throughout this paper, we use EC to refer to the eligibility criteria section as a single textual unit. are a particularly common driver of protocol amendments Getz et al. 2024 . Changes to inclusion and exclusion criteria can arise for multiple reasons, as noted in ICH E9 and prior clinical research Lewis 1999 ; Cleophas et al. 2009 . New medical insights may necessitate amendments, while persistent violations of entry criteria or inadequate recruitment can also prompt revisions. Because modifications to EC directly affect who can enroll, changes introduced mid-trial can yield meaningful differences between participant populations before and after an amendment, with implications for study integrity and interpretability. These factors make EC amendments both impactful and important to anticipate early in the design process. Despite the central role of protocol design in clinical trial efficiency, the computational literature lacks large-scale resources and models to predict whether EC in an initial protocol will be modified later (Table 1 ). EC define the study population and are among the most frequently amended components of trial protocols, making the initial EC text a strong signal for predicting future eligibility-criteria amendments. Automatically identifying EC at elevated risk of future amendments could help sponsors improve protocol quality, reduce avoidable revisions, and streamline trial execution. To support research on clinical trial design, we introduce AMEND++ , a benchmark suite for studying eligibility-criteria (EC) amendment prediction from initial trial protocols. AMEND++ includes two datasets capturing different trade-offs between scale and label fidelity: AMEND , a large-scale collection derived from public protocol version histories, and AMEND_LLM , a refined subset emphasizing substantive eligibility changes. Using this benchmark, we show that the information of initial eligibility criteria contains predictive signals of future amendment risk. We make three primary contributions: 1. We formulate eligibility criteria amendment prediction as a new NLP task grounded in real-world clinical trial design, where the objective is to forecast whether an initial protocol will later undergo eligibility-related amendments. 2. We release AMEND++ , a benchmark suite consisting of two large-scale datasets: AMEND , which provides eligibility criteria version histories with amendment labels derived from public trial records, and AMEND_LLM , a refined subset constructed using an LLM-based label denoising algorithm. This algorithm decomposes EC amendments into added, removed, and modified components to isolate substantive eligibility changes, resulting in high-quality amendment labels with substantially higher agreement with human annotations than alternative labeling approaches. 3. We propose Change-Aware Masked Language Modeling (CAMLM), a revision-aware pretraining strategy that leverages historical eligibility-criteria edits to learn amendment-sensitive representations. Through extensive benchmarks and ablations, we show that CAMLM consistently improves amendment prediction across multiple datasets, backbone encoders, and downstream classifiers. Figure 1: Overview of the proposed framework for clinical trial eligibility criteria (EC) amendment prediction, from data collection to downstream task application. LR: logistic regression, RF: random forest, TH: trial head used for predicting amendment. Human annotation is performed only on the test data. 2 Related Work In recent years, a variety of machine learning and deep learning approaches have been applied throughout the clinical-trial lifecycle, including outcome prediction Gao et al. 2025 ; Fu et al. 2022 , generation of digital twins or simulated trial participants Das et al. 2023 ; Das et al. 2025a , and trial-document similarity search Das et al. 2025b ; Luo et al. 2024 . These studies demonstrate the growing potential of data-driven methods to support trial design, analysis, and operational decision-making. Few NLP systems have focused on extracting and normalizing eligibility criteria into structured representations, enabling cohort querying and downstream analysis but not modeling protocol evolution or amendment risk Tseo et al. 2020 ; Yuan et al. 2019 . More recently, multi-task benchmarks such as TrialBench have released standardized datasets spanning trial design and prediction tasks, including eligibility-criteria design, but do not consider revision-aware pretraining or forecasting protocol amendments from initial drafts Chen et al. 2024 . In contrast, research on protocol amendments has been primarily descriptive and statistical. Prior work has characterized the frequency, causes, and operational burden of amendments Getz et al. 2016 ; Botto et al. 2024 ; Joshi 2023 , but none have framed

Read the complete text