Am I eligible? Natural Language Inference for Clinical Trial Patient Recruitment: the Patient’s Point of View

Mathilde Aguiar, Pierre Zweigenbaum, Nona Naderi · 2025

Read Am I eligible? Natural Language Inference for Clinical Trial Patient Recruitment: the Patient’s Point of View by Mathilde Aguiar, Pierre Zweigenbaum, Nona Naderi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-15718.txt.

Introduction

Mathilde Aguiar, Pierre Zweigenbaum, and Nona Naderi test whether patients can judge their own eligibility for clinical trials using plain language. Recruitment is slow, and trials are usually proposed by clinicians. Direct online outreach could reach patients faster, if patients can describe their medical profile in their own words and still be matched well.

The team builds a dataset and task where patient language profiles are matched to trials adapted from a 2022 benchmark. Profiles were rewritten by hand in patient language, with known eligible and excluded cases. Several open language models score in a moderate to good range with patient wording. The best model loses little compared with medical wording, which suggests patient led matching is viable.

Catalog record

CREATORMathilde Aguiar, Pierre Zweigenbaum, Nona Naderi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-15718

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Am I eligible? Natural Language Inference for Clinical Trial Patient Recruitment: the Patient’s Point of View Mathilde Aguiar, Pierre Zweigenbaum, Nona Naderi Abstract Recruiting patients to participate in clinical trials can be challenging and time-consuming. Usually, participation in a clinical trial is initiated by a healthcare professional and proposed to the patient. Promoting clinical trials directly to patients via online recruitment might help to reach them more efficiently. In this study, we address the case where a patient is initiating their own recruitment process and wants to determine whether they are eligible for a given clinical trial, using their own language to describe their medical profile. To study whether this creates difficulties in the patient-trial matching process, we design a new dataset and task, Natural Language Inference for Patient Recruitment (NLI4PR), in which patient-language profiles must be matched to clinical trials. We create it by adapting the TREC 2022 Clinical Trial Track dataset, which provides patients’ medical profiles, and rephrasing them manually using patient language. We also use the associated clinical trial reports where the patients are either eligible or excluded. We prompt several open-source Large Language Models on our task and achieve from 56.5 to 71.8 of F1 score using patient language, against 64.7 to 73.1 for the same task using medical language. When using patient language, we observe only a small loss in performance for the best model, suggesting that having the patient as a starting point could be adopted to help recruit patients for clinical trials. The corpus and code bases are all freely available on our Github 1 1 1 https://github.com/CTInfer/NLI4PR and HuggingFace 2 2 2 https://huggingface.co/datasets/Mathilde/NLI4PR repositories. 1 Introduction Many efforts have been made to develop methods based on Natural Language Processing (NLP) to solve ongoing challenges in healthcare. These studies are targeting either medical professionals or patients. However, patients and medical professionals use different kinds of language. A system trained and designed on medical language might, therefore, fail when used with patient language. Before releasing a new medicine on the market, clinical trials must be performed and recruit several cohorts of patients with profiles that comply with the inclusion and exclusion criteria of the trial. Recruiting patients can be challenging and costly, especially for studies focusing on certain diseases or targeting a specific population, e.g. a study targeting young children with a rare disease. This can cause major delays for the trial: in 2012, 80% of trials in the US were aborted because of the lack of fitting participants ( Johnson, 2015 ) . While enrollment into the trial is usually proposed by a medical practitioner to an already known patient, new online recruitment solutions 3 3 3 See for instance Klineo or DigitalECMT . are promoting trials directly to patients who might not be familiar with clinical trials. These solutions could help speed up and reduce the cost of the patient recruitment process, allowing to recruit hard-to-reach populations, and target underrepresented populations ( Brøgger-Mikkelsen et al., 2020 ) . In this study, we focus on patient recruitment for clinical trials by adopting the patient’s point of view, thus using patient language (PL) to describe the patient’s medical profile. To enable the research community to explore this setting, we design a novel task, Natural Language Inference for Patient Recruitment (NLI4PR). We create a dataset derived from patient profiles from the shared task TREC 2022 Clinical Trial Track (TREC-CT 2022) ( Roberts et al., 2022 ) and clinical trials’ eligibility criteria for which the patient would be eligible or excluded. We frame the recruitment task into a Natural Language Inference (NLI) task. Our aim is to evaluate models’ ability to infer from a given premise (the trial’s eligibility criteria) whether the statement (the patient’s medical profile) is entailed or contradicts the given premise. If there is an entailment, the patient can be enrolled in the trial; otherwise, the patient does not match the trial’s eligibility criteria. Since Large Language Models (LLMs) have demonstrated competitive results in similar shared tasks ( Jullien et al., 2023b ; Jullien et al., 2024 ) , we evaluate how they fare on the present new task. Our contributions are the following: • Using patient language instead of medical doctor’s language to describe the patient’s medical profile and perform the patient-trial matching task. • Creating a new dataset and task, NLI4PR, aiming at matching patients to clinical trials using patient language. • Evaluating and comparing Large Language Models on the patient-matching task using medical and patient language. 2 Related Work 2.1 Natural Language Processing for recruiting patients for clinical trials Recruiting patients for clinical trials can be challenging and time-consuming. This is one of the main causes for trials to fail ( Kantor and Morzy, 2024 ) . Trials target a certain population, defined through the eligibility criteria designed at the beginning of the study (see Fig. 1 ). These criteria are expressed as free text in the Clinical Trial Reports (CTRs). The traditional way of promoting trials to patients was made directly by healthcare professionals to known patients that might fit the trial. However, this involves a long manual review of patient profiles, which can also lead to screening errors. Thanks to the digitization of patients’ medical records, called electronic health records (EHRs), systems based on NLP ( Ghosh et al., 2024 ; Murcia et al., 2024 ) aimed at providing support to solve the patient-trial matching task. These systems allow the automatic review of patients’ profiles and trial eligibility criteria. They can either follow the trial-to-patients paradigm (for a given trial, the system suggests several patient profiles) or patient-to-trials (for a given patient, the system proposes several trials). Figure 1: Example of a CTR’s eligibility criteria. Taken from NCT04581941, available on clinicaltrials.gov The TREC-CT 2021 ( Soboroff, 2022 ) , 2022 ( Roberts et al., 2022 ) , and 2023 ( Soboroff, 2024 ) shared tasks promote the development of NLP-based systems that address the patient-trial matching problem. These tasks provide patient topics, which are a short description of a patient’s medical profile, in free-text form in the 2021 and 2022 editions or as structured text (as questionnaires) in the 2023 edition. The goal is to provide for each patient a ranked list of CTRs for which the patient would be eligible, excluded, or not relevant. With the recent advent of Large Language Models, methods using these models ( Jin et al., 2024 ; Nievas et al., 2024 ; Wornow et al., 2025 ) have been developed to perform the patient-trial matching. These methods have demonstrated competitive results compared to previous methods based on Masked Language Models. Natural Language Inference is a task that aims to determine whether a statement can be inferred from a given premise. This task is quite challenging as it requires different kinds of knowledge, and involves finding evidence in the given pieces of text and confronting these pieces of evidence all together in order to conclude if there is an entailment or a contradiction. The NLI4CT task ( Jullien et al., 2023a ) uses NLI on clinical trials for various applications. Clinical trials are used as NLI premises, and statements have been manually generated. One of the targeted applications is patient recruitment, but the

Read the complete text