A Pipeline for Generating Longitudinal Synthetic Clinical Notes Using Large Language Models
William Poulett, Alice Waterhouse, Ben Wallace, Scarlett Kynoch, Amaia Imaz Blanco, Michael Spence, Jonathan Pearson · 2026
Read A Pipeline for Generating Longitudinal Synthetic Clinical Notes Using Large Language Models by William Poulett, Alice Waterhouse, Ben Wallace, Scarlett Kynoch, Amaia Imaz Blanco, Michael Spence, Jonathan Pearson (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-26879.txt.
Introduction
William Poulett and six colleagues present a pipeline that fabricates realistic hospital notes for patients who do not exist. Clinical AI tools need medical text to develop and test. Real notes are locked away for privacy. Synthetic notes, written by language models, offer a substitute. The challenge is keeping a long hospital story consistent from admission to discharge.
The pipeline works in three layers. Structured patient generation creates the person. A journey simulation plans their hospital course. Language models then write the notes themselves, varying style and detail like real clinicians. Built-in validation and augmentation steps check faithfulness and boost realism. The released data set holds seventy synthetic patients with twenty to fifty notes each. It is offered at several validation levels for different uses.
Catalog record
| CREATOR | William Poulett, Alice Waterhouse, Ben Wallace, Scarlett Kynoch, Amaia Imaz Blanco, Michael Spence, Jonathan Pearson |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.26879
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Pipeline for Generating Longitudinal Synthetic Clinical Notes Using Large Language Models William Poulett, Alice Waterhouse, Ben Wallace, Scarlett Kynoch, Amaia Imaz Blanco, Michael Spence, Jonathan Pearson Abstract Synthetic data is increasingly used to enable the development and evaluation of AI systems in domains where access to real-world data is restricted. In healthcare, clinical documentation presents particular challenges due to its sensitivity. This work introduces a synthetic clinical notes pipeline and dataset designed to support the development of clinical AI tools while avoiding the privacy risks associated with real patient data. The dataset is generated using a modular pipeline that combines structured patient generation, semi-structured patient journey simulation, and unstructured clinical note generation using large language models. The pipeline is designed to prioritise internal consistency across longitudinal patient records, while also capturing variation in writing style, note structure, and clinical detail. Additional mechanisms, including LLM-based validation and augmentation steps, are used to improve faithfulness, realism, and diversity of the generated notes. We release a dataset of 70 synthetic patients, each associated with 20–50 clinical notes spanning a full hospital journey. The dataset is provided at multiple levels of validation, enabling users to balance realism and scalability depending on their use case. This dataset supports the development, testing, and evaluation of clinical AI systems, including summarisation tools, coding models, and decision support systems, without reliance on real patient data. Our code is available on GitHub and our data on Hugging Face . 1 Introduction Clinical AI systems, including summarisation tools, diagnostic support systems, and automated coding models, require large volumes of clinical documentation for development and evaluation. Access to this data is heavily restricted. Patient records are subject to stringent regulatory and ethical requirements, and institutional approval processes for using them in research are often slow or unsuccessful. Privacy-enhancing techniques such as anonymisation and de-identification can reduce risk, but they do not always satisfy approval requirements. [ 12 ] Synthetic data offers a practical alternative. Synthetic clinical notes are generated from scratch to reflect the structure and content of real clinical documentation, without containing genuine patient information. Recent advances in large language models (LLMs) have made high-quality synthetic text generation significantly more accessible, with growing interest in applications to clinical NLP [ 11 , 17 ] . Generating synthetic clinical notes that are useful for AI development requires careful design. Notes must be medically plausible and structurally realistic. They must also be internally consistent across a longitudinal patient record, where multiple notes describe the same patient, the same events, and the same evolving clinical picture. Additionally, the dataset must reflect the range of variation present in real clinical settings, including differences in writing style, level of detail, specialty-specific terminology, and clinician documentation habits. This paper presents a modular pipeline for generating synthetic clinical notes and a publicly available dataset produced using that pipeline. The pipeline incorporates structured patient generation, longitudinal journey simulation, and LLM-based note generation with validation and augmentation steps. We release a dataset of 70 synthetic patients, each with 20 to 50 clinical notes spanning a full hospital journey, provided at multiple levels of validation to support different downstream use cases. Our contributions are as follows: • A modular, configurable pipeline for generating synthetic clinical notes with longitudinal consistency • A publicly available dataset of synthetic clinical notes across 70 patients, provided at multiple validation levels • An evaluation of pipeline outputs across dimensions of realism, consistency, and variation 2 Dataset Description 2.1 Overview We plan to release the dataset at three levels of validation: Bronze, Silver, and Gold. Currently, only silver has been released. The Gold dataset will consist of data generated using our validated pipeline and LLM, with additional review and validation by clinicians. The Silver dataset consists of data generated using our validated pipeline and LLM, without clinician review. The Bronze dataset will consist of data generated using our validated pipeline, possibly with new LLMs, without additional validation steps. 2.2 Known Issues Some special characters may be incorrectly decoded in the dataset. Users are advised to perform basic cleaning before use. 2.3 Silver Dataset The Silver dataset contains data generated using our pipeline with GPT-4o as the underlying language model. It includes 70 patients, each associated with approximately 20–50 synthetic clinical notes. Of these patients, 50 are adults and 20 are paediatric cases. 2.4 Data Structure The dataset is provided across three tables: 1. patients.csv 2. admissions.csv 3. synthetic_clinical_notes.csv The patients.csv table contains demographic and identifying information for each synthetic patient, including age, date of birth, full name, gender identity, NHS number, and a unique person identifier. The admissions.csv table contains admission-level information for each patient, including admission identifiers, admission method and timestamp, admission title, bed location, patient identifiers, site information, and ward details. The synthetic_clinical_notes.csv table contains the generated clinical notes associated with each patient admission. This includes metadata such as timestamps, note identifiers, note subject and type, as well as the clinical note text itself. 3 Related Work Synthetic data can enable a range of use-cases including end-to-end software testing; tool demonstration; faster innovation; novel linkage; evaluation of solutions; and addressing bias and quality. The choice of approach greatly depends on the type of data to be synthesised, the use-case, and the balance between privacy, fidelity, fairness, explainability and adoption. To ensure adequate coherence across different notes in the patient journey, we needed a methodology which clearly defines the patient, their reason for being in hospital, and the series of events that make up their journey. There are therefore three different types of synthetic data which we needed to consider: 1. The patient demographics and their reason for hospitalisation can be represented by structured data; 2. The patient’s journey through hospital is semi-structured; 3. The final outputs, i.e. the clinical notes themselves, constitute unstructured data. 3.1 High Privacy Structured Data Generation Synthetic tabular data can either be generated from raw data or domain knowledge. If generating from raw data, then the first step is to create a representation which captures the content and variability of the raw data but also balances this against privacy so no individual data point can be confidently identified from the representation. The second step is to then sample from this representation in a way that considers inherent biases. The simplest way of doing this is to “erode” raw data (through adding noise, suppressing low counts, reallocation and aggregation) until a privacy threshold (usually defined by k-anonymity, l-diversity, or t-closeness [ 15 ] is achieved. The NHS Digital Artificial Data pilot is one such example of this [ 13 ] . Alternatively, we can use tools such as Synthea [ 20 ] . This is an open-source patient population simulator which allows for the generation of machine readable, realistic and synthetic patient data. This can then generate lifespans of realistic but fictional synthetic patient electronic health records. Alternative simulation engines including agent-based modelling (Agent Hospital [ 10 ] ) and digital twin setups which have been developed but often turn out to be too burdensome to maintain for general usage. The evaluation of the tabular synthetic data generated includes fidelity, utility, fairness and privacy metrics. • To measure fidelity, we turn to statistical tests to understand profile comparisons (Pearson’s or