A Case Study Exploring the Current Landscape of Synthetic Medical Record Generation with Commercial LLMs

Yihan Lin, Zhirong Yu, Simon A. Lee · 2025

Read A Case Study Exploring the Current Landscape of Synthetic Medical Record Generation with Commercial LLMs by Yihan Lin, Zhirong Yu, Simon A. Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-14657.txt.

Introduction

Fake patient files could train medical software without ever touching a real person's past. Yihan Lin, Zhirong Yu, and Simon Lee test how well the big commercial chat models fake them in 2025. Fake files offer charms a real set cannot: a fixed shape, fairer mixes of patients, and free sharing.

The hard test is travel: a file style learned at one hospital must still ring true at another, a known weak point of medical data work. The team probes where the models shine and where they slip, across the steps of making the files. Their headline is measured: the models fake reliably in part, with clear gaps left. Privacy-safe data at scale is the prize at stake.

Catalog record

CREATORYihan Lin, Zhirong Yu, Simon A. Lee
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-14657

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Case Study Exploring the Current Landscape of Synthetic Medical Record Generation with Commercial LLMs Yihan Lin, Zhirong Yu, Simon A. Lee Abstract Synthetic Electronic Health Records (EHRs) offer a valuable opportunity to create privacy-preserving and harmonized structured data, supporting numerous applications in healthcare. Key benefits of synthetic data include precise control over the data schema, improved fairness and representation of patient populations, and the ability to share datasets without concerns about compromising real individuals’ privacy. Consequently, the AI community has increasingly turned to Large Language Models (LLMs) to generate synthetic data across various domains. However, a significant challenge in healthcare is ensuring that synthetic health records reliably generalize across different hospitals, a long-standing issue in the field. In this work, we evaluate the current state of commercial LLMs for generating synthetic data and investigate multiple aspects of the generation process to identify areas where these models excel and where they fall short. Our main finding from this work is that while LLMs can reliably generate synthetic health records for smaller subsets of features, they struggle to preserve realistic distributions and correlations as the dimensionality of the data increases, ultimately limiting their ability to generalize across diverse hospital settings. † † volume: LEAVE UNSET † † year: 2025 † † submitted: LEAVE UNSET † † published: LEAVE UNSET † † workshop: Conference on Health, Inference, and Learning (CHIL) 2025 Data and Code Availability This work was conducted using numerous enterprise accounts of various commercial Large Language Models. Model Checkpoints may affect reproducibility of this work. The validation data was sourced from eICU database ( Pollard et al., 2018 ) which is a multi-center dataset comprising deidentified health data from over 200,000 ICU admissions across the United States between 2014 and 2015. Institutional Review Board (IRB) Our work did not require IRB approval. Overview of Our Method Figure 1: Overview of our Method 1 Introduction Large Language Models (LLMs) have significantly advanced AI research, serving as powerful tools for diverse applications through their sophisticated natural language understanding and generation capabilities ( Wang et al., 2023 ) . A prominent application of LLMs is synthetic data generation, particularly in healthcare, where they can create synthetic electronic health records (EHRs) ( Chen et al., 2021 ) . Synthetic EHRs offer structured and consistent data generation while addressing privacy concerns associated with real patient data. Additionally, LLMs can generate datasets that better represent underrepresented and marginalized groups, mitigating the diversity limitations of traditional datasets such as MIMIC ( Johnson et al., 2016 ) and UK Biobank ( Bycroft et al., 2018 ) . Despite these advantages, generating synthetic medical records poses challenges in ensuring model generalizability across diverse patient populations and heterogeneous data structures ( Goetz et al., 2024 ; Goldstein et al., 2017 ) . Efforts in data harmonization, including frameworks like MEDS ( Kolo et al., 2024 ) and schema-matching techniques ( Parciak et al., 2024 ) , have made strides but have not fully resolved these issues. Consequently, synthetic data generation remains a promising approach for creating harmonized and adaptable datasets. In this work, we explore the use of LLMs to generate synthetic EHRs and evaluate their effectiveness in healthcare modeling. We investigate various generation strategies, focusing on factors such as sample size, dimensionality, as well as fidelity and privacy. To assess the generalizability of the synthetic data, we conduct multi-site validation using real data from the eICU database ( Pollard et al., 2018 ) . Our benchmarking framework uses an XGBoost ( Shwartz-Ziv and Armon, 2022 ) to provide a robust evaluation of synthetic datasets, addressing the gap in assessing the robustness and generalizability of LLM-generated synthetic data in healthcare. Importance of the Problem Fair and representative datasets are crucial for developing equitable and effective AI systems in healthcare ( Chen et al., 2023 ) . The field faces persistent challenges related to data access, diversity, and bias, which compromise the reliability and fairness of AI models ( Chen et al., 2018 ) . Synthetic data generation offers a viable solution to these issues by providing alternatives that enhance diversity and protect privacy. However, there is a lack of rigorous studies evaluating the robustness and generalizability of synthetic datasets, particularly in healthcare settings. What Makes Generating EHR Challenging? Generating synthetic EHR presents significant challenges, primarily due to the intricate and clinically meaningful relationships that must be preserved between covariates and features. EHR data encompasses a wide array of variables, each of which interacts in complex, non-linear ways. Ensuring that these interdependencies remain coherent and reflective of real-world medical scenarios is crucial for the synthetic data to be both useful and valid for downstream applications. As the scale increases, maintaining these intricate relationships becomes exponentially more difficult. High-dimensional data introduces issues such as sparsity and the curse of dimensionality, which complicate the modeling of joint distributions and the preservation of conditional dependencies. Balancing the fidelity of synthetic data with computational feasibility and privacy constraints further exacerbates the difficulty, making the generation of large-scale, realistic EHR datasets a formidable task. 2 Related Works 2.1 Synthetic Data Generation Synthetic data—artificially generated information that replicates the statistical properties of real-world data—has become a pivotal resource across various industries ( Raghunathan, 2021 ; Jordon et al., 2022 ; Nikolenko, 2021 ) . Its benefits include enhanced privacy by removing personal identifiers, reduced data collection costs, and the ability to generate large-scale, tailored datasets. Nonetheless, challenges such as the potential omission of rare edge cases and the need for rigorous validation to ensure accuracy and relevance persist. In the context of Large Language Models (LLMs), synthetic data offers significant research advancements. It enables LLMs to learn from a broader spectrum of examples without exposing sensitive information or infringing on proprietary content ( Gholami and Omar, 2023 ) . Ensuring the quality and relevance of synthetic data is crucial, as inaccuracies can impair model performance. Studies have shown that appropriately generated synthetic data can enhance LLM performance on downstream tasks ( Gholami and Omar, 2023 ) , improve hidden state representations through pre-training ( Wang et al., 2023 ) , and facilitate complex reasoning in applications like AlphaGeometry ( Trinh et al., 2024 ) . Recent advancements indicate that LLMs surpass traditional generative models, such as Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs), in producing high-fidelity synthetic tabular data ( Borisov et al., 2023 ) . For example, GReaT ( Borisov et al., 2023 ) leverages pre-trained LLMs to outperform GANs in synthesizing high-quality tabular data. Subsequent models, including ReaLTAbFormer ( Solatorio and Dupriez, 2023 ) , TabuLa ( Zhao et al., 2023 ) , DP-LLMTGen ( Tran and Xiong, 2024 ) , and CLLM ( Seedat et al., 2024 ) , have introduced new features that enhance data generation capabilities. Additionally, MALLM-GAN ( Ling et al., 2024 ) integrates LLMs within GAN architectures to further improve synthetic data generation. 2.2 Synthetic Data in Healthcare Synthetic data is well-established in healthcare, with studies evaluating its benefits and challenges ( Gonzales et al., 2023 ) . The high-dimensional nature of patient records requires advanced methods for accurate generation. Generative Adversarial Networks (GANs) have been pivotal in this domain, capable of simulating the complex distributions of patient data

Read the complete text