Knowledge-Guided Retrieval-Augmented Generation for Zero-Shot Psychiatric Data: Privacy Preserving Synthetic Data Generation

Adam Jakobsen 1 2 , Sushant Gautam 1 2 , Hugo Lewi Hammer 1 2 Susanne Olofsdotter 3 Miriam S Johanson 2 Pål Halvorsen 1 2 , Vajira Thambawita 1 · 2026

Read Knowledge-Guided Retrieval-Augmented Generation for Zero-Shot Psychiatric Data: Privacy Preserving Synthetic Data Generation by Adam Jakobsen 1 2 , Sushant Gautam 1 2 , Hugo Lewi Hammer 1 2 Susanne Olofsdotter 3 Miriam S Johanson 2 Pål Halvorsen 1 2 , Vajira Thambawita 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25186.txt.

Introduction

Jakobsen and co-authors make fake patient data for psychiatry research without touching real records. Privacy rules keep real psychiatric tables locked away, which slows AI work. Their method steers a language model with text pulled from the DSM-5 and ICD-10 manuals. It builds synthetic tables for six anxiety disorders. Rivals trained on real data still win on some traits. But the guided model matches pairwise structure well and posts the lowest pair error in two disorders. Checks show low linkage risk, near the best rival.

Catalog record

CREATORAdam Jakobsen 1 2 , Sushant Gautam 1 2 , Hugo Lewi Hammer 1 2 Susanne Olofsdotter 3 Miriam S Johanson 2 Pål Halvorsen 1 2 , Vajira Thambawita 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35165
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.25186

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Knowledge-Guided Retrieval-Augmented Generation for Zero-Shot Psychiatric Data: Privacy Preserving Synthetic Data Generation Adam Jakobsen 1 2 , Sushant Gautam 1 2 , Hugo Lewi Hammer 1 2 Susanne Olofsdotter 3 Miriam S Johanson 2 Pål Halvorsen 1 2 , Vajira Thambawita 1 Abstract AI systems in healthcare research have shown potential to increase patient throughput and assist clinicians, yet progress is constrained by limited access to real patient data. To address this issue, we present a zero-shot, knowledge-guided framework for psychiatric tabular data in which large language models (LLMs) are steered via Retrieval-Augmented Generation using the Diagnostic and Statistical Manual of Mental Disorders (DSM-5) and the International Classification of Diseases (ICD-10). We conducted experiments using different combinations of knowledge bases to generate privacy-preserving synthetic data. The resulting models were benchmarked against two state-of-the-art deep learning models for synthetic tabular data generation, namely CTGAN and TVAE, both of which rely on real data and therefore entail potential privacy risks. Evaluation was performed on six anxiety-related disorders: specific phobia, social anxiety disorder, agoraphobia, generalized anxiety disorder, separation anxiety disorder, and panic disorder. CTGAN typically achieves the best marginals and multivariate structure, while the knowledge-augmented LLM is competitive on pairwise structure and attains the lowest pairwise error in separation anxiety and social anxiety. An ablation study shows that clinical retrieval reliably improves univariate and pairwise fidelity over a no-retrieval LLM. Privacy analyses indicate that the real data-free LLM yields modest overlaps and a low average linkage risk comparable to CTGAN, whereas TVAE exhibits extensive duplication despite a low k k -map score. Overall, grounding an LLM in clinical knowledge enables high-quality, privacy-preserving synthetic psychiatric data when real datasets are unavailable or cannot be shared. I Introduction Mental health disorders represent a significant and growing global health challenge, affecting a substantial portion of the population [ 24 ] . According to the World Health Organization (WHO) , one in every eight people worldwide lives with a mental disorder [ 35 , 9 ] . Artificial Intelligence (AI) and Machine Learning (ML) have emerged as powerful paradigms with the potential to accelerate the diagnostic process, enhance diagnostic precision, and improve access to mental healthcare [ 27 , 16 ] . However, progress in this domain is severely constrained by limited access to large-scale, high-quality psychiatric data. The sensitive nature of this information requires strict adherence to privacy regulations, creating a bottleneck for research and model development [ 12 ] . To circumvent these challenges, deep learning synthetic data generators have emerged as a promising solution to data scarcity in healthcare [ 8 , 15 ] . While powerful, these methods are fundamentally reliant on access to large volumes of real patient data for training. This dependency introduces a utility-privacy paradox. To protect patient confidentiality, techniques like Differential Privacy (DP) , where noise is injected during the learning process, are often applied during training of the generative model [ 13 ] . However, this injected noise can degrade the statistical integrity of the learned data distribution, consequently diminishing the utility of the synthetic data for downstream tasks [ 32 , 39 ] . This inherent trade-off between privacy and utility limits the effectiveness of data-dependent generation methods, as stronger privacy guarantees often lead to less useful synthetic data. In this work, we introduce a fundamentally different paradigm for psychiatric data synthesis that completely circumvents the data-dependency problem and its associated fidelity-utility-privacy paradox. To generate privacy-preserving synthetic data, we propose a zero-shot, knowledge-guided framework that leverages a Large Language Model (LLM) to “simulate” a patient completing a structured clinical assessment based on the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-V) [ 2 ] . By employing Retrieval-Augmented Generation (RAG) [ 21 ] , our model grounds its responses in a knowledge base of clinical criteria, enabling it to generate clinically plausible and coherent assessment data without being trained on or exposed to real patient records. This zero-shot approach breaks the reliance on sensitive data, allowing for the creation of high-fidelity, privacy-preserving synthetic datasets from first principles. We evaluate our generated datasets in terms of both fidelity and privacy, demonstrating a viable path toward accelerating AI research in mental health without compromising patient privacy. Source code and datasets are available at https://github.com/Adamjakobsen/Zero-Shot-Psychiatry-with-RAG . II Related Work Our work is situated at the intersection of three rapidly advancing domains: synthetic data generation in healthcare, privacy-preserving machine learning, and the application of LLMs for clinical simulation. This section reviews key developments in these areas and contextualizes the novelty of our knowledge-guided, zero-shot approach. II-A Synthetic Data Generation for Health Data The use of synthetic data to overcome privacy and accessibility barriers in healthcare is a well-established field of research. Generative Adversarial Network (GAN) -based models, such as MedGAN [ 7 ] , have been successfully used to generate realistic synthetic Electronic Health Record (EHR) . To better handle the mixed-type nature of tabular data common in EHRs, specialized architectures like the Conditional Tabular GAN (CTGAN) were developed [ 37 ] . CTGAN and its variants have become a popular baseline for generating tabular medical data, demonstrating strong performance in preserving the statistical properties of the original data across various medical applications [ 10 ] . Subsequent work has extended GAN architectures to handle the temporal nature of longitudinal patient data, as seen in models like RCGAN [ 14 ] and DoppelGANger [ 23 ] . VAEs have also been employed for similar tasks, often noted for their more stable training dynamics, with models like MedVAE and TVAE demonstrating strong performance in generating plausible patient records [ 5 , 37 ] . While these models excel at learning distributions from existing data, their fundamental limitation is their complete dependence on a large, representative real dataset for training. This reliance makes them vulnerable to privacy risks and perpetuates data scarcity issues when no initial dataset is available. Our work diverges from this entire paradigm by eliminating the need for a real training dataset altogether. II-B Privacy Preservation in Synthetic Health Data To mitigate the privacy risks associated with training generative models on sensitive data, Differential Privacy (DP) has become the gold standard [ 13 ] . The core idea of DP is to add carefully calibrated noise at some point in the model training pipeline—either to the input data, the model gradients (as in DP-SGD [ 1 ] ), or the output—to make it computationally infeasible to determine whether any single individual’s data was used in the training. Numerous studies have integrated DP with generative models for health data. For example, DP-GAN [ 36 ] applies noise to the gradients of the discriminator during GAN training to provide formal privacy guarantees. Similarly, PATE-GAN [ 19 ] uses the Private Aggregation of Teacher Ensembles (PATE) framework to achieve privacy. However, this formal privacy comes at a cost. The noise injection required for DP inherently creates a trade-off between privacy, fidelity and data utility [ 20 , 39 ] . High levels of privacy (i.e., more noise) often lead to a degradation in the statistical fidelity of the synthetic data, reducing its effectiveness for training downstream machine learning models. Our knowledge-guided approach sidesteps this fidelity-privacy paradox by generating data from a

Read the complete text