SynSym: A Synthetic Data Generation Framework for Psychiatric Symptom Identification Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1; August 09–13, 2026; Jeju Island, Republic of Korea Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1 (KDD ’26), August 09–13, 2026, Jeju Island, Republic of Korea DOI: 10.1145/3770854.3785698 ISBN: 979-8-4007-2258-5/2026/08 CCS: Computing methodologies Natural language processing CCS: Computing methodologies Language resources

Migyeong Kang, Jihyun Kim, Hyolim Jeon, Sunwoo Hwang, Jihyun An, Yonghoon Kim, Haewoon Kwak, Jisun An, Jinyoung Han · 2026

Read SynSym: A Synthetic Data Generation Framework for Psychiatric Symptom Identification Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1; August 09–13, 2026; Jeju Island, Republic of Korea Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1 (KDD ’26), August 09–13, 2026, Jeju Island, Republic of Korea DOI: 10.1145/3770854.3785698 ISBN: 979-8-4007-2258-5/2026/08 CCS: Computing methodologies Natural language processing CCS: Computing methodologies Language resources by Migyeong Kang, Jihyun Kim, Hyolim Jeon, Sunwoo Hwang, Jihyun An, Yonghoon Kim, Haewoon Kwak, Jisun An, Jinyoung Han (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-21529.txt.

Introduction

Kang and co-authors build SynSym, a framework that generates synthetic training data for spotting psychiatric symptoms in social media posts. Expert labeling is slow and lacks standard guidelines, so real datasets stay small. SynSym expands each symptom into sub-concepts, then writes expressions in varied linguistic styles. It also composes multi-symptom posts guided by clinical co-occurrence patterns. Models trained only on the synthetic data matched models trained on real data across three benchmarks. Adding real data for fine-tuning helped further, they report.

Catalog record

CREATORMigyeong Kang, Jihyun Kim, Hyolim Jeon, Sunwoo Hwang, Jihyun An, Yonghoon Kim, Haewoon Kwak, Jisun An, Jinyoung Han
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53918
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.21529

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SynSym: A Synthetic Data Generation Framework for Psychiatric Symptom Identification Conference: Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1; August 09–13, 2026; Jeju Island, Republic of Korea Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1 (KDD ’26), August 09–13, 2026, Jeju Island, Republic of Korea DOI: 10.1145/3770854.3785698 ISBN: 979-8-4007-2258-5/2026/08 CCS: Computing methodologies Natural language processing CCS: Computing methodologies Language resources Migyeong Kang, Jihyun Kim, Hyolim Jeon, Sunwoo Hwang, Jihyun An, Yonghoon Kim, Haewoon Kwak, Jisun An, Jinyoung Han Abstract . Psychiatric symptom identification on social media aims to infer fine-grained mental health symptoms from user-generated posts, allowing a detailed understanding of users’ mental states. However, the construction of large-scale symptom-level datasets remains challenging due to the resource-intensive nature of expert labeling and the lack of standardized annotation guidelines, which in turn limits the generalizability of models to identify diverse symptom expressions from user-generated text. To address these issues, we propose SynSym , a synthetic data generation framework for constructing generalizable datasets for symptom identification. Leveraging large language models (LLMs), SynSym constructs high-quality training samples by (1) expanding each symptom into sub-concepts to enhance the diversity of generated expressions, (2) producing synthetic expressions that reflect psychiatric symptoms in diverse linguistic styles, and (3) composing realistic multi-symptom expressions, informed by clinical co-occurrence patterns. We validate SynSym on three benchmark datasets covering different styles of depressive symptom expression. Experimental results demonstrate that models trained solely on the synthetic data generated by SynSym perform comparably to those trained on real data, and benefit further from additional fine-tuning with real data. These findings underscore the potential of synthetic data as an alternative resource to real-world annotations in psychiatric symptom modeling, and SynSym serves as a practical framework for generating clinically relevant and realistic symptom expressions. † † cc-license: by 1. Introduction Mental health disorders represent a global public health concern, with nearly half of the world’s population expected to experience at least one mental disorder over the course of their lifetime ( 28 ) . With the increasing use of social networks, people frequently share their psychological experiences online, offering new opportunities for language-based mental health assessment ( 7 ) . Although early natural language processing (NLP) research has primarily focused on predicting the risk of mental disorders ( 8 ; 35 ; 36 ; 25 ) , there is increasing interest in identifying fine-grained psychiatric symptoms reflected in the language of users ( 32 ; 45 ; 4 ; 22 ) . Symptom identification aims to recognize individual psychiatric symptoms, such as anhedonia, insomnia, or depressed mood, based on clinical instruments such as the PHQ-9 (Patient Health Questionnaire) ( 23 ) and DSM-5 (Diagnostic and Statistical Manual of Mental Disorders) ( 2 ) . Beyond disorder-level classification, this task enables early detection of high-risk individuals and supports personalized intervention ( 44 ) . Despite its clinical importance, psychiatric symptom identification remains a challenging task primarily due to the inherent difficulties in constructing high-quality training datasets—particularly the complexity of the annotation process for symptom labels ( 30 ) . One key difficulty is that multiple psychiatric symptoms frequently co-occur within a single user-generated post, necessitating fine-grained multi-label annotation guidelines ( 44 ) . Another issue is the lack of standardized labeling protocols. While disorder-level classification can leverage standardized instruments such as the DSM-5 or PHQ-9, symptom-level annotation depends on subjective judgment, leading to inconsistencies and low inter-annotator agreement ( 29 ) . These challenges indicate that the construction of reliable training datasets for symptom identification requires well-defined annotation protocols and the close involvement of mental health professionals throughout the annotation process. These structural challenges have been widely revealed in most existing studies on psychiatric symptom identification. For example, the number of samples per symptom class is extremely small in most prior work; some rare symptoms are represented by as few as 100 instances, making it difficult for models to learn the diversity of symptom expressions ( 16 ; 41 ; 45 ; 40 ) . Moreover, the reliability of the annotation remains a key obstacle. Many publicly available datasets have been labeled by non-experts ( 16 ; 41 ; 45 ) , and a recent study has raised concerns about the consistency and clinical validity of these annotations. For instance, 29 re-annotated a subset of the PRIMATE dataset ( 16 ) , originally labeled by crowd workers, with the help of a mental health professional, and found that the agreement with the original labels was remarkably low ( \kappa=0.09 ). In this way, existing datasets on psychiatric symptom identification are mostly small in scale and suffer from limited label reliability, making it difficult for models to learn diverse and clinically meaningful symptom expressions. In addition, because most datasets are constructed from a single platform or linguistic style ( 16 ; 41 ; 45 ) , models often struggle to generalize to new platforms or unseen styles of symptom expressions. To address these limitations, we introduce SynSym , an LLM-based synthetic data generation framework for symptom identification. Given only a list of symptom classes and their brief descriptions, SynSym automatically produces diverse linguistic expressions that reflect the presence of each symptom, with minimal manual effort. The framework consists of four key stages. First, it expands each symptom into fine-grained sub-concepts to comprehensively reflect the diversity of symptom expressions. Second, it generates synthetic symptom expressions in two distinct styles, clinical and colloquial, to capture the stylistic variability observed across platforms and user populations. Third, it generates synthetic examples that reflect multiple co-occurring symptoms, guided by clinical knowledge of symptom co-occurrence patterns. Lastly, it performs quality control by using an LLM to validate whether the generated expressions appropriately align with the intended symptom labels. To the best of our knowledge, SynSym is the first framework to leverage large language models for generating synthetic data for psychiatric symptom identification. By addressing the challenges of limited training data and unreliable labels, SynSym facilitates the construction of high-quality and diverse corpora that support more robust and generalizable symptom identification across diverse settings. To evaluate the effectiveness of SynSym , we conduct experiments on three widely used benchmark datasets for symptom identification. Given that prior research on symptom identification has primarily focused on depressive disorders, we concentrate on three datasets that cover depressive symptoms. Experimental results demonstrate that models trained solely on the synthetic data generated by SynSym perform comparably to those trained on real data, and benefit further from additional fine-tuning with real data. Further experiments on other psychiatric conditions indicate that our framework generalizes beyond depressive disorders, showcasing its extensibility. These findings highlight SynSym ’s ability in generating high-quality data that captures real-world symptom expressions and generalizes across diverse linguistic styles. All resources including the synthetic dataset and code are publicly available to support future research 1 1 1 https://github.com/gyeong707/SynSym-KDD-2026 . 2. Related Work 2.1. Psychiatric Symptom Identification on Social Media Social networks have emerged as valuable data sources for mental health research, as they allow users to express their psychological states anonymously, enabling early detection of mental conditions ( 43 ; 6 ; 13 ; 26 ; 24 ) . Recent research has focused on symptom-level prediction

Read the complete text