Unlocking LLMs: Addressing Scarce Data and Bias Challenges in Mental Health

Vivek Kumar, Eirini Ntoutsi, Pushpraj Singh Rajawat, Giacomo Medda, Diego Reforgiato Recupero · 2024

Read Unlocking LLMs: Addressing Scarce Data and Bias Challenges in Mental Health by Vivek Kumar, Eirini Ntoutsi, Pushpraj Singh Rajawat, Giacomo Medda, Diego Reforgiato Recupero (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-12981.txt.

Introduction

Vivek Kumar and co-authors wrote this 2024 paper on a new data set for studying therapy talk. Motivational interviewing is a counseling style that helps people change habits, but research on it suffers from scarce, expert-labeled dialogue data. Language models could help, yet they also bring bias and made-up content into a sensitive area.

The team used ChatGPT to draft new dialogues in the therapy style, guided by careful prompts about empathy and reflection. Experts then labeled the dialogues under the standard coding scheme of the field, checking both wording and psychological tone. The authors test many models on fresh sorting tasks built from the data. They also study how prompt design and added data can cut the biases the generator brings.

Catalog record

CREATORVivek Kumar, Eirini Ntoutsi, Pushpraj Singh Rajawat, Giacomo Medda, Diego Reforgiato Recupero
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-12981

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Unlocking LLMs: Addressing Scarce Data and Bias Challenges in Mental Health Vivek Kumar, Eirini Ntoutsi, Pushpraj Singh Rajawat, Giacomo Medda, Diego Reforgiato Recupero Abstract Large language models (LLMs) have shown promising capabilities in healthcare analysis but face several challenges like hallucinations, parroting, and bias manifestation. These challenges are exacerbated in complex, sensitive, and low-resource domains. Therefore, in this work we introduce IC-AnnoMI, an expert-annotated motivational interviewing (MI) dataset built upon AnnoMI by generating in-context conversational dialogues leveraging LLMs, particularly ChatGPT. IC-AnnoMI employs targeted prompts accurately engineered through cues and tailored information, taking into account therapy style (empathy, reflection), contextual relevance, and false semantic change. Subsequently, the dialogues are annotated by experts, strictly adhering to the Motivational Interviewing Skills Code (MISC), focusing on both the psychological and linguistic dimensions of MI dialogues. We comprehensively evaluate the IC-AnnoMI dataset and ChatGPT’s emotional reasoning ability and understanding of domain intricacies by modeling novel classification tasks employing several classical machine learning and current state-of-the-art transformer approaches. Finally, we discuss the effects of progressive prompting strategies and the impact of augmented data in mitigating the biases manifested in IC-AnnoM. Our contributions provide the MI community with not only a comprehensive dataset but also valuable insights for using LLMs in empathetic text generation for conversational therapy in supervised settings. 1 Introduction Motivational Interviewing (MI) is a client-centered, directive method of conversational counselling that enhances an individual’s motivation to achieve behavioural change ( Miller and Rollnick 2012 ) . MI helps the clients resolve ambivalence and focus on intrinsic motivations by "strengthening client’s belief in their capability" or "providing a supportive environment" to make positive changes Moyers et al. 2009 ; Martins and McNeil 2009 ; Alperstein and Sharpe 2016 . MI has gained wide attention from the clinical psychology community due to its proven efficacy in catalyzing significant improvements in health behaviours such as reducing alcohol consumption, smoking cessation, dietary modification, substance abuse, and increasing physical activity ( Apodaca et al. 2014 ; Barnett et al. 2014 ; Catley et al. 2012 ; Lundahl et al. 2013 ) . In particular, MI have been very effective in interventions where client adherence and commitment are critical to successful treatment outcomes ( Hettema et al. 2005 ; Tavabi et al. 2021 ) . In a nutshell, the core principles of MI, namely, "expressing empathy", "developing discrepancy", "rolling with resistance", and "supporting self-efficacy", are designed to promote a non-confrontational approach that respects client autonomy and facilitates self-directed change ( Moyers and Rollnick 2002 ) . Since MI is an interactive and time-intensive process, it is accessible to only a small population group, and the reasons account for " individual’s awareness towards mental health ", " cost of intervention ", " lifestyle constraints ", and so on. According to World Health Organization report 1 1 1 https://www.who.int/news-room/fact-sheets/detail/mental-disorders , one in every eight people in the world live with a mental disorder and over half ( 54.7% ) of adults with a mental condition do not have access to effective treatment, summing up over 28 million individuals Organization 2022 ; Reinert et al. 2021 . Hence, to overcome these challenges and break the barriers in catering to essential and effective treatment, recent research has focused on artificial intelligence (AI) applications. In particular, Large Language Models (LLMs) have been recognised as a potential solution to alleviate the burden on clinicians ( Tripathi et al. 2024 ; Wang et al. 2023 ; Yu et al. 2023 ) . Undoubtedly, LLMs can be instrumental in tackling a wide range of problems directly or by means of assisting roles ( Stella et al. 2023 ; Shiffrin and Mitchell 2023 ) . However, due to its specialised nature, the mental health domain poses unique challenges of complex language understanding that question LLMs efficacy ( Demszky et al. 2023 ; Abramski et al. 2023 ) . Empirical studies have delineated that in such complex domains, LLMs are prone to severe performance concerns like hallucinations ( Li et al. 2023a ; Sarkar 2023 ) , stochastic parroting nature Bender et al. 2021 ; Duan et al. 2023 , and biases Yeh et al. 2023 . Therefore, this study aims to bridge this gap by addressing the scarce data and bias challenges in low-resource domains, such as mental health, by generating plausible synthetic data. In this context, we leverage LLMs, particularly ChatGPT and novel prompting strategies, to generate in-context ( Brown et al. 2020 ; Chen et al. 2022 ; Dong et al. 2022 ) MI dialogues, considering whole therapeutic conversations at once. Furthermore, we develop an evaluation scheme adhering to the Manual for the Motivational Interviewing Skill Code (MISC) ( Miller et al. ) to assess the quality of generated MI dialogues by comprehensively touching down the psychological and linguistic dimensions. Moreover, we model a novel classification task to identify high- and low-quality MI dialogues. This setting is used to evaluate ChatGPT in terms of domain intricacies understanding, emotional reasoning ability, and biases (contextual, sampling, class imbalance) originated from the experimental dataset. Finally, we discuss the risks of unsupervised employment of LLMs in healthcare, emphasizing the need for collaboration with domain experts and human supervision to ensure responsible LLM implementation across healthcare settings. To put in perspective, our contributions are summarised below: • Tailored prompting approach : We propose progressive prompt-based augmentation techniques using LLMs to generate in-context MI dialogue. • Expert annotation : We develop a rigorous annotation scheme covering psychological and linguistic aspects (e.g., language comprehension, MI structure, false semantics change, contextual reasoning) of generated data grounded on MISC to propose the IC-AnnoMI dataset. • Model performance evaluation : We perform extensive experiments with CML and state-of-the-art (transformer) approaches on the IC-AnnoMI dataset to (i) provide a broad set of baselines for the adopted task, (ii) assess the quality of IC-AnnoMI , and (iii) discuss potential risks and dangers of unsupervised use of LLMs in sensitive domain. • Reproducibility : We publicly 2 2 2 https://github.com/vsrana-ai/IC-AnnoMI provide IC-AnnoMI and the source code used for our experiments to contribute to the low resource domain and facilitate further research. The rest of the paper is organised as follows. Section 2 presents the existing research on LLMs in healthcare. Section 3 presents the data augmentation, MISC annotation, and the dataset creation. Section 4 provides the problem statement and experimental design. Section 5 outlines our experimental setting and results. Section 6 addresses the implications of our study and opens up future research directions. Finally, the limitations section discusses the limitations of our work. 2 Related work In this section, we introduce the works focused on developing public datasets to assist research into psychology and highlight the biases affecting LLMs. 2.1 Data scarcity in mental health domain Domains like psychology and its sub-domains suffer from the scarcity of publicly available resources (datasets) that could be instrumental in mitigating bias in ML approaches and enforcing responsible and ethical AI ( Wu et al. 2021 ) . This problem has gained traction, and researchers have periodically attempted to bridge this gap by developing publicly available datasets. Early efforts in this direction can be credited to ( Pérez-Rosas et al. 2016 ) , where they released a dataset annotated with ten counselor behavioural codes

Read the complete text