MoPHES:Leveraging on-device LLMs as Agent for Mobile Psychological Health Evaluation and Support

Xun Wei, Pukai Zhou Zeyu Wang · 2025

Read MoPHES:Leveraging on-device LLMs as Agent for Mobile Psychological Health Evaluation and Support by Xun Wei, Pukai Zhou Zeyu Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-16085.txt.

Introduction

Xun Wei, Pukai Zhou, and Zeyu Wang put a mental health agent on the phone itself, where it can assess state before it chats. Nearly a billion people live with anxiety, depression, and related conditions, in-person therapy cannot meet that demand, and stigma deters many from seeking it. General chatbots converse warmly but skip the real-time state assessment that professional counselling requires.

MoPHES joins state evaluation, conversational support, and professional treatment recommendations in one framework. Two small fine-tuned models run on-device: one gauges the user's state and predicts anxiety and depression severity, the other holds multi-turn supportive dialogue informed by that gauge. On-device deployment adds convenience and privacy. The three authors also build a benchmark for automatic scoring of state prediction and counselling dialogue, with metrics, data sets, and methods included.

Catalog record

CREATORXun Wei, Pukai Zhou Zeyu Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-16085

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MoPHES:Leveraging on-device LLMs as Agent for Mobile Psychological Health Evaluation and Support Xun Wei, Pukai Zhou Zeyu Wang Abstract The 2022 World Mental Health Report calls for global mental health care reform, amid rising prevalence of issues like anxiety and depression that affect nearly one billion people worldwide. Traditional in-person therapy fails to meet this demand, and the situation is worsened by stigma. While general-purpose large language models (LLMs) offer efficiency for AI-driven mental health solutions, they underperform because they lack specialized fine-tuning. Existing LLM-based mental health chatbots can engage in empathetic conversations, but they overlook real-time user mental state assessment which is critical for professional counseling. This paper proposes MoPHES , a framework that integrates mental state evaluation, conversational support, and professional treatment recommendations. The agent developed under this framework uses two fine-tuned MiniCPM4-0.5B LLMs: one is fine-tuned on mental health conditions datasets to assess users’ mental states and predict the severity of anxiety and depression; the other is fine-tuned on multi-turn dialogues to handle conversations with users. By leveraging insights into users’ mental states, our agent provides more tailored support and professional treatment recommendations. Both models are also deployed directly on mobile devices to enhance user convenience and protect user privacy. Additionally, to evaluate the performance of MoPHES with other LLMs, we develop a benchmark for the automatic evaluation of mental state prediction and multi-turn counseling dialogues, which includes comprehensive evaluation metrics, datasets, and methods. 1 1 1 https://github.com/weixun2018/MoPHES † † footnotetext: \dagger Equal Contribution. † † footnotetext: * Corresponding Author. I Introduction Mental health issues are emerging as an increasingly severe threat to global public health, with their prevalence rising annually. Approximately one billion people worldwide suffer from psychological disorders, accounting for 13% of the global population and imposing a heavy disease burden [ 1 ] . Among these mental disorders, anxiety and depression alone make up nearly 60%. However, this threat remain significantly underestimated. Over 70% individuals with such disorders never access effective mental health services, primarily due to low social awareness and stigma surrounding mental illness, particularly in developing countries [ 1 ] . Furthermore, traditional in-person therapy includes both offline sessions and online consultations with a psychological counselor, but it still struggles to meet the enormous demand. The inadequacy of this approach comes from two key limitations: a shortage of qualified professionals and high service costs. As a result, the challenge of providing high-quality, affordable mental health care remains formidable. Recently, the Natural Language Processing(NLP) technology has been actively applied to develop AI-powered systems that deliver psychological counseling and treatment guidance. Researchers have primarily focused on three core areas:providing mental disease counseling, enhancing emotional support capability and offering online psychological consultation services. Notably, the advent of LLMs has significantly advanced AI intelligence and fuels enthusiasm of researchers into digital mental health interventions. Subsequently, various studies have been proposed to improve mental health by leveraging LLMs as conversational chatbots or dedicated intelligent agents [ 9 , 10 , 11 , 12 ] . However, the direct application of general-purpose LLMs, such as ChatGPT, Claude and Llama, tends to yield underwhelming performance in mental health field. Naturally, an effective method to overcome this limitation is to fine-tune general-purpose LLMs with specialized psychological corpora. Currently, a series of mental health LLMs have been developed, including MeChat [ 14 ] , PsyLLM [ 17 ] , SoulChat [ 19 ] , CPsyCoun [ 21 ] , EmoLLLM [ 22 ] , PsycoLLM [ 23 ] . Owing to ethics policy and privacy protection, real-world datasets of multi-turn mental counseling dialogues remain extremely scarce. Thus, the key of these studies is to construct a high-quality multi-turn dialogues dataset of psychological counseling, which are typically derived from website-crawled Q&As or clinical counseling reports. For instance, SMILECHAT [ 14 ] is synthetic multi-turn dialogues dataset containing 55K samples, generated from single-turn QAs. When carefully fine-tuned on such multi-turn conversions, mental health LLMs exhibit superior performance compared to general-purpose LLMs in terms of content naturalness, emotional empathy and helpfulness. Despite these advancements, the limitation of the aforementioned chatbots lies in their failure to conduct concurrent assessments of users’ mental states during interactions—a core capability for professional psychological counselors [ 29 ] . For professional psychological counseling, a counselor typically adopts corresponding psychotherapy methods based on their synchronous evaluation of a user’s mental state. For example, symptoms of mild anxiety condition differ from those of severe anxiety condition, and the corresponding treatment approaches also vary: the former may only require appropriate conversational guidance and meditation, while the latter is likely to need medication-based intervention. Consequently, it is necessary to enable LLMs to evaluate users’ mental states and deliver symptom-specific interventions. Additionally, in the mobile internet era, the provision of mobile psychological counseling services has become extremely urgent. In this paper, we propose a novel framework MoPHES , which leverages LLMs as intelligent agent to provide mobile psychological health evaluation and support. The implementation of MoPHES follows three key stages, detailed as follows: First, we collect single-turn counseling QAs from publicly available sources. For dataset construction, we label users’ counseling questions with mental conditions labels; simultaneously, we generate multi-turn dialogues from the single-turn QAs via prompting GPT-4o mini model. Then we fine-tune two MiniCPM4-0.5B LLMs separately on the mental health conditions dataset and the multi-turn dialogue dataset. The first model, fine-tuned on the mental conditions dataset, focuses on evaluating users’ mental states; the second model, fine-tuned on the multi-turn dialogue dataset, engages users in empathetic conversations. Finally, we deploy the two fine-tuned models on Android-based mobile devices using the llama.cpp framework [ 3 ] . During interactions, the agent assesses user’s mental state and stores the assessment results locally after every 5 dialogue turns. When initiating the next dialogue round, the agent first loads the user’s historical mental state records, integrates this information with the user’s current input, and then generates a more tailored and context-aware response. The main contribution of this paper can be summarized as follows: • We propose a new framework for mental health that organically integrates the mental state assessment, conversational support and professional treatment recommendations. By fine-tuning on mental health conditions dataset and multi-turn counseling dialogues, our agent is endowed both predictive and conversational capabilities and more closely mimics the role of a real psychologist. • We demonstrate that “small” LLM with 0.5 billion parameters can achieve remarkable performance in the mental health domain through fine-tuning on specialized corpora. This model can be easily deployed and run on most users’ mobile devices, thereby enabling the provision of convenient mental health services while protecting users’ privacy. • We develop a psychological benchmark for automatic evaluation of mental state prediction and multi-turn counseling dialogues, which includes comprehensive evaluation metrics, datasets and methods. II Related Work Recently, the mental health field has garnered significant attention across numerous studies, largely driven by the impact of the COVID-19 pandemic [ 24 , 25 , 26 , 27 , 28 ] . Since the emergence of LLMs, researchers have begun to leverag these models to support mental health efforts, primarily focusing on areas such as mental conditions identification and psychological chatbot development. MentaLLaMA [ 30 ] introduced a multi-task and multi-source interpretable mental health instruction

Read the complete text