Standardization of Psychiatric Diagnoses — Role of Fine-tuned LLM Consortium and OpenAI-gpt-oss Reasoning LLM Enabled Decision Support System Journal: Journal Name
Eranga Bandara, Ross Gore, Atmaram Yarlagadda, Anita H. Clayton, Preston Samuel, Christopher K. Rhea, Sachin Shetty · 2025
Read Standardization of Psychiatric Diagnoses — Role of Fine-tuned LLM Consortium and OpenAI-gpt-oss Reasoning LLM Enabled Decision Support System Journal: Journal Name by Eranga Bandara, Ross Gore, Atmaram Yarlagadda, Anita H. Clayton, Preston Samuel, Christopher K. Rhea, Sachin Shetty (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-25588.txt.
Introduction
Eranga Bandara led six co-authors on psychiatric diagnosis standardization. Ross Gore, Atmaram Yarlagadda, and Anita H Clayton helped. Preston Samuel, Christopher K Rhea, and Sachin Shetty joined. Their 2025 paper proposes a language model decision support system.
Their system uses a consortium of fine-tuned models. Depression is one example setting in training data. An OpenAI thinking model refines that consensus decision. A novel deployment method orchestrates agent contact. Transparency and responsible AI guide the workflow design. Tests show great promise for better quality. A prototype integrated three fine-tuned models jointly. It was developed with a United States Army team. The work claims first such consortium integration.
Catalog record
| CREATOR | Eranga Bandara, Ross Gore, Atmaram Yarlagadda, Anita H. Clayton, Preston Samuel, Christopher K. Rhea, Sachin Shetty |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-25588
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Standardization of Psychiatric Diagnoses — Role of Fine-tuned LLM Consortium and OpenAI-gpt-oss Reasoning LLM Enabled Decision Support System Journal: Journal Name Eranga Bandara, Ross Gore, Atmaram Yarlagadda, Anita H. Clayton, Preston Samuel, Christopher K. Rhea, Sachin Shetty Abstract The diagnosis of most mental disorders, including psychiatric evaluations, primarily depends on dialogues between psychiatrists and patients. This subjective process can lead to variability in diagnoses across clinicians and patients, resulting in inconsistencies and challenges in achieving reliable outcomes. To address these issues and standardize psychiatric diagnoses, we propose a Fine-Tuned Large Language Model (LLM) Consortium and OpenAI-gpt-oss Reasoning LLM-enabled Decision Support System for the clinical diagnosis of mental disorders. Our approach leverages fine-tuned LLMs trained on conversational datasets involving psychiatrist–patient interactions focused on mental health conditions (e.g., depression). These models are capable of identifying mental disorders with high accuracy based on natural language input. The diagnostic predictions from individual models are aggregated through a consensus-based decision-making process, refined by the OpenAI-gpt-oss reasoning LLM. We propose a novel method for deploying LLM agents that orchestrate seamless communication between the LLM consortium and the reasoning LLM, ensuring transparency, reliability, and responsible AI across the entire diagnostic workflow. Each LLM in the consortium was fine-tuned using the Unsloth library on Google Colab’s Tesla GPUs. To optimize performance on consumer-grade hardware, we employed Low-Rank Adaptation with 4-bit quantization (QLoRA). Experimental results demonstrate the transformative potential of combining fine-tuned LLMs with a reasoning model to create a robust and highly accurate diagnostic system for mental health assessment. A prototype of the proposed platform, integrating three fine-tuned LLMs with the OpenAI-gpt-oss reasoning LLM, was developed in collaboration with the U.S. Army Medical Research Team in Norfolk, Virginia, USA. To the best of our knowledge, this work represents the first application of a fine-tuned LLM consortium integrated with a reasoning LLM for clinical mental health diagnosis—paving the way for next-generation AI-powered eHealth systems aimed at standardizing psychiatric diagnoses. 1 Introduction The diagnosis of mental disorders remains one of the most complex and nuanced challenges in clinical medicine. Unlike many physical illnesses, which can be confirmed through objective tests such as blood panels, imaging, or genetic screening, psychiatric diagnoses rely heavily on subjective assessment [ 1 ] . The current diagnostic process is predominantly based on conversations between psychiatrists and patients, guided by standardized criteria outlined in manuals such as the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5) [ 2 ] . During clinical interviews, psychiatrists assess the patient’s reported symptoms, behavioral cues, emotional responses, and historical context to reach a diagnosis. However, this approach introduces significant variability and subjectivity. Diagnoses can differ between clinicians assessing the same patient, and even the same clinician may interpret similar symptoms differently across patients [ 3 ] . This variability can be attributed to differences in clinical experience, interpersonal dynamics, cultural context, and interpretation of symptom severity or duration [ 4 ] . Moreover, time constraints, communication barriers, and unconscious bias can further compromise diagnostic consistency. These challenges contribute to misdiagnosis, delayed treatment, and inconsistent care, ultimately affecting patient outcomes [ 5 ] . In recent years, advances in artificial intelligence, particularly LLMs [ 6 , 7 ] , have demonstrated exceptional capabilities in natural language understanding and reasoning. These developments open new avenues for enhancing the diagnostic process in psychiatry by introducing data-driven, scalable, and interpretable decision support systems. In this context, we propose a Fine-Tuned LLM Consortium and OpenAI-gpt-oss Reasoning LLM [ 8 , 9 , 10 , 11 ] enabled decision support system designed to assist and augment the clinical diagnosis of mental disorders. The LLMs in the system are trained/fine-tuned on curated conversational datasets that simulate or replicate psychiatrist–patient interactions related to mental health evaluations, such as those for depression, anxiety, PTSD, and schizophrenia [ 12 , 13 ] . By fine-tuning a set of LLMs on these datasets, the system learns to recognize patterns indicative of specific mental disorders. Predictions from these models are then aggregated through a consensus-based reasoning process, led by OpenAI-gpt-oss, a dedicated reasoning LLM that evaluates and refines the diagnostic output. The specialized orchestration LLM agent [ 14 , 15 , 16 ] coordinates communication between components, ensuring an end-to-end workflow that is accurate, interpretable, and aligned with DSM-5 diagnostic standards [ 17 ] . To enable deployment in resource-constrained environments, each model is fine-tuned using the Unsloth library on Google Colab GPUs [ 18 ] with Low-Rank Adaptation and 4-bit quantization (QLoRA) [ 19 ] , ensuring high performance with minimal computational overhead. The proposed approach aims not to replace clinicians but to support them with a robust, evidence-based, and transparent tool that improves diagnostic precision and consistency. The following are our main contributions of this research. 1. Fine-tuning a consortium of LLMs to analyze conversational data and predict diagnoses of mental disorders. 2. Incorporating the OpenAI-gpt-oss reasoning model to provide the final diagnosis based on the LLM consortium’s predictions. 3. Automating the end-to-end diagnostic decision-making process for mental disorders through an LLM consortium integrated with the OpenAI-gpt-oss model, orchestrated by LLM agents to ensure transparency, reliability, and adherence to Responsible AI principles. 4. Implementing the prototype of the platform, integrating three LLMs with OpenAI-gpt-oss reasoning LLM, in collaboration with the U.S. Army Medical Research Team in Norfolk, Virginia, USA. The remainder of the paper is organized as follows: Section 2 introduces the core technologies that underpin the proposed AI-assisted psychiatric diagnostic platform. Section 3 details the overall system architecture, highlighting the integration of large language models and reasoning engines. Section 4 outlines the platform’s core functionalities and operational workflow. Section 5 presents implementation details and evaluates the system’s performance across diagnostic tasks. Section 6 reviews related work and contextualizes our approach within the landscape of LLM-based medical diagnosis systems. Finally, Section 7 concludes the paper and discusses potential directions for future research and clinical deployment. 2 Background This section provides a foundational overview of the core technologies underpinning the proposed AI-assisted psychiatric diagnostic platform. In particular, we highlight advancements in Large Language Models (LLMs), reasoning-capable LLMs, fine-tuning techniques, and the emerging paradigm of AI agents. 2.1 Large Language Models (LLMs) Large Language Models (LLMs) are advanced deep neural networks trained on extensive text corpora to comprehend, generate, and reason using natural language. They form the backbone of modern Natural Language Processing (NLP) systems [ 20 ] and have demonstrated exceptional performance across a wide range of tasks, including text summarization, machine translation, dialogue generation, and question answering [ 6 ] . Several prominent LLMs such as OpenAI’s GPT [ 21 ] , Meta’s Llama [ 22 , 7 ] , Mistral [ 23 ] , and Alibaba’s Qwen2 [ 24 ] are available in both proprietary and open-source formats. Open-source LLMs offer significant advantages for healthcare applications, including transparency, customizability, and lower deployment costs. For instance, Llama-3 [ 22 , 7 ] is valued for its compact architecture and strong performance, even on resource-constrained systems. Mistral [ 25 ] features optimized attention mechanisms for faster inference, while Qwen2 [ 24 ] is designed for multilingual and on-device use, making it suitable for scalable, privacy-preserving deployments. 2.2 Reasoning LLMs While foundational LLMs excel in pattern recognition and natural language