A Human-Centric Pipeline for Aligning Large Language Models with Chinese Medical Ethics
Haoan Jin, Han Ying, Jiacheng Ji, Hanhui Xu, Mengyue Wu · 2026
Read A Human-Centric Pipeline for Aligning Large Language Models with Chinese Medical Ethics by Haoan Jin, Han Ying, Jiacheng Ji, Hanhui Xu, Mengyue Wu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-07954.txt.
Introduction
Haoan Jin and colleagues align language models with Chinese medical ethics using human-centered methods. Language models now serve many healthcare tasks. Aligning them with medical ethics, especially in complex real cases, remains underexplored. Their 2026 preprint presents MedES, a dynamic, scenario-centric benchmark. It is built from 260 authoritative Chinese medical, ethical, and legal sources. The scenarios reflect challenges in clinical decision-making.
Ethics in medicine involves consent, confidentiality, and duties that vary by situation. A benchmark drawn from real authoritative sources tests those nuances better than generic questions. Chinese sources matter because norms and law differ across countries. Human-centric construction keeps clinicians and ethicists in the loop. The paper serves medical AI scholars and health policy readers. It argues alignment must be tested where care actually happens.
Catalog record
| CREATOR | Haoan Jin, Han Ying, Jiacheng Ji, Hanhui Xu, Mengyue Wu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-07954
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Human-Centric Pipeline for Aligning Large Language Models with Chinese Medical Ethics Haoan Jin, Han Ying, Jiacheng Ji, Hanhui Xu, Mengyue Wu Abstract Recent advances in large language models (LLMs) have enabled their application to a range of healthcare tasks. However, aligning LLMs with the nuanced demands of medical ethics, especially under complex real-world scenarios, remains underexplored. In this work, we present MedES , a dynamic, scenario-centric benchmark specifically constructed from 260 authoritative Chinese medical, ethical, and legal sources to reflect the challenges in clinical decision-making. To facilitate model alignment, we introduce a guardian-in-the-loop framework that leverages a dedicated automated evaluator—trained on expert-labeled data and achieving over 97% accuracy within our domain—to generate targeted prompts and provide structured ethical feedback. Using this pipeline, we align a 7B-parameter LLM through supervised fine-tuning and domain-specific preference optimization. Experimental results, conducted entirely within the Chinese medical ethics context, demonstrate that our aligned model outperforms notably larger baselines on core ethical tasks, with observed improvements in both quality and composite evaluation metrics. Our work offers a practical and adaptable framework for aligning LLMs with medical ethics in the Chinese healthcare domain, and suggests that similar alignment pipelines may be instantiated in other legal and cultural environments through modular replacement of the underlying normative corpus. Code — https://github.com/X-LANCE/MedEthicAlign Datasets — https://github.com/X-LANCE/MedEthicAlign Introduction Large language models (LLMs) are increasingly being deployed in the medical domain, offering capabilities such as diagnostic support ( Wu et al. 2023 ) , health advice generation ( Li et al. 2023 ) , and decision-making assistance ( Gaber et al. 2025 ) . However, when applied to high-stakes scenarios involving health, these models often suffer from ethical unreliability—generating recommendations that violate legal regulations, professional standards, or cultural norms. Unlike general-purpose misalignment, ethical failures in medicine can lead to real-world harm, legal liability, and erosion of public trust ( Hagendorff 2022 ; Ong et al. 2024 ) . Ensuring robust ethical alignment in medical LLMs is thus a critical yet underexplored challenge. To align LLMs with medical ethical values and increase safety levels, several prerequisites are essential. First, a rigorous dataset for fine-tuning is needed to ensure that the models adhere to ethical standards. Second, a human-in-the-loop pipeline should be implemented to provide ongoing oversight and correction of model outputs by human experts. Lastly, an automatic ethics evaluator is crucial for systematically assessing and flagging potential ethical issues, thereby ensuring that LLMs maintain compliance with medical ethical guidelines. Recent efforts have attempted to evaluate and improve ethical capabilities in LLMs through benchmark datasets and fine-tuning strategies. For example, MedSafetyBench ( Han et al. 2024 ) leverages general principles from the AMA Code of Ethics to assess AI behavior in the U.S. healthcare context. However, its coverage remains abstract, lacking grounding in complex, scenario-specific ethical dilemmas that often arise in real-world medical practice. Similarly, MedEthicEval ( Jin et al. 2025 ) introduced a Chinese-language benchmark for detecting ethical violations in medical scenarios, offering an initial step toward formalizing ethical evaluation. However, existing benchmarks are not alignment-oriented and remain limited in several aspects: 1) they operate as static evaluations with fixed ethical criteria, which do not evolve with changing medical norms and societal values; 2) they are disconnected from the model development loop, offering limited utility for iterative optimization; 3) they lack diagnostic granularity across the diverse dimensions of medical ethics. As a result, such benchmarks fall short in meeting the pressing need to effectively align LLMs with medical ethics. To address these challenges, we introduce MedES , a scenario-centric evaluation suite that reflects realistic and high-stakes ethical challenges, and we propose an guardian-in-the-loop alignment framework that integrates benchmark feedback into a closed-loop pipeline for iterative improvement. This unified approach enables both fine-grained evaluation and targeted model alignment, bridging the gap between ethical assessment and practical deployment. Figure 1: An overview of our proposed framework. In this paper, we introduce MedES , a structured and extensible benchmark designed to evaluate and align LLMs with medical ethics and safety. MedES encompasses 12 real-world high-risk clinical scenarios , spanning ethics and safety dimensions. These scenarios are grounded in a curated and continuously updated rule base, built from 260 authoritative documents —including legal regulations, clinical standards, and ethical guidelines—yielding 1278 atomic rules . To augment the safety evaluation, we incorporate medical QA datasets such as MedQA ( Jin et al. 2021 ) and NLPEC ( Li et al. 2020 ) , guided by expert-curated sources like the Emergency Triage Guidelines ( Group 2008 ) and the Drug Label and Instruction Guide ( Wolf et al. 2011 ) , which are among the most authoritative references in clinical assessment. In addition to the benchmark, we develop a guardian-in-the-loop pipeline that uses the benchmark not only for evaluation but also as a mechanism for iterative model refinement . By detecting weaknesses across scenarios and feeding them back into the synthetic data generator, we support progressive alignment of the model’s ethical reasoning. This closed-loop optimization resembles reinforcement learning (RL) ( Kaelbling, Littman, and Moore 1996 ) , while leveraging multi-dimensional, structured evaluator feedback specific to medical ethics and safety. To validate the effectiveness of our pipeline, we conduct extensive experiments using both open-source and commercial foundation models under a supervised fine-tuning (SFT) ( Ouyang et al. 2022 ) setting. Our results demonstrate that SFT, when guided by a structured evaluator-in-the-loop process, can significantly improve ethical reliability—particularly in high-risk or ambiguous clinical scenarios—by instilling domain-specific knowledge and ethical reasoning capabilities. An overview of our framework is shown in Figure 1 . Our main contributions are: • MedES Benchmark: A scenario-centric benchmark built from real-world sources, targeting both ethical and safety risks in clinical practice. • Guardian-in-the-Loop Framework: An iterative alignment pipeline that incorporates accurate, structured evaluator feedback for model optimization. • Empirical Gains: Our aligned 7B model outperforms a 671B commercial LLM, improving composite scores by over 10% on high-risk ethical tasks. Alignment-Oriented MedES Benchmark Motivated by the limitations of existing benchmarks like MedEthicEval ( Jin et al. 2025 ) , which has less realistic queries and a non-monotonic scoring scheme unsuitable for model alignment and fine-grained ethical evaluation, we introduce MedES . This new benchmark focuses on E thics and S afety to better reflect real-world user inputs and provide a more effective training signal for LLM alignment. Ethical Dataset Construction To better reflect the ethical challenges encountered in real-world medical deployments, we curated 12 high-risk scenarios (e.g., organ transplantation, assisted reproduction technology) based on prevalence in legal cases, public controversies, and clinical guidelines through close collaboration with medical ethics researchers. For each scenario, we collected and analyzed 260 authoritative documents , including national laws, industry standards, and ethical guidelines, from which we extracted over 1278 normative rules . These rules serve as the foundational knowledge base for evaluating and guiding model behavior. These documents form a scenario-norm knowledge base that is continually updated as new policies and ethical discourse emerge. Based on this dynamic knowledge base, we use an instruction-tuned LLM ( QWQ ) to generate two question-answer categories: 1) Reasong Ethics QA , subjective, to evaluate ethical reasoning under ambiguous or controversial circumstances; 2) Knowledge Ethics QA , objective, for factual understanding of codified legal, regulatory, or professional