RAG4Outcome: A Retrieval-Augmented Multimodal Framework for Prognostic Prediction in Chronic Osteomyelitis
Daqian ShiQueen Mary University of LondonLondon, UK [email protected] Pei HanShanghai Sixth People’s HospitalAffiliated to SJTU School of MedicineShanghai, CN [email protected] Jishizhan ChenUniversity College LondonLondon, UK [email protected] Yang WangShanghai Sixth People’s HospitalShanghai, CN [email protected], Xiaolei DiaoUniversity College LondonLondon, UK [email protected], Xianyou ZhengShanghai Sixth People’s HospitalAffiliated to SJTU School of MedicineShanghai, CN [email protected], Pengfei ChengShanghai Sixth People’s HospitalAffiliated to SJTU School of MedicineShanghai, CN [email protected] · 2026
Read RAG4Outcome: A Retrieval-Augmented Multimodal Framework for Prognostic Prediction in Chronic Osteomyelitis by Daqian ShiQueen Mary University of LondonLondon, UK [email protected] Pei HanShanghai Sixth People’s HospitalAffiliated to SJTU School of MedicineShanghai, CN [email protected] Jishizhan ChenUniversity College LondonLondon, UK [email protected] Yang WangShanghai Sixth People’s HospitalShanghai, CN [email protected], Xiaolei DiaoUniversity College LondonLondon, UK [email protected], Xianyou ZhengShanghai Sixth People’s HospitalAffiliated to SJTU School of MedicineShanghai, CN [email protected], Pengfei ChengShanghai Sixth People’s HospitalAffiliated to SJTU School of MedicineShanghai, CN [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22833.txt.
Introduction
Shi and six colleagues describe RAG4Outcome, a retrieval-based framework that predicts how chronic bone infection, or osteomyelitis, will progress after surgery. It pulls together PET-CT imaging reports, surgical and diagnostic records, and follow-up notes, then grounds its forecast in a specialist corpus with expert-guided prompts. Early tests on real cases showed promising accuracy and clinical sense for infection care and post-surgery choices.
Catalog record
| CREATOR | Daqian ShiQueen Mary University of LondonLondon, UK [email protected] Pei HanShanghai Sixth People’s HospitalAffiliated to SJTU School of MedicineShanghai, CN [email protected] Jishizhan ChenUniversity College LondonLondon, UK [email protected] Yang WangShanghai Sixth People’s HospitalShanghai, CN [email protected], Xiaolei DiaoUniversity College LondonLondon, UK [email protected], Xianyou ZhengShanghai Sixth People’s HospitalAffiliated to SJTU School of MedicineShanghai, CN [email protected], Pengfei ChengShanghai Sixth People’s HospitalAffiliated to SJTU School of MedicineShanghai, CN [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35409 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.22833
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
RAG4Outcome: A Retrieval-Augmented Multimodal Framework for Prognostic Prediction in Chronic Osteomyelitis Daqian ShiQueen Mary University of LondonLondon, UK [email protected] Pei HanShanghai Sixth People’s HospitalAffiliated to SJTU School of MedicineShanghai, CN [email protected] Jishizhan ChenUniversity College LondonLondon, UK [email protected] Yang WangShanghai Sixth People’s HospitalShanghai, CN [email protected], Xiaolei DiaoUniversity College LondonLondon, UK [email protected], Xianyou ZhengShanghai Sixth People’s HospitalAffiliated to SJTU School of MedicineShanghai, CN [email protected], Pengfei ChengShanghai Sixth People’s HospitalAffiliated to SJTU School of MedicineShanghai, CN [email protected] Abstract Chronic osteomyelitis presents substantial prognostic challenges due to its high recurrence risk and complex postoperative recovery trajectories. Traditional assessment often relies on manual scoring systems, which limit scalability, efficiency, and consistency in clinical practice. Furthermore, the heterogeneous nature of clinical data poses challenges for current multimodal learning approaches that require aligned inputs and large annotated datasets. In this work, we propose RAG4Outcome, a retrieval-augmented generation (RAG) framework for prognostic prediction in chronic osteomyelitis. Our method integrates multimodal clinical data, including PET-CT imaging reports, structured surgical and diagnostic records, and unstructured follow-up notes, into a unified prediction pipeline. By combining a domain-specific retrieval corpus with expert-guided prompting, the framework enables more interpretable, evidence-grounded, and clinically reliable prognosis. Preliminary results on real-world cases demonstrate promising effectiveness and clinical alignment, highlighting the potential of RAG4Outcome for AI-assisted infection management and postoperative decision support. 1 1 footnotetext: Corresponding author. 1 Introduction Chronic osteomyelitis is a highly challenging orthopedic infection characterized by high recurrence risk and complex postoperative recovery trajectories 27 ; 17 ; 18 . Accurate prognostic prediction is critical for tailoring personalized treatment strategies and ensuring long-term care 8 . However, current clinical assessment methods typically rely on expert-defined scoring systems and manual evaluation processes 5 , which are labor-intensive, time-consuming, and difficult to scale across different care settings. This limits their effectiveness for continuous monitoring and early risk stratification in real-world scenarios. In practice, clinicians must reason over a broad range of heterogeneous data types 13 ; 31 ; 30 , including medical imaging reports, structured Electronic Health Records (EHR), and unstructured reports, to assess a patient’s recovery and recurrence risk. These multimodal data sources are often incomplete, asynchronous, and loosely aligned, posing significant challenges for conventional multimodal learning models 32 ; 1 . Existing AI-based methods for postoperative prediction often rely on rigid data alignment, require large amounts of well-labeled multimodal data 1 , and tend to generalize poorly across real-world clinical environments 9 ; 12 . Moreover, critical indicators such as infection type, surgical timing, metabolic biomarkers, and symptom evolution are often embedded in unstructured clinical texts, making them difficult to extract and interpret. To address the above challenges, we propose RAG4Outcome, a retrieval-augmented multimodal framework designed for prognostic prediction in chronic osteomyelitis. Our method integrates multiple forms of clinical data into a unified prediction model, including PET-CT 11 imaging reports, structured EHRs, diagnostic and surgical reports, and follow-up documentations. A central Retrieval-Augmented Generation (RAG) module integrates external medical knowledge retrieved from a domain-specific corpus to produce evidence-grounded outcome predictions. This design enables reliable generation without requiring strict data alignment or exhaustive annotations 33 ; 1 ; 12 ; 16 . To enhance clinical interpretability, we incorporate 12 prognostic indicators identified by orthopedic experts as the most relevant to recovery outcomes in chronic osteomyelitis. These factors guide the structured prompt construction and support targeted retrieval and reasoning. We validate our approach using a real-world dataset 1 1 1 The dataset was collected under institutional ethical approval, ensuring patient privacy and data governance compliance. from anonymized chronic osteomyelitis patients treated at a tertiary care center, each with follow-up in 3–6 years. Case studies on representative patients demonstrate that RAG4Outcome achieves high consistency with clinical scoring systems, while providing transparent, evidence-supported rationales. This work provides a promising step toward the development of reliable, interpretable, and scalable AI tools for infection prognosis and surgical decision support. Rather than replacing established clinical scoring systems, our goal is to complement them with a transparent retrieval-supported framework that can synthesize heterogeneous evidence and assist clinicians in real-world postoperative assessment. Our contributions are summarized as follows: • We propose RAG4Outcome, a retrieval-augmented multimodal framework for clinical prognostic prediction in osteomyelitis, capable of integrating heterogeneous and partially missing clinical data into a unified model. • We design an interpretable prognostic framework that leverages twelve expert-defined indicators and a curated medical retrieval corpus to extract relevant clinical cues and construct structured prompts from multimodal inputs. • We conduct case-level evaluations using real-world patient data, demonstrating strong agreement with established scoring systems and the clinical utility. 2 Related Work 2.1 Prognostic Assessment in Osteomyelitis Prognostic assessment in chronic osteomyelitis has traditionally relied on structured scoring systems designed for orthopedic and infection-related outcome monitoring. One of the most widely used scales is the Lower Extremity Functional Scale (LEFS), a patient-reported outcome measure that evaluates lower-limb functionality 2 ; 7 ; 15 . The Enneking system assesses musculoskeletal tumor patients’ functional status and has been adapted for post-treatment outcome assessment 28 . The Cierny–Mader system evaluates chronic osteomyelitis cases based on anatomic type and host physiology, and is extensively used in clinical risk stratification 17 ; 6 . Different learning strategies are also introduced in the community to optimize the performance of deep learning-based methods 19 ; 20 ; 4 ; 3 . While clinically valuable, these systems require manual interpretation and exhibit subjectivity, limiting scalability and real-time application. Furthermore, studies suggest that current scoring methods fall short in supporting automated or continuous prognostic monitoring 17 , highlighting the need for AI-driven, interpretable alternatives. 2.2 Language Models and Retrieval‑Augmented Generation in Medical AI Large Language Models (LLMs) have shown promise in medical text understanding, summarization, and clinical decision support. BioGPT 14 and Med-PaLM 24 ; 25 demonstrate strong performance on biomedical QA and benchmark challenges. However, LLMs are prone to factual errors, commonly referred to as hallucinations 34 , particularly in scenarios lacking reliable contextual information. To mitigate this, a hybrid architecture, called Retrieval-Augmented Generation, is introduced that combines retrieval-based evidence with generative capabilities. In clinical settings, RAG has been shown to improve factual consistency, support the interpretation of medical guidelines, and reduce hallucination risks 33 ; 10 ; 29 ; 21 . Some of them introduce knowledge bases into the systems 23 ; 22 . Yang et al. 12 applied RAG for the interpretation of the guideline and demonstrated improvements in the factual correctness and the agreement of the clinician. Xiong et al. 33 established benchmarks for RAG in the medical domain and showed its superiority over closed-book LLMs in evidence-aware reasoning tasks. Recent applications include MedRAG for evidence-grounded diagnostic assistance 10 , and a zero-shot RAG-based framework for automatic disease phenotyping from electronic health records, demonstrated on pulmonary hypertension as a case study 26 . By explicitly linking model outputs to retrieved evidence, RAG enhances response consistency and credibility, while also allowing flexible integration of heterogeneous data sources without requiring input alignment or model retraining. 3 The Proposed Method In this section, we present the RAG4Outcome framework, a retrieval-augmented multimodal system designed to support clinical prognostic prediction in chronic osteomyelitis. As illustrated in Figure 1 , the proposed pipeline consists of two primary modules: (1) an Information Extraction Module that processes multimodal clinical data into