Guideline-grounded Retrieval-augmented Generation for Ophthalmic Clinical Decision Support
Shuying Chen, Sen Cui, Zhong Cao · 2026
Read Guideline-grounded Retrieval-augmented Generation for Ophthalmic Clinical Decision Support by Shuying Chen, Sen Cui, Zhong Cao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-21925.txt.
Introduction
Chen and co-authors build a retrieval system that answers eye care questions straight from clinical guideline pages. Each page is an evidence unit, retrieved as an image, so tables and flowcharts stay intact. Routing and filtering add outside evidence only when it helps. Queries are split, rewritten, retrieved, reranked, and reasoned over, with answers citing the exact pages used. On the hard part of HealthBench, the system beat GPT-5.2 by about thirty percent in overall score. Ablations credit the reranking and routing steps.
Catalog record
| CREATOR | Shuying Chen, Sen Cui, Zhong Cao |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44760 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.21925
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Guideline-grounded Retrieval-augmented Generation for Ophthalmic Clinical Decision Support Shuying Chen, Sen Cui, Zhong Cao Abstract In this work, we propose Oph-Guid-RAG, a multimodal visual RAG system for ophthalmology clinical question answering and decision support. We treat each guideline page as an independent evidence unit and directly retrieve page images, preserving tables, flowcharts, and layout information. We further design a controllable retrieval framework with routing and filtering, which selectively introduces external evidence and reduces noise. The system integrates query decomposition, query rewriting, retrieval, reranking, and multimodal reasoning, and provides traceable outputs with guideline page references. We evaluate our method on HealthBench using a doctor-based scoring protocol. On the hard subset, our approach improves the overall score from 0.2969 to 0.3861 (+0.0892, +30.0%) compared to GPT-5.2, and achieves higher accuracy, improving from 0.5956 to 0.6576 (+0.0620, +10.4%). Compared to GPT-5.4, our method achieves a larger accuracy gain of +0.1289 (+24.4%). These results show that our method is more effective on challenging cases that require precise, evidence-based reasoning. Ablation studies further show that reranking, routing, and retrieval design are critical for stable performance, especially under difficult settings. Overall, we show how combining vision based retrieval with controllable reasoning can improve evidence grounding and robustness in clinical AI applications, while pointing out that further work is needed to be more complete . September 17, 2026 CCS Concepts: Computing methodologies; Artificial intelligence; Information systems; Information retrieval; Applied computing; Life and medical sciences; Health informatics. Keywords: Ophthalmology, Clinical Decision Support, RAG, Multimodal Retrieval, Visual Document Retrieval, HealthBench 1 Introduction In the domain of ophthalmology, treatment decisions are highly based on clinical practice guidelines, which define treatment pathways, drug usage, follow-ups and referral conditions. The criticality in clinical practice could result in severe or even fatal consequences due to mistakes made during execution; consequently clinical decision making should rely on accurate, reproducible and auditable data for the sake of science and patients alike. According to recent review results, ophthalmology is rapidly entering an era where both basic model and clinical verification are required. But privacy, bias and the quality of the generated clinical evidence are important issues [ 1 ] . In this regard, there is an intense desire for decision-support that can be based on LLM/LMM; however, relying only on parametric knowledge brings in two significant dangers: firstly, outdated and missing knowledge causes unstable reactions toward the most recent evidenced based recommendation; second, it can hallucinate thresholds, grading, contraindications, or workflow for rare and/or complex cases.The real-world clinical validation of an ophthalmological use case shows how a structured agent decouples the vision processing, knowledge search, and diagnostics reasoning can help improve treatment plans, and avoid general purpose model fragility on rare diseases [ 2 ] . RAG is popularly used to address those problems: it retrieves outside information and uses the retrieved evidence context at generation time, the system enhances traceability and fact-consistency. Systematic review and meta-analysis show that RAG yields statistically significant gains over baselines on biomedical tasks, with actionable advice on how to deploy in the clinic [ 3 ] . However, vanilla RAG assumes that we have good text extraction, chunking and vectorization.In reality, clinical guidelines that are filled with rich tables, flowcharts, complex layouts, embedded images, etc., which makes the process of text extraction and OCR pipeline brittle and expensive. Furthermore, even if the relevant evidence is retrieved, models might not use them properly because of incomplete contexts aggregation, leading to incomplete grounding or remaining hallucination [ 4 ] . Visual document retrieval thus calls fora paradigm of directly embedding the page image for retrieval, avoiding complicated text extraction and taking full advantage of layout and graphical information, providing a new direction to retrievals based on guidelines. We thus turn to the clinically focused problem of how to incorporate guideline evidence as visual pages in RAG for ophthalmic clinical QA and decision support, and how to design an agentic router that can make a controllable decision on when to use external retrieval versus direct generation, while ensuring traceability, robustness, and faithfulness, and reducing hallucinations.This paper makes four key contributions. First, we propose a page-level visual RAG method for ophthalmology guidelines. Each guideline page is used as an independent evidence unit. We directly retrieve page images instead of text, which avoids OCR errors and keeps important structures such as tables and flowcharts. Second, we design the retriever as an controllable retrieval system that has route and filter functions. It routes whether to retrieve or not, and filters out less relevant evidences. Thus it can balance factuality and fluency of responses. Third, we build an end-to-end multimodal pipeline. It includes query decomposition, query rewriting, retrieval, reranking, and answer generation.The system also returns guideline page URLs, so the outputs are traceable. Fourth, we evaluate our system on HealthBench with a doctor-based scoring protocol. The results show that our method improves performance on hard cases, especially in accuracy, and that controlled retrieval is important for stable and reliable output 2 Related Work We categorize previous research into three categories: (i) foundation models and intelligent agents centered on ophthalmology, (ii) guideline-based retrieval-augmented generation (RAG) for clinical decision support across various specialties, and (iii) retrieval and evaluation methodologies for biomedical RAG systems. 2.1 Ophthalmology foundation models and intelligent agents Multimodal Foundation Models and Domain-Specific Agents Recent work in computer vision for eye diseases have been focusing on multimodal foundation models and the domain-specific agents.Zhuang et al. (Zhuang, 2025) proposes a moduler reasoner to integrate visual analysis, retrieval and diagnosis using concrete improvements in the practical use cases for ophthalmic treatment [ 2 ] . Sevgi, F. A.(2024), Personalized Instruction-Tailored and RetrievalAugmented GPT Models for Eye Education and Clinical Assistance, for the purposes of privacy, accountability, and other operational concerns [ 5 ] . An extensive road map of vision-language foundation models for ophthalmology is provided in Chia(2024), observing continued problems with data bias, regulation and appropriate clinical validation. Apart from these changes, making everything simple and understandable is another major focus now [ 1 ] .Han Wang (2025) combines knowledge graphs and contrastive learning together with organised “ clinical profile ” metrics to explain how ophthalmic AI works. Training & Simulation [ 6 ] . Luo(2025) proposes a retrieval augmented digital patient for improving taking an ophthalmic history showing that RAG-based approaches are worth learning [ 7 ] . Grzybowski(2024) discusses AI algorithm to analyse the fundus images of ocular and systemic disease [ 8 ] while Ong A.Y.(2025) analyses regulator-sanctioned ocular image-analysis AI aMD’s shortcoming on reporting norms and empirical data [ 9 ] . Also, there is continuous development of disease specific DSS such as the staging algorithm for keratogenous developed by Muhsin et al.(2024) [ 10 ] . 2.2 Guideline-grounded RAG for clinical decision support Our concern is not just that the model could give us an answer, but that it gives an answer consistent with what clinicians would say. In this regard, Kresevic (2024) shows how systematic guideline reformulation together with RAG and agile prototyping improve precise guidance understanding, suggesting that both evidence format as well as search strategy matter for trustworthiness [ 11 ] . Ong C.S.(2024). Proposes Surgery LLM that attempts to unify workflow and share the same goal [ 12 ]