GlaBoost: A multimodal Structured Framework for Glaucoma Risk Stratification

Cheng Huang 1,2 , Weizheng Xie 1 , Karanjit Kooner 2 , Tsengdar Lee 3 , Jui-Kai Wang 2 , Jia Zhang 1, † {\dagger} · 2025

Read GlaBoost: A multimodal Structured Framework for Glaucoma Risk Stratification by Cheng Huang 1,2 , Weizheng Xie 1 , Karanjit Kooner 2 , Tsengdar Lee 3 , Jui-Kai Wang 2 , Jia Zhang 1, † {\dagger} (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-03750.txt.

Introduction

Cheng Huang and colleagues built a system that sorts glaucoma risk by combining several kinds of patient data at once. Glaucoma damages the optic nerve and can blind if caught late, yet many tools use only one data type and cannot explain their answers. Writing in twenty twenty-five, the team fuses standard clinical measures, features drawn from retinal photos by a pretrained image network. Written expert notes on the nerve rim converted by a language model. A boosted tree model then makes the final risk call from the combined features.

On two real annotated data sets, the combined system beat simpler baseline models by a wide margin in their validation tests. The features that mattered most, such as the cup-to-disc ratio and rim color, match what eye doctors already watch, which helps trust. The authors offer the design as a transparent template extendable to other eye diseases.

Catalog record

CREATORCheng Huang 1,2 , Weizheng Xie 1 , Karanjit Kooner 2 , Tsengdar Lee 3 , Jui-Kai Wang 2 , Jia Zhang 1, † {\dagger}
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-03750

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

GlaBoost: A multimodal Structured Framework for Glaucoma Risk Stratification Cheng Huang 1,2 , Weizheng Xie 1 , Karanjit Kooner 2 , Tsengdar Lee 3 , Jui-Kai Wang 2 , Jia Zhang 1, † {\dagger} Abstract Early and accurate detection of glaucoma is critical to prevent irreversible vision loss. However, existing methods often rely on unimodal data and lack interpretability, limiting their clinical utility. In this paper, we present GlaBoost, a multimodal gradient boosting framework that integrates structured clinical features, fundus image embeddings, and expert-curated textual descriptions for glaucoma risk prediction. GlaBoost extracts high-level visual representations from retinal fundus photographs using a pretrained convolutional encoder and encodes free-text neuroretinal rim assessments using a transformer-based language model. These heterogeneous signals, combined with manually assessed risk scores and quantitative ophthalmic indicators, are fused into a unified feature space for classification via an enhanced XGBoost model. Experiments conducted on two real-world annotated dataset demonstrate that GlaBoost significantly outperforms baseline models, achieving a validation accuracy of 98.71%. Feature importance analysis reveals clinically consistent patterns, with cup-to-disc ratio, rim pallor, and specific textual embeddings contributing most to model decisions. GlaBoost offers a transparent and scalable solution for interpretable glaucoma diagnosis and can be extended to other ophthalmic disorders. I Introduction Glaucoma is a progressive optic neuropathy and one of the leading causes of irreversible blindness worldwide [ 26 , 27 , 24 ] . Early and accurate diagnosis is critical but remains challenging due to the disease’s complex presentation and reliance on heterogeneous diagnostic information, including fundus images [ 28 ] , anatomical measurements [ 22 ] , and expert clinical descriptions [ 21 ] . While recent AI-based approaches, especially convolutional neural networks (CNNs) [ 26 , 27 , 25 , 45 , 33 , 46 , 35 ] , have achieved strong performance in image-based glaucoma detection [ 45 , 33 , 22 , 40 ] , they often fail to incorporate structured clinical indicators and textual annotations that ophthalmologists rely on [ 29 , 21 ] . This omission limits both diagnostic accuracy and interpretability [ 23 , 4 ] . To bridge this gap, we propose GlaBoost , a multimodal learning framework that combines fundus image embeddings, structured features, and expert-generated textual descriptions using XGBoost [ 4 ] . By integrating sentence embeddings of ophthalmologist narratives, GlaBoost leverages semantic context in addition to traditional visual and numeric features. All in all, our main contributions are summarized as follows: • We propose GlaBoost , a novel multimodal framework that fuses fundus image embeddings, structured anatomical indicators, and expert-provided textual descriptions using XGBoost for glaucoma risk prediction. • We introduce a pipeline for extracting and embedding free-text clinical observations and demonstrate their value in improving diagnostic performance. • We perform extensive experiments and feature attribution analysis to show that integrating textual semantics and structured features with visual cues not only improves predictive performance but also yields interpretable insights into glaucoma diagnosis. TABLE I : Interdisciplinary Developments at the Intersection of AI and Glaucoma Diagnosis Dataset Data Modality Task Number LAG [ 26 ] Image CV 5824 Images OCTA-500 [ 28 ] Image CV 500 Subjects Harvard-GDP [ 35 ] Image CV 21059 Samples Harvard-GF [ 36 ] Image CV 3300 Samples FairSeg [ 45 ] Image CV 10000 Images FairDomain [ 46 ] Image CV 10000 Subjects Drishti-GS [ 43 ] Image CV 101 Images ORIGA [ 50 ] Image CV 650 Images RIM-ONE [ 13 ] Image CV 169 Images DRIVE [ 44 ] Image CV 40 Images SCES [ 10 ] Image CV 3353 Adults STARE [ 19 ] Image CV 20 Images MURED [ 39 ] Image CV 2208 Images ROSE [ 37 ] Image CV 229 Images GSS-RetVein [ 22 ] Image CV 550 Images FairCLIP [ 34 ] Image+Corpus CV+NLP 10000 Samples FairVision [ 33 ] Image+Corpus CV+NLP 30000 Subjects II Related Work II-A AI for Glaucoma As shown in TABLE I , we present a comprehensive summary of popular AI algorithms and their associated glaucoma datasets. Existing works predominantly employ CNNs [ 25 , 26 , 27 ] and their derivatives, such as U-Net [ 40 ] , for tasks including glaucoma-related pathology detection [ 34 , 33 , 22 ] , segmentation [ 45 ] , and 3D reconstruction [ 28 ] . These efforts are predominantly focused on computer vision (CV) tasks. The recent rise of large language models (LLMs) [ 1 , 2 , 15 , 30 ] and vision-language models (VLMs) [ 29 , 21 ] has spurred growing interest in incorporating natural language processing (NLP) corpora into medical AI research. Although existing AI models perform well in tasks like segmentation or detection, they are fundamentally constrained by their reliance on visual patterns, such as pixel intensity distributions [ 37 , 43 ] . This contrasts with clinical diagnosis, which depends on interpretable biological markers like intraocular pressure (IOP) [ 24 ] , highlighting a critical gap between computational models and human decision-making [ 4 , 3 ] . II-B Clinical Decision Making In clinical settings, ophthalmologists often integrate multiple modalities, including fundus photographs, patient history, and nuanced textual assessments of optic nerve morphology [ 6 , 24 , 46 ] . These descriptions capture subtle semantic patterns that may not be detectable through pixel-level analysis alone [ 29 ] . Traditional AI systems rarely leverage such free-text narratives, creating a gap between automated systems and human expert reasoning [ 25 , 26 , 33 ] . Recent efforts in explainable AI (XAI) have sought to improve interpretability by analyzing feature importance or using attention mechanisms [ 49 , 9 ] , but they typically still rely on unimodal input [ 11 , 8 ] . Bridging this gap requires multimodal frameworks that not only fuse visual and structured data but also embed domain-specific text in a clinically meaningful way [ 31 ] . Motivated by these limitations, we propose GlaBoost, a multimodal XGBoost-based framework that integrates fundus image embeddings, structured clinical features, and expert textual descriptions to enhance the interpretability and accuracy of glaucoma risk prediction. III Methodology: GlaBoost Data Input : let \mathcal{D}=\{(\mathbf{x}_{i},y_{i})\}_{i=1}^{N} denote the dataset, where each instance consists of multimodal features \mathbf{x}_{i} and a binary label y_{i}\in\{0,1\} indicating the presence of glaucoma. We decompose the input feature vector \mathbf{x}_{i} as: \mathbf{x}_{i}=\left[\mathbf{x}_{i}^{\text{text}};\mathbf{x}_{i}^{\text{struct}};\mathbf{x}_{i}^{\text{human}};\mathbf{x}_{i}^{\text{img}}\right] (1) where \mathbf{x}_{i}^{\text{text}}\in\mathbb{R}^{d_{t}} is the textual embedding, \mathbf{x}_{i}^{\text{struct}}\in\mathbb{R}^{d_{s}} represents structured clinical features, and \mathbf{x}_{i}^{\text{img}}\in\mathbb{R}^{d_{v}} are visual features extracted from fundus images. \mathbf{x}_{i}^{\text{human}} is the data based on human subjective judgment, not a label, and in certain datasets, it is not required and is considered optional. Fig. 1 : The Architecture of GlaBoost Based on this input of data, as shown in Fig. 1 GlaBoost have 4 stages: (1) Structured Feature Extraction ; (2) Image Feature Extraction ; (3) Textual Feature Extraction and (4) Multimodal Fusion and Classification . III-A Structured Feature Extraction Each instance contains a clinical report field description where we extract two or one types of structured features: III-A 1 Machine-Readable Fundus Biomarker Within each report, the fundus_features subfield contains object-structured annotations of retinal morphology. We extract the following features, based on established ophthalmological indicators, such as “optic_disc_size (small, normal, large)” and “cup_to_disc_ratio \in[0,1] ”. Categorical variables

Read the complete text