Weakly Supervised Patch Annotation for Improved Screening of Diabetic Retinopathy
Shramana Dey, Abhirup Banerjee, B. Uma Shankar, Ramachandran Rajalakshmi, Sushmita Mitra · 2026
Read Weakly Supervised Patch Annotation for Improved Screening of Diabetic Retinopathy by Shramana Dey, Abhirup Banerjee, B. Uma Shankar, Ramachandran Rajalakshmi, Sushmita Mitra (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-03991.txt.
Introduction
Dey and others present SAFE, a two-stage method for weakly supervised patch annotation in diabetic retinopathy screening. Early lesions are subtle and often missed for lack of annotation, while expert labeling is slow and incomplete. SAFE first learns structured discriminative embeddings from expert-labeled patches with a dual-arm network, then extrapolates labels to unannotated regions from spatial and meaning proximity.
Catalog record
| CREATOR | Shramana Dey, Abhirup Banerjee, B. Uma Shankar, Ramachandran Rajalakshmi, Sushmita Mitra |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65380 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.03991
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Weakly Supervised Patch Annotation for Improved Screening of Diabetic Retinopathy Shramana Dey, Abhirup Banerjee, B. Uma Shankar, Ramachandran Rajalakshmi, Sushmita Mitra Abstract Diabetic Retinopathy (DR) requires timely screening to prevent irreversible vision loss. However, its early detection remains a significant challenge since often the subtle pathological manifestations (lesions) get overlooked due to insufficient annotation. Existing literature primarily focuses on image-level supervision, weakly-supervised localization, and clustering-based representation learning, which fail to systematically annotate unlabeled lesion region(s) for refining the dataset. Expert-driven lesion annotation is labor-intensive and often incomplete, limiting the performance of deep learning models. We introduce S imilarity-based A nnotation via F eature-space E nsemble (SAFE), a two-stage framework that unifies weak supervision, contrastive learning, and patch-wise embedding inference, to systematically expand sparse annotations in the pathology. SAFE preserves fine-grained details of the lesion(s) under partial clinical supervision. In the first stage, a dual-arm Patch Embedding Network learns semantically structured, class-discriminative embeddings from expert annotated patches. Next, an ensemble of independent embedding spaces extrapolates labels to the unannotated regions based on spatial and semantic proximity. An abstention mechanism ensures trade-off between highly reliable annotation and noisy coverage. Experimental results demonstrate reliable separation of healthy and diseased patches, achieving upto 0.9886 accuracy. The annotation generated from SAFE substantially improves downstream tasks such as DR classification, demonstrating a substantial increase in F1-score of the diseased class and a performance gain as high as 0.545 in Area Under the Precision-Recall Curve (AUPRC). Qualitative analysis, with explainability, confirms that SAFE focuses on clinically relevant lesion patterns; and is further validated by ophthalmologists. K eywords Contrastive learning \cdot Semi-supervised learning \cdot Deep learning \cdot Incomplete annotation 1 Introduction Diabetic Retinopathy (DR) remains a leading cause of preventable vision loss [ 30 , 1 ] worldwide. It progresses gradually through the non-proliferative stages–mild, moderate, severe–culminating in proliferative DR, which is characterized by neovascularization and increased risk of vision-threatening complications [ 40 ] . Early stage manifestations of DR, such as microaneurysms and intraretinal hemorrhages, collectively referred to as red lesions [ 31 ] , are subtle and difficult to detect due to their low contrast and visual similarity to the surrounding retinal background. Bright lesions, including hard and soft exudates, are generally more distinct; the former appear as sharply defined yellow-white deposits, while the latter are more diffuse with poorly defined boundaries. Fig. 1 illustrates the lesions of the DR spectrum. As DR is often asymptomatic in its early stages, a timely and accurate diagnosis is essential to prevent irreversible retinal damage [ 23 ] . This has driven increasing interest in automated and scalable screening systems to reduce the reliance on overburdened clinical workflows [ 29 ] . Recent advances in machine learning (ML) and deep learning (DL) have led to the development of effective DR screening models [ 34 , 12 , 37 ] . Unlike ophthalmologists, who reason holistically using clinical context, the performance of the learning models is dependent on the availability of high-quality fine-grained annotations. This constrains the accuracy of decision-making by these models, to the extent and quality of labeled supervision [ 17 ] . Most DR datasets suffer from non-uniform lesion distribution, resulting in partial annotation. Since the density of lesions varies with the severity of the disease and detailed labeling is time consuming and labor intensive, many pathological regions remain unlabeled. Small lesions such as microaneurysms and dot-blot hemorrhages often go undetected, due to their subtle appearance and loss of information during associated downsampling. These limit the ability of supervised models to learn discriminative characteristics specific to the lesions. Conventional semi-supervised learning (SSL) [ 15 , 22 , 38 ] leverages unlabeled data, along with labeled data, to improve classification performance. However, its applicability remains limited in DR screening due to coarse lesion boundaries inadvertently including surrounding healthy regions to induce noisy labels. Figure 1: Representative patches from fundus images of Messidor dataset, illustrating key DR-related pathologies and healthy retinal regions. White bounding boxes highlight the lesions associated with DR. Lesion segmentation [ 22 , 27 ] relies on precise lesion annotation, which is available only for a few datasets such as IDRiD [ 28 ] and e-ophtha [ 10 ] . Obtaining precise expert-annotated lesion segmentation at higher scales remains impractical, and is limited by sample size as well as lesion density and diversity. Segmentation models inherit bias from partial lesion coverage [ 22 , 36 ] – leading to incomplete feature learning by the model. Weakly supervised DR grading approaches, including attention-based frameworks [ 39 ] , are often optimized for improving global classification accuracy. However, these paradigms operate on existing annotations, involving missing supervisory cues for enhanced performance. As a result, the gain in performance remains constrained in partial supervision. Explicit annotation expansion addresses such structural constraints to enable systematic refinement of the dataset. Recent literature has highlighted the value of lesion-level information in the grading of DR [ 4 ] . Researchers have explored diverse learning strategies to operate under weak, partial or missing supervision, in existing datasets. These collectively emphasize the value of structured representation learning under limited supervision. Although labeling of unlabeled data was found to be effective in natural images [ 14 ] , the concept has been minimally explored in the medical domain. Weak supervision was employed on textual reports to annotate microaneurysms [ 8 ] , highlighting the importance of indirect supervision to compensate for missing lesion annotation. However, it failed to generalize well across heterogeneous lesion categories. Prototypical networks [ 33 ] demonstrated label-efficient learning via prototype matching, while Deep Cluster [ 5 ] learned domain-specific latent features without direct supervision. A dynamic Prototype-aware weakly supervised segmentation framework [ 15 ] represented classes using global centroid assumption in homogeneous distributions. As DR lesions exhibit heterogeneous morphology, it necessitates a more flexible approach for feature representation that does not rely on simple prototype learning. Contrastive Learning frameworks, such as SimCLR [ 6 ] , demonstrated that representation alignment through similarity maximization yielded highly structured embedding spaces. Extending this, Supervised Contrastive Learning (SCL) [ 21 ] has been used in DR classification frameworks [ 34 , 7 , 19 ] to improve discriminative capacity in the presence of sparse and imbalanced labels. Recent literature on contrastive learning [ 17 ] explored disease diagnosis given low quality images. Enforcing intra-class compactness and inter-class separation in the embedding space, SCL facilitated robust feature learning under class imbalance to accommodate the high morphological variance of DR lesions [ 20 ] . SCL allows a model to capture nuanced similarities between diverse lesion types. Efforts to address annotation limitations include an iterative label correction pipeline [ 25 ] and expert-in-the-loop querying to detect mislabeled regions [ 3 ] . However, they risk over-cleaning or involve high human involvement. Only a limited number of studies explicitly focused on refining annotation quality as a central objective. Existing literature acknowledges challenges posed by noisy or partial supervision and addresses them within task-specific models. Though they demonstrate promising performance gain, the benefits remain confined to the associated model architecture. A principled automated dataset refinement strategy is required to enable reusable and task agnostic enhancement of data quality. We propose an automated framework – S imilarity-based A nnotation via