CURE: Curriculum-guided Multi-task Training for Reliable Anatomy Grounded Report Generation

Pablo Messina, Andrés Villa, Juan León Alcázar, Karen Sánchez, Carlos Hinojosa, Denis Parra, Alvaro Soto, Bernard Ghanem · 2026

Read CURE: Curriculum-guided Multi-task Training for Reliable Anatomy Grounded Report Generation by Pablo Messina, Andrés Villa, Juan León Alcázar, Karen Sánchez, Carlos Hinojosa, Denis Parra, Alvaro Soto, Bernard Ghanem (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-15408.txt.

Introduction

Pablo Messina, Andrés Villa, and co-authors teach medical models to point at what they describe. Their 2026 arXiv paper deals with radiology report generation by vision-language models. Such models can draft reports, but their grounding is weak: words often fail to match the image.

That mismatch makes reports unreliable. The authors present CURE, an error-aware curriculum learning framework. It improves grounding and report quality with no extra data. The model learns from its own errors in a planned order. Reports thus tie each finding more tightly to the visual evidence in the scan.

Catalog record

CREATORPablo Messina, Andrés Villa, Juan León Alcázar, Karen Sánchez, Carlos Hinojosa, Denis Parra, Alvaro Soto, Bernard Ghanem
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE123 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-15408

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CURE: Curriculum-guided Multi-task Training for Reliable Anatomy Grounded Report Generation Pablo Messina, Andrés Villa, Juan León Alcázar, Karen Sánchez, Carlos Hinojosa, Denis Parra, Alvaro Soto, Bernard Ghanem Abstract Medical vision–language models can automate the generation of radiology reports but struggle with accurate visual grounding and factual consistency. Existing models often misalign textual findings with visual evidence, leading to unreliable or weakly grounded predictions. We present “CURE”, an error-aware curriculum learning framework that improves grounding and report quality without any additional data. CURE tunes a multimodal instructional model on phrase grounding, grounded report generation, and anatomy-grounded report generation using public datasets. The method dynamically adjusts sampling based on model performance emphasizing harder samples to improve spatial and textual alignment. CURE improves grounding accuracy by +0.37 IoU, boosts report quality by +0.188 CXRFEScore, and reduces hallucinations by 18.6%. CURE is a data-efficient framework that enhances both grounding accuracy and report reliability. Code is available at https://github.com/PabloMessina/CURE and model weights at https://huggingface.co/pamessina/medgemma-4b-it-cure . 1 Introduction Figure 1 : False Positive Detection of Pathologies. Given the same chest X-ray input both models approximate the location of the left clavicle. However, the baseline model (MAIRA-2) hallucinates a fracture (there is no fracture in the image), whereas our proposed model (CURE) generates a clinically correct and visually grounded description. In the medical domain, Vision-language Models (VLMs) enable the automatic generation of diagnostic reports from imaging exams, thereby reducing the workload of specialists and promoting standardized diagnostic pipelines Bannur et al. 2024b ; Li et al. 2023b ; Sellergren et al. 2025a . Despite their remarkable success in bridging visual and textual modalities Radford et al. 2021 ; Tschannen et al. 2025 ; Liu et al. 2024 ; Bai et al. 2025 ; Cocchi et al. 2025 , VLMs still face fundamental challenges when applied to specialized domains such as medicine. The factuality and reliability of VLMs remain a significant concern, as current architectures often generate outputs that are inconsistent with their visual input, a phenomenon known as hallucinations Tong et al. 2024 ; Villa et al. 2025b ; Li et al. 2023c . Medical VLMs Sellergren et al. 2025a ; Zambrano Chaves et al. 2025 ; Li et al. 2023b rely on large-scale, domain-specific datasets to adapt general-purpose multi-modal models for medical applications. While this standard fine-tuning strategy improves performance on medical benchmarks, the resulting models often lack visual grounding, thus limiting interpretability and increasing the risk of hallucinations Villa et al. 2025a . For clinical adoption, it is crucial that VLMs produce factually accurate outputs and correctly ground medical findings in the relevant image regions. Strengthening factuality and grounding is therefore essential to ensure transparency, trustworthiness, and the reliable deployment of medical VLMs in real-world workflows. To address these drawbacks, state-of-the-art models such as MAIRA-2 Bannur et al. 2024b explicitly incorporate grounded report generation to better align local visual evidence with the textual findings. For example, MAIRA-2 is trained on a diverse set of localization-based tasks, including phrase grounding and grounded report generation. However, as shown in Figure 1 , current models often exhibit a bias in which the target visual regions become overly associated with abnormal findings, leading to false positives in medical reports. To address these limitations, we propose CURE ( CU rriculum-guided Multi-task Training for RE liable Anatomy Grounded Report Generation), a curriculum-based learning framework that enhances the reliability and visual grounding of medical VLMs without requiring additional data. CURE improves the standard training pipeline, and obtains improved results using only a subset of publicly available chest X-ray datasets. In particular, CURE replaces the conventional finding-generation objective used in state-of-the-art methods with an anatomy-grounded report generation (AGRG) task, thus leveraging the most detailed regional annotations provided by some datasets. Our contributions are threefold: i) We introduce CURE, a novel error-aware curriculum framework that dynamically adjusts sampling distributions based on model performance, enhancing visual grounding without requiring any additional training data. ii) Our training strategy enables the effective transfer of grounding capabilities to medical VLMs that originally lack visual grounding mechanisms. These models surpass the current state of the art in visual grounding, despite being trained on less training data. iii) On the Chest ImaGenome dataset, CURE achieves an 18.6% reduction in hallucinations across six key anatomical regions, substantially improving the reliability and trustworthiness of medical VLM outputs and setting a new state-of-the-art in visually grounded report generation. 2 Related Work Medical Vision-language Models. The adoption of Vision-language models (VLMs) in the medical domain has advanced rapidly in recent years Singhal et al. 2023 ; Nath et al. 2025 ; Jeong et al. 2024 ; Kalpélbé et al. 2025 . Early approaches primarily targeted clinical report generation and captioning tasks, while more recent models such as Med-PaLM Singhal et al. 2023 ; Singhal et al. 2025 , MAIRA-2 Bannur et al. 2024a , and the recently released MedGemma Sellergren et al. 2025b exhibit strong multi-modal reasoning capabilities across diverse medical modalities. Despite their success, the challenge of efficiently fine-tuning these large models on heterogeneous and task-specific medical datasets remains largely unsolved. Our work builds upon this line of research by introducing a structured, error-aware training curriculum that enhances performance without requiring additional data or model parameters. Multi-Task Learning in Medical Imaging. Multi-task learning (MTL) is a widely adopted paradigm for jointly training models on related objectives such as classification, segmentation, and report generation Caruana 1993 ; Zhang and Yang 2021 ; Liu et al. 2023 . In medical imaging, MTL has been successfully applied across modalities, improving both efficiency and generalization Kim et al. 2023 ; Boutillon et al. 2021 ; Sainz de Cea et al. 2020 ; Chen et al. 2018 ; Weninger et al. 2019 ; Wimmer et al. 2021 ; Mohamed et al. 2025 . For instance, Sainz et al . Sainz de Cea et al. 2020 leveraged MTL for breast cancer screening by jointly learning classification and detection of abnormal findings in mammography; Chen et al . Chen et al. 2018 improved atrial segmentation and classification using MRI; and Weninger et al . Weninger et al. 2019 enhanced brain tumor segmentation by coupling detection and image reconstruction tasks in brain MRI. Despite these advances, MTL performance strongly depends on how task contributions are balanced during training Kendall et al. 2018 . Improper weighting can cause task dominance and negative transfer Sener and Koltun 2018 ; Yu et al. 2020 ; Mohamed et al. 2025 , degrading overall performance. To address this limitation, we propose an adaptive curriculum that dynamically schedules data exposure based on model performance, allowing the network to automatically prioritize under-performing tasks rather than relying on manually tuned loss weights. Curriculum Learning. Curriculum learning (CL) Bengio et al. 2009 ; Wang et al. 2021 trains models by gradually increasing task difficulty, starting from easier samples and progressing to harder ones, in analogy to human learning. CL has been successfully applied to medical imaging Shibu et al. 2025 ; Li et al. 2023a . For instance, Shibu et al . Shibu et al. 2025 introduced a MedSAM-guided CL strategy for white matter tract segmentation, where the curriculum is defined by anatomical block complexity to progressively refine spatial representations. Similarly, Li et al . Li et al. 2023a introduced

Read the complete text