Med-Banana-50K: A Cross-modality Large-Scale Dataset for Text-guided Medical Image Editing
Anonymous Authors · 2025
Read Med-Banana-50K: A Cross-modality Large-Scale Dataset for Text-guided Medical Image Editing by Anonymous Authors (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-00801.txt.
Introduction
Zhihui Chen and colleagues present Med-Banana, a framework for editing medical images from text instructions. Good edits must add the requested feature while keeping anatomy, image style, and clinical sense intact. Earlier data sets kept only edits that succeeded, and threw the failures away.
Med-Banana instead learns from both. Its resource, Med-Banana-80K, stores success and failure editing paths with candidate images, checks, rejection reasons, and revised prompts. Three parts are trained together: an editor, a verifier, and a refiner, so new edits can be checked and fixed in a loop. Tests with model judges, blinded experts, and other probes show steady gains over open medical image editors.
Catalog record
| CREATOR | Anonymous Authors |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-00801
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Med-Banana-50K: A Cross-modality Large-Scale Dataset for Text-guided Medical Image Editing Anonymous Authors Abstract Medical image editing has emerged as a pivotal technology with broad applications in data augmentation, model interpretability, medical education, and treatment simulation. However, the lack of large-scale, high-quality, and openly accessible datasets tailored for medical contexts with strict anatomical and clinical constraints has significantly hindered progress in this domain. To bridge this gap, we introduce Med-Banana-50K , a comprehensive dataset of over 50k medically curated image edits spanning chest X-ray, brain MRI, and fundus photography across 23 diseases. Each sample supports bidirectional lesion editing (addition and removal) and is constructed using Gemini-2.5-Flash-Image based on real clinical images. A key differentiator of our dataset is the medically grounded quality control protocol: we employ an LLM-as-Judge evaluation framework with criteria such as instruction compliance, structural plausibility, image realism, and fidelity preservation, alongside iterative refinement over up to five rounds. Additionally, Med-Banana-50K includes around 37,000 failed editing attempts with full evaluation logs to support preference learning and alignment research. By offering a large-scale, medically rigorous, and fully documented resource, Med-Banana-50K establishes a critical foundation for developing and evaluating reliable medical image editing systems. Our dataset and code are publicly available. [https://github.com/richardChenzhihui/med-banana-50k] . 1 Introduction Medical image editing represents a critical frontier in computational medicine, with transformative potential for data augmentation, model interpretability, medical education, and treatment simulation. By enabling precise lesion manipulation—such as addition or removal—it can generate tailored cases for rare diseases, thereby addressing the long-tail problem in medical imaging. Furthermore, it facilitates the creation of counterfactual samples to probe AI decision-making (e.g., “Would the AI still make the same diagnosis without this lesion?”), enhances training through synthetically generated clinical scenarios, and allows visualization of potential treatment outcomes. Despite these promising applications, progress in open medical image editing remains hindered by the absence of large-scale, high-quality, and freely shareable datasets. While general-domain editing models—including those based on multimodal LLMs like GPT-1-Image 6 and Gemini-2.5-Flash-Image 2 , as well as diffusion methods 1 ; 16 —have achieved remarkable success in natural image editing, they often struggle with domain shift when applied to medical data. Medical images impose unique constraints: edits must preserve anatomical consistency, modality-specific texture and noise patterns, and disease-relevant minimality, all while navigating complex privacy and licensing landscapes. To address these challenges, we introduce Med-Banana-50K, a large-scale dataset of approximately 50,000 high-quality medical image edits across three modalities (chest X-ray, brain MRI, and fundus photography) and 23 diseases. Each sample supports bidirectional lesion editing and has been refined through up to five rounds of iterative optimization using a medically adapted LLM-as-Judge evaluation framework to ensure anatomical and visual fidelity. The dataset also includes 37,000 failure cases to support preference learning and model alignment. By providing a diverse, fully shareable resource with clear licensing, Med-Banana-50K aims to catalyze advances in reliable and clinically applicable medical image generation. Figure 1 illustrates our systematic approach to dataset construction. We leverage Gemini-2.5-Flash-Image to generate bidirectional edits (lesion addition and removal), employ Gemini-2.5-Pro as an automated judge for quality assurance through multi-dimensional medical scoring (instruction compliance, structural plausibility, realism, and fidelity preservation), and implement history-aware iterative refinement up to five rounds. Failed editing attempts are automatically retried and preserved as negative examples for preference learning, while successful edits form our core training data. Our contributions are summarized as follows: 1. Large-scale shareable dataset: We release Med-Banana-50K, containing 50,635 high-quality medical image editing examples built from real clinical images, systematically organized by disease type and modality, with rigorous quality control through automated LLM-as-Judge scoring and multi-round refinement. 2. Multi-objective training support: Beyond the 50K successful single-turn examples, we provide 37K failed attempts with full evaluation logs for preference learning and alignment methods like DPO 12 and reward modeling, enabling research on robustness and iterative refinement. 3. Medical domain adaptation: We introduce a medically grounded quality rubric emphasizing fidelity preservation (noise/grain/artifacts), structural plausibility (anatomical correctness), and counterfactual minimal change, addressing unique constraints not covered by general-domain editing datasets. Figure 1: Pipeline: instruction generation, single-step editing, LLM-as-Judge evaluation, and history-aware refinement under fidelity, negative rules, and minimal change 2 Dataset Construction We construct Med-Banana-50K through a systematic pipeline designed to ensure both scale and quality while respecting medical domain constraints. Our approach leverages state-of-the-art multimodal models for generation and evaluation while maintaining strict quality control at each stage. We begin by describing our source images and medical editing taxonomy (Section 2.1), then detail our instruction generation procedure (Section 2.2), and present the construction of our single-turn dataset with automated quality assessment (Section 2.3). 2.1 Overview and Medical Editing Taxonomy Our dataset is built upon images from three established medical imaging sources: MIMIC-CXR 7 for chest X-rays, Brain Tumor MRI Dataset 10 for brain scans, and ODIR-5K 13 for fundus photography. We organize medical image edits into a comprehensive taxonomy covering 23 disease types across 3 modalities and 2 editing directions (lesion addition and removal). Table 1 presents our complete taxonomy organized by modality and disease type. Our dataset is built upon images from three established medical imaging sources: MIMIC-CXR 7 for chest X-rays, Brain Tumor MRI Dataset 10 for brain scans, and ODIR-5K 13 for fundus photography. We organize medical image edits into a comprehensive taxonomy covering 23 disease types across 3 modalities and 2 editing directions (lesion addition and removal). Table 1 presents our complete taxonomy organized by modality and disease type. Modality coverage. Our dataset spans three major medical imaging modalities: (1) Chest X-ray (12 pathology types): frontal radiographs covering common thoracic conditions including pneumothorax, pleural effusion, atelectasis, consolidation, edema, cardiomegaly, fracture, and lung lesions; (2) Brain MRI (4 tumor types): T1-weighted or FLAIR sequences showing glioma, meningioma, pituitary tumor, and no-tumor cases; (3) Fundus photography (7 disease types): color retinal images depicting diabetic retinopathy, glaucoma, age-related macular degeneration, cataract, hypertension, myopia, and normal cases. Bidirectional editing tasks. For each (image, disease) pair, we construct two complementary editing directions. Lesion addition (normal \to diseased) synthesizes pathological findings in healthy images, enabling data augmentation and counterfactual generation. Lesion removal (diseased \to normal) simulates therapeutic outcomes or generates healthy references for comparison. This bidirectional design yields 6 distinct task combinations (3 modalities \times 2 directions). Image preprocessing. All images are resized to 1024 \times 1024 resolution and converted to JPEG format (quality 95) to balance file size and perceptual quality. We preserve original metadata where available for traceability but remove all patient identifiers from released data. 2.2 Instruction Generation For each (image, disease, task) tuple, we generate an English editing instruction using Gemini-2.5-Pro with a carefully designed system prompt. The prompt emphasizes three requirements: (1) Understandability : instructions should be comprehensible to non-medical personnel while remaining medically plausible; (2) Specificity : instructions must reference visible anatomical landmarks and disease characteristics; (3) Naturalness : phrasing should resemble how a user might naturally request an edit. Critically, the instruction generation prompt enforces our three core medical constraints: fidelity preservation (preserve noise, grain, device artifacts, imaging characteristics), negative rules (no text/labels, no sharp unnatural edges, no repetitive structures, no non-target pathologies), and counterfactual minimality (modify only disease-relevant regions). An example instruction for pneumothorax addition might be: “Add signs of pneumothorax in the right lung field, showing a visible visceral