Establishing dermatopathology encyclopedia DermpathNet with Artificial Intelligence-Based Workflow 3 3 3 Accepted by Scientific Data .
Ziyang Xu, Mingquan Lin, Yiliang Zhou, Zihan Xu, Seth J. Orlow, Shane A. Meehan, Alexandra Flamm, Ata S. Moshiri, Yifan Peng · 2026
Read Establishing dermatopathology encyclopedia DermpathNet with Artificial Intelligence-Based Workflow 3 3 3 Accepted by Scientific Data . by Ziyang Xu, Mingquan Lin, Yiliang Zhou, Zihan Xu, Seth J. Orlow, Shane A. Meehan, Alexandra Flamm, Ata S. Moshiri, Yifan Peng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-19378.txt.
Introduction
Ziyang Xu and seven co-authors build an open encyclopedia of skin pathology images with an AI run workflow. Clinicians and trainees in dermatopathology often struggle to find high quality open image sets for learning and cross checking. Good sets are scattered, small, or locked away.
Their resource, DermpathNet, aims to be comprehensive and open for teaching, reference, and machine learning alike. An AI based workflow helps gather and organize the images at scale. Open, well ordered image sets lift both training of doctors and training of the models that may one day assist them.
Catalog record
| CREATOR | Ziyang Xu, Mingquan Lin, Yiliang Zhou, Zihan Xu, Seth J. Orlow, Shane A. Meehan, Alexandra Flamm, Ata S. Moshiri, Yifan Peng |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-19378
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Establishing dermatopathology encyclopedia DermpathNet with Artificial Intelligence-Based Workflow 3 3 3 Accepted by Scientific Data . Ziyang Xu, Mingquan Lin, Yiliang Zhou, Zihan Xu, Seth J. Orlow, Shane A. Meehan, Alexandra Flamm, Ata S. Moshiri, Yifan Peng Abstract Accessing high-quality, open-access dermatopathology image datasets for learning and cross-referencing is a common challenge for clinicians and dermatopathology trainees. To establish a comprehensive open-access dermatopathology dataset for educational, cross-referencing, and machine-learning purposes, we employed a hybrid workflow to curate and categorize images from the PubMed Central (PMC) repository. We used specific keywords to extract relevant images, and classified them using a novel hybrid method that combined deep learning-based image modality classification with figure caption analyses. Validation on 651 manually annotated images demonstrated the robustness of our workflow, with an F-score of 89.6% for the deep learning approach, 61.0% for the keyword-based retrieval method, and 90.4% for the hybrid approach. We retrieved over 7,772 images across 166 diagnoses and released this fully annotated dataset, reviewed by board-certified dermatopathologists. Using our dataset as a challenging task, we found the current image analysis algorithm from OpenAI inadequate for analyzing dermatopathology images. In conclusion, we have developed a large, peer-reviewed, open-access dermatopathology image dataset, DermpathNet , which features a semi-automated curation workflow. Background & Summary Clinicians, as well as dermatology and pathology trainees, often struggle to access high-quality, open-access dermatopathology image datasets for diagnostic or educational purposes 15 , 18 , 8 , 12 , 6 , 17 . Physical or digital slides used for teaching are typically proprietary to a specific institution and may include patient identifiers, restricting their broader use 2 , 7 , 9 . Some sites, such as VisualDx, offer a limited collection of dermatopathology images but require a user subscription 16 . Others, like Pathologyoutline.com, provide only a small number of images illustrating classic disease features 11 . While PathPresenter offers high-resolution digital collections of scanned slides that can be uploaded by any user, not all cases on the platform are peer-reviewed, which may affect reliability 14 . In this study, we developed a pipeline to accelerate the automated construction of a dermatopathology image dataset using the PubMed Central Open Access Subset (PMC-OA) as our source 3 . PMC-OA is a free, peer-reviewed, open-access platform that hosts an extensive range of biomedical information 10 . Specifically, we curated and cataloged images from PMC-OA that correspond to common benign and malignant cutaneous neoplasms, aiming to create a comprehensive dermatopathology dataset for educational purposes, cross-referencing, and machine learning applications. Our approach leveraged a deep learning (DL)-enabled algorithm to facilitate the identification and organization of relevant images. Additionally, we evaluated and compared the precision and recall metrics of traditional keyword-based retrieval against those of our DL-based retrieval algorithms. Methods Constructing DermPath Lexicon We began by compiling a comprehensive list of benign and malignant cutaneous neoplasms to serve as our diagnoses of interest for this proof-of-concept study. We first compiled an initial lexicon with 12 categories, based on input from subject matter experts (SMEs). Next, we searched for symptoms in the UMLS Metathesaurus (version 2023AB) in the English language, using vocabulary sources of “SNOMEDCT_US” and “MeSH”. We included concepts that can be strictly matched in UMLS, along with their narrower concepts (children). Collecting candidate images from PMC-OA Using the PubMed API (Entrez Programming Utilities 13 ), we then searched for PMC-OA articles containing relevant keywords in their titles or abstracts. For instance, the query term for identifying articles related to Angiokeratoma was “Angiokeratoma [Title/Abstract].” The E-utilities tool retrieved the PubMed Central ID (PMCID) for each relevant article, which serves as the unique reference number within the PMC-OA repository. Next, we used these PMCIDs to obtain the full-text articles in XML format, which adheres to the NISO standard DTD for article publishing 1 . We then parsed the XML files to extract figures and their corresponding legends. When figures were presented as compounds containing multiple panels, we separated them into individual panels using an existing deep-learning model developed by Yao et al 20 . Determine dermatopathology-specific images using a hybrid approach Because the majority of figures retrieved from PMC-OA articles were not dermatopathology images, we developed a hybrid algorithm to accurately identify the relevant image modality. This approach combines a deep learning-based image modality classifier with keyword-based retrieval from the figure captions ( Figure 1 ). Figure 1: Overview of the Artificial Intelligence empowered workflow for semi-automated retrieval of dermatopathology images from PubMed Central (PMC). Development of image modality classification (DL classifier). First, we trained a deep learning-based image modality classifier using the ImageCLEF 2016 dataset ( Table 1 ) 4 . Our model architecture was based on DenseNet-121, pre-trained on ImageNet 5 . We replaced the original classification layer with a fully connected layer followed by a sigmoid activation function, enabling the model to output the probability of an input image being a pathology image. All images were resized to 224 \times 224 \times 3 to standardize input dimensions. We grouped the ImageCLEF 2016 image modality labels into a binary classification scheme for training. Specifically, the “Dermatopathology” class (referred to as ‘light microscopy’ in https://www.imageclef.org/2016/medical ) was designated as the positive category, and all other modality classes (including radiology, microscopy, and generic biomedical illustrations) were combined into a single “non-pathology” category. This enabled us to train the DL classifier as a binary model. The models were implemented in Keras with a TensorFlow backend and optimized using the Adam optimizer with a learning rate of 5\times 10^{-5} . Stochastic image augmentation was applied at three levels: (1) random rotation between 0°and 10°, (2) random translation along the x- and y-axes by up to 10% of the image width or height, and (3) random horizontal and vertical flipping. We evaluated the model’s performance on the ImageCLEF 2016 dataset using precision, recall, and F-score metrics. Table 1: Total number of dermatopathology and non-dermatopathology images in the ImageCLEF2016 dataset used for training and validation of the AI image modality classifier used in this study. Training Test Dermatopathology 696 405 Other image modalities 6,080 3,761 Total 6,776 4,166 Development of a keyword-based classifier. To ensure the highest quality figures for each diagnosis, we implemented an additional filtering step when more than 10 images were retrieved for a particular diagnosis of interest. In these cases, we further screened pathology images based on the presence of specific keywords, such as “H and E”, in the figure legends ( Table 2 ). If any of these keywords were found in the corresponding figure legend or manuscript title, the image was deemed relevant to that diagnosis. Table 2: Keywords used to identify dermatopathology images based on their corresponding figure legends. H & E x4 Low power x10 H and E x4 Lower power x10 H&E 4x Lower-power x50 hematoxylin and eosin 4x Nuclei x50 hematoxylin-eosin 50x Pathologic x20 high magnification 100x Pathology x20 High power 10x Pattern 50x Higher power 10x Immunofluorescence x200 Higher-power 100x 200x Histopathologic 20x x200 Histopathology 20x 400x IHC 200x x400 Immunohistochemistry x100 400x low magnification x100 x400 Development of a hybrid classifier. Given that more images are retrieved for specific diagnoses than others (depending on the rarity of the diagnoses), we further combined the DL classifier with keyword-based classification.