VIDS: A Verified Imaging Dataset Standard for Medical AI
Dr. Joan S. Muthu, PhD · 2026
Read VIDS: A Verified Imaging Dataset Standard for Medical AI by Dr. Joan S. Muthu, PhD (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17525.txt.
Introduction
Muthu and Shalen propose VIDS, a verified standard for medical imaging datasets used to train AI. Existing formats cover image storage or folder naming, but none machine-checks who annotated what, with which tool, and to what quality bar. VIDS fills that curation gap with folder layouts, naming rules, provenance schemas, and 21 machine-enforceable validation rules spanning two compliance profiles. Built around NIfTI files with full DICOM metadata kept in sidecars, it exports cleanly to common training frameworks and is benchmarked on four major public datasets.
Catalog record
| CREATOR | Dr. Joan S. Muthu, PhD |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28414 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.17525
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
VIDS: A Verified Imaging Dataset Standard for Medical AI Dr. Joan S. Muthu, PhD Abstract Medical imaging AI development is fundamentally dependent on annotated datasets, yet no existing standard provides machine enforceable validation across dataset structure, annotation provenance, quality documentation, and ML readiness within a single framework. DICOM standardizes image acquisition, storage, and communication at the individual study level. BIDS organizes neuroimaging research datasets with consistent naming conventions. Neither of these standards addresses the curation layer, viz., who annotated what, when, with what tool, and to what quality standard. This paper presents VIDS (Verified Imaging Dataset Standard), an open specification that defines folder layout, file naming, annotation provenance schemas, quality documentation, and 21 machine enforceable validation rules across two compliance profiles. VIDS uses NIfTI as a canonical working format while preserving full DICOM metadata in sidecars for traceability, and supports export to any downstream ML framework (nnU-Net, MONAI, COCO, flat NIfTI) without loss of provenance. Twenty two compliance dimensions are defined and four major public datasets, viz., LIDC-IDRI, BraTS, CheXpert, and the Medical Segmentation Decathlon, are benchmarked against these dimensions. It is observed that even widely used datasets satisfy only 20–39% of these dimensions, with provenance and quality documentation as the largest systematic gaps. Further, LIDC-Hybrid-100 is released as a 100 subject VIDS compliant reference CT dataset with consensus segmentation masks from four radiologist annotations (mean pairwise Dice 0.7765), which validates 21/21 on the Full compliance profile. VIDS is fully open source: the specification is CC BY 4.0, all tools are Apache 2.0, the reference validator is available on PyPI ( pip install vids-validator ), and LIDC-Hybrid-100 is published on Zenodo ( https://doi.org/10.5281/zenodo.19582717 ). 1 Introduction The medical imaging AI pipeline is dependent on annotated datasets at every stage, from algorithm development through regulatory submission. Nevertheless, there is no standard that governs how these datasets should be structured, documented, and validated. It is a common observation that teams receive datasets as opaque archives of unnamed NIfTI files with undocumented annotations, and consequently spend days or weeks on data engineering before any model training can commence. Existing standards solve adjacent problems at different layers. DICOM ( 11 ) standardizes image acquisition, storage, and communication. BIDS ( 5 ) organizes neuroimaging datasets with consistent naming conventions and sidecar JSON metadata. COCO ( 8 ) and Pascal VOC ( 3 ) define annotation formats for natural image detection tasks. Datasheets for Datasets ( 4 ) and Data Cards ( 12 ) propose documentation frameworks for dataset transparency. These frameworks provide optional free text sections for describing annotation processes but do not enforce structured per annotation provenance or validate completeness automatically. Hence, none of these standards provide machine enforceable validation across the full scope of an annotated medical imaging dataset, viz., directory structure, file naming, annotation provenance (who annotated, when, with what tool, under what quality controls), quality documentation (inter annotator agreement, class distributions), and ML readiness (train/val/test splits with leakage prevention). VIDS fills this gap. It defines a complete directory structure for multi modality imaging datasets, mandatory per annotation provenance documentation, 21 machine enforceable validation rules, two compliance profiles for incremental adoption, and format agnostic export to downstream ML frameworks. It is noteworthy that VIDS is a delivery structure and not a data product. It enforces that quality is documented, not that quality is good. A bad dataset in VIDS format is still bad, but visibly bad: thin provenance, low inter annotator agreement, and demographic gaps are exposed in structured, machine readable fields. Therefore, VIDS shifts dataset evaluation from implicit trust to explicit, inspectable evidence. The contributions of this paper are as follows: (i) The VIDS v1.0 specification, covering dataset structure through ML readiness (Section 3 ). (ii) A zero dependency reference validator published on PyPI (Section 4 ). (iii) A compliance analysis benchmarking four major public datasets against 22 VIDS dimensions (Section 5 ). (iv) LIDC-Hybrid-100, a public VIDS compliant reference dataset with 100 subjects, 89 annotated, 224 nodules, and full provenance (Section 6 ). 2 Related Work 2.1 Medical Imaging Standards The DICOM standard ( 11 ) is the foundation of medical image acquisition, storage, and communication, defining how scanners produce and transmit images. DICOM operates at the study level and does not address how annotated datasets should be organized for AI development. DICOM SEG and DICOM SR extend DICOM for segmentation storage and structured reporting, but template variability across vendors limits their utility as a universal dataset standard. The Brain Imaging Data Structure (BIDS) ( 5 ) introduced consistent naming conventions ( sub- , ses- ) and sidecar JSON metadata for organizing neuroimaging datasets. VIDS adopts these conventions and extends them to multi modality annotation with mandatory provenance. Nevertheless, BIDS does not cover annotation provenance, quality documentation, or automated compliance validation, and is specific to neuroimaging. 2.2 Annotation Formats and Documentation COCO ( 8 ) and Pascal VOC ( 3 ) define annotation schemas for object detection in natural images. These formats handle bounding boxes and segmentation polygons but lack provenance metadata and are not designed for volumetric medical imaging. Datasheets for Datasets ( 4 ) and Data Cards ( 12 ) propose documentation frameworks for dataset transparency. More recently, RSNA launched ATLAS (2025), a searchable catalog of standardized dataset and model cards for medical imaging AI. These frameworks serve the purpose of documenting datasets, describing annotation processes, limitations, and intended uses. However, they do not define or enforce dataset file structure. A dataset card with thorough free text documentation can accompany a completely unstructured archive. VIDS operates at a different layer: it defines the structure itself and validates compliance automatically. 2.3 The Gap Table 1 summarizes the coverage of existing standards. It is evident that no existing standard combines all five requirements for production medical imaging AI datasets: directory structure, annotation provenance, quality documentation, ML readiness, and automated validation. Table 1: Coverage comparison across five dataset requirements. Standard Structure Provenance Quality ML Ready Validator DICOM Partial — — — — BIDS Yes — — — Yes COCO / VOC Partial — — — — Datasheets / Cards — Partial Partial — — RSNA ATLAS — Partial — — — VIDS Yes Yes Yes Yes Yes 3 VIDS Design 3.1 Design Principles VIDS is built on five principles: (i) Provenance is mandatory, not optional. Every annotation must document who created it, when, with what tool, and under what quality controls. (ii) Validation is automated. Compliance is determined by running a validator, not by reading a checklist. If the validator passes, the dataset is compliant. (iii) The standard is format agnostic at delivery. VIDS defines a canonical internal structure. Datasets can be exported to any downstream framework without loss of provenance. (iv) Profiles enable incremental adoption. The POC profile requires 15 rules for quick prototypes. The Full profile requires all 21 for production, publications, and regulatory submissions. (v) The standard complements, not replaces. VIDS works with NIfTI (file format), DICOM (source data), BIDS (naming conventions), and existing ML frameworks. 3.2 Dataset Structure A VIDS dataset organizes data into a root containing metadata files, a sub-*/ses-*/modality/ hierarchy for source imaging, a derivatives/annotations/ tree mirroring the source layout, and quality/ and ml/ directories for Full profile compliance. File naming follows the pattern: sub-<ID>_ses-<ID>_<modality>_<suffix>.<ext>