Metrics that Matter: Evaluating Image Quality Metrics for Medical Image Generation

Yash Deo, Yan Jia, Toni Lassila, William A. P. Smith, Tom Lawton, Siyuan Kang, Alejandro F. Frangi, Ibrahim Habli · 2025

Read Metrics that Matter: Evaluating Image Quality Metrics for Medical Image Generation by Yash Deo, Yan Jia, Toni Lassila, William A. P. Smith, Tom Lawton, Siyuan Kang, Alejandro F. Frangi, Ibrahim Habli (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-07175.txt.

Description

Yash Deo and co-authors test whether quick image scores can judge fake medical scans in a 2025 paper. AI tools now make synthetic brain scans, and clinics need proof the scans are sound. When no true scan exists to compare, teams lean on scores that grade an image on its own. The team ask how far those scores can be trusted.

They ran the scores on brain MRI data with tumors and blood vessels. The scores faced noise, shifted data, and small shape changes made to mimic real flaws. The team then set score ranks next to ranks from a real scan task. Many scores missed small shape flaws that matter for care. Some also gave odd reads when the data had been memorized by the model. The authors urge care teams to pair any quick score with task-based tests before use.

Catalog record

CREATORYash Deo, Yan Jia, Toni Lassila, William A. P. Smith, Tom Lawton, Siyuan Kang, Alejandro F. Frangi, Ibrahim Habli
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE81 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-07175

Browse the full library · About the Tower of Babel