Grounding Multimodal Large Language Models with Quantitative Skin Attributes: A Retrieval Study

Max Torop Masih Eskandar Nicholas Kurtansky Jinyang Liu Jochen Weber, Octavia Camps Veronica Rotemberg Jennifer Dy Kivanc Kose · 2025

Read Grounding Multimodal Large Language Models with Quantitative Skin Attributes: A Retrieval Study by Max Torop Masih Eskandar Nicholas Kurtansky Jinyang Liu Jochen Weber, Octavia Camps Veronica Rotemberg Jennifer Dy Kivanc Kose (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-20188.txt.

Description

Max Torop and co-authors test whether image language models can ground their skin calls in measured traits in a 2025 study. Skin models can flag cancer well, but doctors need reasons they can check before trusting a call.

Traits such as lesion size have been tied to cancer risk with high accuracy on their own. The team tune a model to predict those trait values from images, then test the grounding through a search task: find past cases with like trait values. Results on a large skin set suggest the model's inner space does carry trait news. The path could yield calls that cite plain numbers.

Catalog record

CREATORMax Torop Masih Eskandar Nicholas Kurtansky Jinyang Liu Jochen Weber, Octavia Camps Veronica Rotemberg Jennifer Dy Kivanc Kose
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-20188

Browse the full library · About the Tower of Babel