A Systematic Analysis of Declining Medical Safety Messaging in Generative AI Models
2025
Read A Systematic Analysis of Declining Medical Safety Messaging in Generative AI Models (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-08030.txt.
Description
Sonali Sharma, Ahmed Alaa, and Roxana Daneshjou present a 2025 study of safety warnings in answers from generative AI models. Such models now read medical images and answer health questions, yet their answers often contain errors. Disclaimers remind users that AI output is not checked by a professional and cannot replace medical advice. The team tracked how often these warnings appear across model versions from 2022 to 2025.
They screened model answers to two thousand medical images and five hundred health questions. Warning phrases appeared in about a quarter of text model answers in 2022 but under one percent by 2025. Image models showed the same steep fall. By 2025 most models gave no warning at all. The authors argue that warnings should be built in as a safeguard, tuned to each answer's clinical context.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-08030