Med-CoDE: Medical Critique based Disagreement Evaluation Framework

Mohit Gupta, Akiko Aizawa, Rajiv Ratn Shah, { mohit22112 , rajivratn }@iiitd.ac.in, aizawa @nii.ac.jp · 2025

Read Med-CoDE: Medical Critique based Disagreement Evaluation Framework by Mohit Gupta, Akiko Aizawa, Rajiv Ratn Shah, { mohit22112 , rajivratn }@iiitd.ac.in, aizawa @nii.ac.jp (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-15330.txt.

Description

Mohit Gupta, Akiko Aizawa, and Rajiv Ratn Shah build a framework that grades medical AI answers by measuring disagreement in this 2025 paper. Language models now draft medical text with fluent ease. Fluency is not accuracy, and errors in clinics carry risk. Current grading methods miss much of what matters. Their framework uses structured critique as the measuring stick. Model answers are compared with established medical ground truth. The degree of mismatch is scored on a scale.

Numbers on disagreement give a firmer view of reliability. Weak spots in a model's knowledge show up as critique patterns. Hospitals need such tools before trusting AI drafts. The framework targets medical settings in particular. It is an evaluation methods paper for health AI. The authors frame it as a safety contribution.

Catalog record

CREATORMohit Gupta, Akiko Aizawa, Rajiv Ratn Shah, { mohit22112 , rajivratn }@iiitd.ac.in, aizawa @nii.ac.jp
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-15330

Browse the full library · About the Tower of Babel