Med-CoDE: Medical Critique based Disagreement Evaluation Framework
Mohit Gupta, Akiko Aizawa, Rajiv Ratn Shah, { mohit22112 , rajivratn }@iiitd.ac.in, aizawa @nii.ac.jp · 2025
Read Med-CoDE: Medical Critique based Disagreement Evaluation Framework by Mohit Gupta, Akiko Aizawa, Rajiv Ratn Shah, { mohit22112 , rajivratn }@iiitd.ac.in, aizawa @nii.ac.jp (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-15330.txt.
Description
Mohit Gupta, Akiko Aizawa, and Rajiv Ratn Shah build a framework that grades medical AI answers by measuring disagreement in this 2025 paper. Language models now draft medical text with fluent ease. Fluency is not accuracy, and errors in clinics carry risk. Current grading methods miss much of what matters. Their framework uses structured critique as the measuring stick. Model answers are compared with established medical ground truth. The degree of mismatch is scored on a scale.
Numbers on disagreement give a firmer view of reliability. Weak spots in a model's knowledge show up as critique patterns. Hospitals need such tools before trusting AI drafts. The framework targets medical settings in particular. It is an evaluation methods paper for health AI. The authors frame it as a safety contribution.
Catalog record
| CREATOR | Mohit Gupta, Akiko Aizawa, Rajiv Ratn Shah, { mohit22112 , rajivratn }@iiitd.ac.in, aizawa @nii.ac.jp |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-15330