EH-Benchmark: Ophthalmic Hallucination Benchmark and Agent-Driven Top-Down Traceable Reasoning Workflow Journal: Information Fusion

Xiaoyu Pan, Yang Bai, Ke Zou, Yang Zhou, Jun Zhou, Huazhu Fu, Yih-Chung Tham, Yong Liu · 2025

Read EH-Benchmark: Ophthalmic Hallucination Benchmark and Agent-Driven Top-Down Traceable Reasoning Workflow Journal: Information Fusion by Xiaoyu Pan, Yang Bai, Ke Zou, Yang Zhou, Jun Zhou, Huazhu Fu, Yih-Chung Tham, Yong Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-22929.txt.

Description

Xiaoyu Pan and co-authors build a benchmark for false answers in eye-care language models. Their 2025 paper notes that medical models can invent findings when their eye knowledge is thin or their image reading is weak. Existing tests do not sort these errors well or point to fixes.

Their benchmark sorts model errors into two broad classes, one about seeing and one about reasoning, each with sub-types. They also propose a three-stage agent workflow that pulls in knowledge, studies cases, and checks results. Tests show the workflow cut both kinds of error in a clear way. The work gives eye-care AI a sharper test, and a traced path from question to answer that staff can audit.

Catalog record

CREATORXiaoyu Pan, Yang Bai, Ke Zou, Yang Zhou, Jun Zhou, Huazhu Fu, Yih-Chung Tham, Yong Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-22929

Browse the full library · About the Tower of Babel