SiMing-Bench: Evaluating Procedural Correctness from Continuous Interactions in Clinical Skill Videos

Xiyang Huang, Jiawei Lin, Keying Wu, Jiaxin Huang, Kailai Yang, Renxiong Wei, Cheng Zeng, Jiayi Xiang, Ziyan Kuang, Min Peng, Qianqian Xie, Sophia Ananiadou · 2026

Read SiMing-Bench: Evaluating Procedural Correctness from Continuous Interactions in Clinical Skill Videos by Xiyang Huang, Jiawei Lin, Keying Wu, Jiaxin Huang, Kailai Yang, Renxiong Wei, Cheng Zeng, Jiayi Xiang, Ziyan Kuang, Min Peng, Qianqian Xie, Sophia Ananiadou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-09037.txt.

Description

Huang and eleven colleagues introduce SiMing-Bench, a benchmark for judging procedural correctness in full-length clinical skill videos. Current video benchmarks test event recognition, temporal ordering, and long-context recall, but miss a harder expert skill. That skill is tracking how ongoing interactions change the procedural state and decide whether later actions are correct. The benchmark targets rubric-based process-level judgment, and finds step errors persist even when overall scores look acceptable. The bottleneck is modeling how interactions update procedural state over time, not finer scoring or localization.

Catalog record

CREATORXiyang Huang, Jiawei Lin, Keying Wu, Jiaxin Huang, Kailai Yang, Renxiong Wei, Cheng Zeng, Jiayi Xiang, Ziyan Kuang, Min Peng, Qianqian Xie, Sophia Ananiadou
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49365
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.09037

Browse the full library · About the Tower of Babel