QEVA: A Reference-Free Evaluation Metric for Narrative Video Summarization with Multimodal Question Answering

Woojun Jung, Junyeong Kim · 2026

Read QEVA: A Reference-Free Evaluation Metric for Narrative Video Summarization with Multimodal Question Answering by Woojun Jung, Junyeong Kim (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-24052.txt.

Description

Jung and Kim propose QEVA, a metric that grades video summaries against the source video itself, with no human-written reference needed. It turns the summary into questions answered from multiple modes, scoring coverage, factuality, and chronology. A new benchmark of 800 summaries from 200 videos backs the approach, and QEVA tracks human judgment more closely than prior metrics on standard correlation measures.

Catalog record

CREATORWoojun Jung, Junyeong Kim
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30255
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.24052

Browse the full library · About the Tower of Babel