KRETA: A Benchmark for Korean Reading and Reasoning in Text-Rich VQA Attuned to Diverse Visual Contexts

Taebaek Hwang, Minseo Kim, Gisang Lee, Seonuk Kim, Hyunjun Eun · 2025

Read KRETA: A Benchmark for Korean Reading and Reasoning in Text-Rich VQA Attuned to Diverse Visual Contexts by Taebaek Hwang, Minseo Kim, Gisang Lee, Seonuk Kim, Hyunjun Eun (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-19944.txt.

Description

Taebaek Hwang and co-authors build KRETA, a 2025 benchmark that tests AI vision models on Korean text inside images. They face signs, forms, and labels inside photos and must reason about them, a skill well tested in English but barely in Korean. Without a shared yardstick, Korean progress cannot be compared fairly.

KRETA spans 15 domains and 26 image types, from street scenes to documents. A semi-automated pipeline drafts questions by breaking images into steps, and a seven-point quality check keeps only sound items. The authors admit the set is tuned to Korean, but they built the pipeline to travel: other low-resource languages can clone it. Code and data are public, so labs can test and compare on equal terms.

Catalog record

CREATORTaebaek Hwang, Minseo Kim, Gisang Lee, Seonuk Kim, Hyunjun Eun
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-19944

Browse the full library · About the Tower of Babel