KRETA: A Benchmark for Korean Reading and Reasoning in Text-Rich VQA Attuned to Diverse Visual Contexts
Taebaek Hwang, Minseo Kim, Gisang Lee, Seonuk Kim, Hyunjun Eun · 2025
Read KRETA: A Benchmark for Korean Reading and Reasoning in Text-Rich VQA Attuned to Diverse Visual Contexts by Taebaek Hwang, Minseo Kim, Gisang Lee, Seonuk Kim, Hyunjun Eun (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-19944.txt.
Description
Taebaek Hwang and co-authors build KRETA, a 2025 benchmark that tests AI vision models on Korean text inside images. They face signs, forms, and labels inside photos and must reason about them, a skill well tested in English but barely in Korean. Without a shared yardstick, Korean progress cannot be compared fairly.
KRETA spans 15 domains and 26 image types, from street scenes to documents. A semi-automated pipeline drafts questions by breaking images into steps, and a seven-point quality check keeps only sound items. The authors admit the set is tuned to Korean, but they built the pipeline to travel: other low-resource languages can clone it. Code and data are public, so labs can test and compare on equal terms.
Catalog record
| CREATOR | Taebaek Hwang, Minseo Kim, Gisang Lee, Seonuk Kim, Hyunjun Eun |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-19944