KVoiceBench, KOpenAudioBench, and KMMAU: Agent-Driven Korean Speech Benchmarks for Evaluating SpeechLMs

Haechan Kim Seungjun Chung Inkyu Park, Jihoo Lee Jonghyun Lee, [-0.2em] KRAFTON · 2026

Read KVoiceBench, KOpenAudioBench, and KMMAU: Agent-Driven Korean Speech Benchmarks for Evaluating SpeechLMs by Haechan Kim Seungjun Chung Inkyu Park, Jihoo Lee Jonghyun Lee, [-0.2em] KRAFTON (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27984.txt.

Description

Kim and colleagues build Korean benchmarks for speech-language models without corrupting the language through naive translation. Two human-agent pipelines transfer spoken-question tests and convert Korean speech corpora into understanding tasks, yielding three public sets totaling over twelve thousand samples. Tests of eight models show English-Korean gaps that vary sharply by model and task.

Catalog record

CREATORHaechan Kim Seungjun Chung Inkyu Park, Jihoo Lee Jonghyun Lee, [-0.2em] KRAFTON
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44395
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.27984

Browse the full library · About the Tower of Babel