K-FinHallu: A Hallucination Detection Benchmark for Multi-Turn RAG in Korean Finance

Eunbyeol Cho, Yunseung Lee, Mirae Kim, Jeewon Yang, Youngjun Kwak, Edward Choi · 2026

Read K-FinHallu: A Hallucination Detection Benchmark for Multi-Turn RAG in Korean Finance by Eunbyeol Cho, Yunseung Lee, Mirae Kim, Jeewon Yang, Youngjun Kwak, Edward Choi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29523.txt.

Introduction

Eunbyeol Cho and five colleagues present K-FinHallu, a benchmark for hallucinations in multi-turn Korean finance chat. Current tests mostly cover single English chats, missing back-and-forth flow in Korean finance. The team builds chats from genuine Korean financial texts and plants hallucinations under a taxonomy based on whether the context can answer, with justified refusals allowed. Even top models fail fine-grained financial checks and refusal conduct. Tuning an eight-billion model rivals frontier systems, with justified refusal still weakest.

Catalog record

CREATOREunbyeol Cho, Yunseung Lee, Mirae Kim, Jeewon Yang, Youngjun Kwak, Edward Choi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE79269
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.29523

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

K-FinHallu: A Hallucination Detection Benchmark for Multi-Turn RAG in Korean Finance Eunbyeol Cho, Yunseung Lee, Mirae Kim, Jeewon Yang, Youngjun Kwak, Edward Choi Abstract Large Language Models (LLMs) have advanced financial automation through Retrieval-Augmented Generation (RAG), yet hallucinations remain a critical barrier to deployment in high-stakes environments. Existing benchmarks focus on single-turn, English-centric tasks, leaving the multi-turn dynamics and linguistic-regulatory nuances of the Korean financial domain unaddressed. We introduce K-FinHallu, the first benchmark for hallucination detection in multi-turn Korean financial RAG. We construct multi-turn dialogues from authentic Korean financial documents and inject hallucinations under a proposed hierarchical taxonomy based on context answerability that explicitly accounts for justified abstention. Benchmarking frontier and open-source LLMs as hallucination detectors, we find that even the strongest models struggle with fine-grained financial diagnostics and refusal behavior. While fine-tuning an 8B model on our training split yields performance competitive with frontier LLMs, justified abstention remains the weakest axis across all evaluated models. Figure 1: Example of a contradictory hallucination in K-FinHallu. Hallucinated content is shown in red, hallucination spans are highlighted, and blue text indicates the clue text. 1 Introduction The rapid advancement of Large Language Models (LLMs) Brown et al. 2020 has catalyzed a paradigm shift across various industries. In the financial sector, LLMs are increasingly deployed to enhance operational efficiency in areas such as market analysis and the summarization of complex financial reports. However, the financial domain demands a level of precision and real-time information that often exceeds an LLM’s internal parametric knowledge. Consequently, Retrieval-Augmented Generation (RAG) has emerged as the standard architecture for financial AI Lithgow-Serrano et al. 2025 , providing evidence-based responses grounded in external, reliable knowledge bases. Despite these advantages, LLMs still produce hallucinations — outputs that contradict retrieved documents or lack contextual grounding Shuster et al. 2021 ; Niu et al. 2024 . In finance, such hallucinations are particularly critical as even small factual errors can lead to substantial monetary losses, compliance risks, and the erosion of user trust. Therefore, establishing rigorous evaluation benchmarks to detect domain-specific hallucinations is essential for reliable deployment. While existing works have addressed hallucinations in the context of RAG, two primary gaps remain in reflecting real-world financial service environments. First, there is a lack of established evaluation frameworks for multi-turn conversational RAG within the financial domain. Financial services typically operate through continuous interactions ( e.g. , chatbots) involving anaphora and implicit references. Existing benchmarks, which focus predominantly on single-turn tasks Niu et al. 2024 ; Mishra et al. 2024 , struggle to identify hallucinations arising from context-tracking failures, such as logical inconsistencies with prior turns or the misinterpretation of implicit references. Second, the unique nature of the Korean financial environment is underrepresented in existing benchmarks. Existing benchmarks Kaur et al. 2025 ; Wang et al. 2025 focus on Western institutional contexts. These datasets fail to account for Korea-specific financial systems, such as Jeonse lease system Yun 2020 , or local regulatory environments. Furthermore, Korean linguistic features—including its agglutinative morphology and the polysemy of Sino-Korean technical terminology—cannot be addressed through simple translation. To the best of our knowledge, there is currently no native Korean financial benchmark specifically designed to evaluate hallucinations in multi-turn dialogues. To bridge these gaps, we introduce K-FinHallu , a multi-turn RAG hallucination detection benchmark for the Korean financial domain, constructed from real-world Korean financial documents. We build K-FinHallu through a pipeline of faithful dialogue generation and systematic hallucination injection, covering numerical perturbations, cross-turn inconsistencies, and failures to abstain when retrieval is unsuccessful. Figure 1 illustrates a representative example of a contradictory hallucination from K-FinHallu, where the model misinterprets specific financial loan regulations. Benchmarking frontier and open-source LLMs as detectors, we find that even the strongest models struggle with fine-grained financial diagnostics and refusal behavior. Furthermore, we demonstrate that our pipeline can scale to automatically construct a training split, on which a fine-tuned 8B model with rationale supervision matches or outperforms frontier LLMs. Our primary contributions are as follows: • We release K-FinHallu , the first multi-turn hallucination detection benchmark for Korean financial RAG, built on authentic Korean financial documents. • We propose a hierarchical hallucination taxonomy based on context answerability that explicitly accounts for justified abstention in multi-turn RAG dialogues. • We demonstrate that our construction pipeline can automatically generate a training split, on which a fine-tuned 8B model with rationale supervision matches or outperforms frontier LLMs. Figure 2: Hallucination taxonomy for multi-turn RAG. We categorize five types of hallucinations based on context answerability: four types of groundedness failures in answerable scenarios where sufficient evidence is provided, and one type of fabrication in unanswerable scenarios. 2 Related Work 2.1 Hallucination Detection Benchmarks Recent studies have actively explored hallucination evaluation in LLMs Mishra et al. 2024 ; Seo and Lim 2025 . HaluEval Li et al. 2023 introduced a foundational benchmark for tasks such as question answering and summarization, but it primarily focuses on single-turn interactions and short contexts. RAGTruth Niu et al. 2024 addresses hallucinations in RAG systems by detecting them across various domains. However, it focuses on the accuracy of individual responses rather than the flow of multi-turn dialogues. For dialogue-level evaluations, DiaHalu Chen et al. 2024 and FaithDial Dziri et al. 2022 assess the consistency and factuality of general conversations. HalluLens Bang et al. 2025 emphasizes the distinction between factuality and hallucination, while also noting the lack of evaluation for cases where a model should refuse to answer. Our research builds on these findings by focusing on intrinsic hallucination rather than external knowledge. We specifically evaluate the logical consistency with retrieved documents and the ability to abstain from answering in multi-turn dialogues. 2.2 Financial Hallucination Benchmarks The financial domain requires high precision and up-to-date information, making specialized benchmarks essential. Existing benchmarks such as AlphaFin Li et al. 2024 and FinBen Xie et al. 2024 focus on measuring financial analysis and information retrieval performance. However, they do not typically verify the presence of hallucinations in generated responses. While OmniEval Wang et al. 2025 evaluates RAG in finance through multi-dimensional metrics using synthetic data, including hallucinations, it tends to overlook the context degradation inherent in long-form financial reports. PHANTOM Kaur et al. 2025 introduced a benchmark for hallucination detection in long-context financial QA by focusing on source faithfulness, which measures whether a response is strictly based on the provided documents. However, this benchmark is primarily based on Western financial systems and English datasets. Although financial services are often provided through chatbots, existing benchmarks do not sufficiently reflect hallucinations caused by context loss or anaphora resolution in multi-turn dialogues. 2.3 Korean Hallucination Benchmarks Benchmarks for evaluating Korean LLMs have progressed through datasets such as KMMLU Son et al. 2025 and HAE-RAE Son et al. 2024 . Despite this progress, datasets specifically designed for hallucination evaluation remain limited. Existing benchmarks such as Ko-TruthfulQA Lin et al. 2022 ; Park et al. 2024 often rely on translated English datasets, which may fail to capture Korean linguistic and cultural nuances Hendrycks et al. 2020 ; Seo et al. 2024 . K-HALU Seo and Lim 2025 addresses this by covering domains such as news and books within a Korean context. However, it does not account for financial regimes unique to Korea, such as housing finance regulations. Our

Read the complete text