From National Curricula to Cultural Awareness: Constructing Open-Ended Culture-Specific Question Answering Dataset Work done independently.

Haneul Yoo Won Ik Cho Geunhye Kim Jiyoon Han · 2026

Read From National Curricula to Cultural Awareness: Constructing Open-Ended Culture-Specific Question Answering Dataset Work done independently. by Haneul Yoo Won Ik Cho Geunhye Kim Jiyoon Han (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-04632.txt.

Introduction

Haneul Yoo and three co-authors turn school textbooks into cultural training data for language models, in a 2026 arXiv paper. Models perform unevenly across languages and cultures because their training text leans English and carries its values with it. National social studies curricula, by contrast, are a society's own account of itself, and the authors propose them as a scalable foundation for culture-aware supervision.

Their framework, CuCu, is an automated multi-agent system that transforms a national curriculum into open-ended, culture-specific question-answer pairs for finetuning. Applied to the Korean national social studies curriculum, it produced KCaQA, a dataset of roughly thirty-four thousand such pairs. Analyses and training experiments suggest the dataset genuinely covers culture-specific topics and elicits responses grounded in local sociocultural context, rather than translated generalities — a template other countries' curricula could follow.

Catalog record

CREATORHaneul Yoo Won Ik Cho Geunhye Kim Jiyoon Han
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-04632

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

From National Curricula to Cultural Awareness: Constructing Open-Ended Culture-Specific Question Answering Dataset Work done independently. Haneul Yoo Won Ik Cho Geunhye Kim Jiyoon Han Abstract Large language models (LLMs) achieve strong performance on many tasks, but their progress remains uneven across languages and cultures, often reflecting values latent in English-centric training data. To enable practical cultural alignment, we propose a scalable approach that leverages national social studies curricula as a foundation for culture-aware supervision. We introduce CuCu , an automated multi-agent LLM framework that transforms national textbook curricula into open-ended, culture-specific question–answer pairs. Applying CuCu to the Korean national social studies curriculum, we construct KCaQA , comprising 34.1k open-ended QA pairs. Our quantitative and qualitative analyses suggest that KCaQA covers culture-specific topics and produces responses grounded in local sociocultural contexts. 2 2 2 CuCu and KCaQA are available at https://github.com/haneul-yoo/cucu . 1 Introduction Large language models (LLMs) have demonstrated remarkable performance on complex tasks, yet this progress has been uneven across languages and cultures. As training corpora are dominated by English-centric resources 32 ; 47 ; 3 , LLMs often internalize values and cultural framing latent in these resources. This yields culturally hollow outputs or inappropriate behaviors when applied to underrepresented regions 40 ; 1 ; 14 . As LLMs are deployed in culture-sensitive domains, this skew becomes consequential, leading to reduced performance, biased judgments, and limited cultural sensitivity in local sociocultural contexts 35 ; 19 ; 4 ; 10 . Post-training ( e.g ., supervised fine-tuning and preference optimization) offers a practical path toward culture-adapted or sovereign LLMs 43 ; 13 ; 27 . However, obtaining high-quality supervision grounded in local civic norms, historical narratives, and social institutions remains a major bottleneck 20 . Existing multilingual post-training datasets are typically general-purpose ( e.g ., daily life, STEM, reasoning) and often produced via translation of English resources 25 , which provides linguistic coverage but weak cultural grounding 33 . In this paper, we propose using national curricula as a structured prior for generating culture-grounded supervision at scale. Unlike ad hoc prompts or translated datasets, national curricula are carefully designed by domain experts and, in many countries, publicly published by governments or educational authorities; they explicitly enumerate what students are expected to learn and thereby provide both coverage (which topics a society prioritizes) and constraints (how those topics should be framed in relation to civic norms and institutions). This structure offers a principled backbone for constructing open-ended, culture-specific question answering (QA) supervision. Figure 1: Overview of CuCu . CuCu constructs an open-ended culture-specific QA pairs using national curricula. We introduce CuCu (from national Cu rricula to Cu ltural Awareness, pronounced kkukku ), a multi-agent LLM framework that leverages textbook curricula to automatically generate open-ended, culture-specific question–answer pairs (Figure 1 ). We apply CuCu to the Korean national social studies curriculum to produce KCaQA ( K orean C ulturally- a ware QA , pronounced kkakka ), comprising 34.1k open-ended, culture-specific QA pairs on Korean culture in four languages. By grounding the generation process in national standards, CuCu ensures that the resulting data incorporates culture-specific knowledge as well as normative perspectives required for genuine cultural awareness. 2 Related Work 2.1 AI-assisted Data Construction The construction of natural language data has traditionally been conducted manually, but the recent disclosure of generative language models has enabled practitioners to obtain such resources with the help of machines. Especially for the pre-training and post-training data of language models, 12 has demonstrated the significance of synthetic textbook-like materials as a sufficient and necessary source of learning. Following this light, Cosmopedia 2 investigated diverse depths in data synthesis, considering a wide range of domains and audiences. These approaches led to multiple data generation attempts in alignment 42 , reducing hallucination 16 , and further synthesizing frameworks 26 . 2.2 Culture-specific NLP Data Regardless of the data creation being manual or AI-assisted, culture-specific NLP data construction has long been a topic of interest among diversity and inclusivity interest groups. Though culture incorporates a wide range of dimensions, including region and nation, ethnic, social groups, custom, etc. 38 , we mainly focus on social consensus that lies in a specific culture and language. This differs from approaches that focus on professional knowledge, and is rather close to approaches that aim at ensuring or benchmarking language models’ capability of understanding customs and teachings 24 , norms 34 , and common grounds 39 shared among cultural groups. Especially for Korean, prior studies have tackled the evaluation of language model alignment considering cultural heritage 17 , historical knowledge 36 , or social bias 15 ; 21 . 22 has investigated social values and common knowledge regarding Korean among LLMs, but the dataset is close-ended and does not necessarily account for LLM-targeted questions, while 18 only handles factuality issues instead of sociocultural norms and values. In this light, we aim to construct a framework and the following dataset to address open-ended, culture-specific questions in light of standard and refined sources of value. 3 CuCu and KCaQA We introduce CuCu (from national Cu rricula to Cu ltural Awareness), a multi-agent LLM framework that constructs an open-ended, culture-specific QA dataset using national curricula. Figure 1 describes an overview pipeline of CuCu . Query Generation. We use Solar Pro 2 41 and GPT-4o 3 3 3 Model version: gpt-4o-2024-08-06 28 to generate or revise query texts and to evaluate query texts in each LLM agent, respectively. 1. Initial query generation: We generate an initial query in Korean based on a learning outcome ( i.e ., a pair of a learning objective and an achievement criterion). We (1) generate a query, (2) evaluate whether it fully reflects the learning outcome, and (3) revise based on the feedback, repeating this loop up to five times. 2. Culture-sensitive filtering: We filter out queries that involve general, culture-agnostic knowledge, further improving their naturalness and language use. 3. Paraphrasing & Augmentation: We paraphrase the initial query into two additional queries that target the same learning outcomes but differ in style and tone. Each resulting query is then expanded into three variants: (1) without mentioning any culture or country, (2) implicitly referring to “our/my” culture or country, and (3) explicitly stating the name of a specific culture or country. 4. Human validation & Refinement: One of the authors, who is a Korean L1 speaker born and raised in Korea, who has been educated under the Korean national curricula and thus is familiar with its norms and culture, manually validates and refines queries generated by multi-LLM agents. This process mainly includes (1) revising queries to be natural colloquial questions, (2) inspecting if the variants imply the same meaning regardless of the presence of culture or country-related expressions, and (3) assuring that queries adhere to the learning objective and the achievement criteria, not handling topics that are overly generic or too professional. 5. Multilingual extension: We finally extend the queries into three additional languages ( i.e ., English, Chinese, and Japanese) by translating the ones explicitly stating the culture/country name. Response Generation. We use four open-source LLMs ( i.e ., GPT-OSS 29 , Qwen3 , Qwen3-Next 44 , and DeepSeek R1 8 ) to generate response texts. 1. User-tailored response generation: For each query, we produce

Read the complete text