Mi:dm 2.0 Korea-centric Bilingual Language Models
Tech. Innovation Group, KT · 2026
Read Mi:dm 2.0 Korea-centric Bilingual Language Models by Tech. Innovation Group, KT (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-09066.txt.
Introduction
A tech team at KT gives a pair of tongues chat model built for Korea first. The model is called Mi:dm 2.0. It works in Korean and English. The team says skill in Korean text is not enough. A model for Korea must grasp shared sense, mood hints, and social rules that Koreans use each day. Those traits shape what a good reply is.
The model is trained to hold those traits as it reasons. It aims to give replies that feel right in a Korean frame, not just right in words. A reader in AI by place gets a case of a model built from a culture out, not just a tongue. It may serve users who find world models oddly off key.
Catalog record
| CREATOR | Tech. Innovation Group, KT |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 111 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-09066
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Mi:dm 2.0 Korea-centric Bilingual Language Models Tech. Innovation Group, KT Abstract We introduce Mi:dm 2.0, a bilingual large language model (LLM) specifically engineered to advance Korea-centric AI . This model goes beyond Korean text processing by integrating the values, reasoning patterns, and commonsense knowledge inherent to Korean society, enabling nuanced understanding of cultural contexts, emotional subtleties, and real-world scenarios to generate reliable, culturally appropriate responses. To address limitations of existing LLMs—often caused by insufficient or low-quality Korean data and lack of cultural alignment—Mi:dm 2.0 emphasizes robust data quality through a comprehensive pipeline that includes proprietary data cleansing, high-quality synthetic data generation, strategic data mixing with curriculum learning, and a custom Korean-optimized tokenizer to improve efficiency and coverage. To realize this vision, we offer two complementary configurations: Mi:dm 2.0 Base (11.5B parameters), built with a Depth-up Scaling strategy for general-purpose use, and Mi:dm 2.0 Mini (2.3B parameters), optimized for resource-constrained environments and specialized tasks. Mi:dm 2.0 achieves state-of-the-art performance in Korean-specific benchmarks, with top-tier zero-shot results on KMMLU and strong results in internal evaluations across language, humanities, and social science tasks. The Mi:dm 2.0 lineup is released under the MIT license supporting extensive research and commercial use. By offering these accessible and high-performance Korea-centric LLMs, KT aims to accelerate AI adoption across Korean industries, public services, and education, while strengthening the Korean AI developer community and laying the groundwork for the broader vision of K-intelligence. Our models are available via https://huggingface.co/K-intelligence . For technical inquiries, please contact [email protected] . 1 Introduction 1.1 The Korea-centric AI, Mi:dm 2.0 KT (Korea Telecom) has developed Mi:dm 2.0 as an instruction-tuned language model that embodies what we call Korea-centric AI . Korea-centric AI refers to a model that thoroughly internalizes the unique values, cognitive frameworks, and commonsense reasoning intrinsic to Korean society. It is not simply about processing and responding in Korean; it is about the profound understanding that reflects and respects the socio-cultural fabric of Korean norms and values. The development of Mi:dm 2.0 begins with a critical observation: despite the release of numerous large language models (LLMs) supporting the Korean language, few are truly grounded in the realities of Korean society. We identify a pervasive problem where existing LLMs, often trained on insufficient or low-quality Korean datasets, exhibit limited linguistic performance and a noticeable gap in their alignment with Korean cultural sensibilities [ 23 , 24 ] . This problem often leads to unnatural or emotionally incongruent responses, or even responses in languages other than Korean, from the perspective of Korean users. To directly address these deficiencies, we conceive Mi:dm 2.0, aiming to establish a new standard for a genuine Korea-centric AI that deeply internalizes the unique values, cognitive frameworks, and common sense reasoning inherent to Korean society, moving beyond mere linguistic proficiency to embody cultural nuance. Our journey begins with a robust data curation pipeline, which meticulously defines criteria for sourcing high-quality, culturally representative Korean text, complemented by innovative synthetic data generation techniques. Following this, we detail our sophisticated pre-training methodology, which ensures effective learning even with a reduced corpus size through careful data selection and strategic training. We then delve into our model optimization techniques, designed to deliver computational efficiency that surpasses comparable domestic and international models. Furthermore, we outline the post-training techniques employed to significantly enhance the model’s ability to perform Korean socio-cultural reasoning and generate contextually appropriate responses. Finally, we provide comprehensive quantitative and qualitative evaluations of Mi:dm 2.0’s performance, including benchmark comparisons that unequivocally demonstrate its advanced understanding of Korean language, culture, and society. 1.2 Mi:dm 2.0 Line-up: Base & Mini We build Mi:dm 2.0 of two distinct parameter scales—11.5B and 2.3B—to meet diverse deployment needs. The Mi:dm 2.0 lineup is the result of extensive and systematic experimentation across a wide range of model architectures, parameter scales, and compression techniques. Through rigorous testing and iterative refinement, we identify configurations that deliver strong quantitative benchmark performance, robust language model evaluations, and reliable results from comprehensive human assessments using real-world scenario prompts. Mi:dm 2.0 Base (11.5B) serves as a general-purpose foundation model, meticulously engineered to strike an optimal balance between scale and performance. Its development began with training an 8B-parameter model from scratch using KT’s proprietary pre-training corpus. To further enhance its capabilities and reach the 11.5B scale, we then applied a Depth-up Scaling (DuS) strategy [ 21 ] . This innovative approach efficiently expands the model’s depth without requiring complex architectural changes, enabling us to effectively leverage representations learned by the initial 8B model. In contrast, Mi:dm 2.0 Mini (2.3B) provides a lighter and more compact alternative. It is specifically optimized for deployment on resource-constrained devices, prioritizing computational efficiency. Mi:dm 2.0 Mini emphasizes task specialization, with a particular focus on intent understanding and machine translation, making it highly efficient for specific applications where resources are limited. Table 1 provides detailed configurations for both models. During training, we employ various optimization techniques, including parallelization and quantization, to maximize GPU resource efficiency. We also extend and customize the underlying training framework to meet Mi:dm’s specific requirements. Mi:dm 2.0 delivers competitive or superior quality compared to open-source models of similar or larger scale while maintaining significantly lower computational overhead. We provide more detailed descriptions of model design and training methodology in Section 3 . Both Mi:dm 2.0 Base and Mi:dm 2.0 Mini are released under the MIT license, allowing extensive use for both research and commercial purposes. The models are available for download on Hugging Face and can be applied to a wide range of applications without restriction. Looking ahead, we plan to expand the Mi:dm 2.0 lineup to support an even broader range of use cases, further solidifying its role as a foundation of K- intelligence. We are also committed to releasing our training code, serving environments, and other research artifacts to facilitate broader adoption and continuous improvement within the ecosystem. Through these efforts, we aim to accelerate AI transformation (AX) across Korean industry, public services, and education, and to make meaningful contributions to the Korean AI developer community with both the Mi:dm 2.0 Base and Mi:dm 2.0 Mini. Models Model Type Model Size Context Length License Midm 2.0 Base Dense 11.5B 32K MIT Midm 2.0 Mini Dense 2.3B 32K MIT Table 1: Mi:dm 2.0 line-up architecture and license 2 Data This section details the methodologies for data construction and management, including domain classification, document filtering pipeline, and synthetic data generation strategies adopted in the development of Mi:dm 2.0. Recent LLMs are known to critically depend on large amounts of high-quality textual data to achieve robust performance [ 7 , 18 ] . However, the Korean language poses a unique challenge due to the limited availability of high-quality and publicly accessible training data compared to English. Furthermore, the heterogeneous quality of Korean corpora available hinders stable and reliable performance. [ 46 , 44 ] To overcome the structural limitations of existing Korean training datasets, Mi:dm 2.0 is strategically designed and robustly trained from the earliest stages of pre-training corpus construction. We explicitly prioritize data quality over quantity to ensure the stable assimilation of both general knowledge and the nuanced Korean cultural and societal context. Despite the reduction in overall token volume, we focus on filtering for accurate, complete, and trustworthy documents.