AdaCultureSafe: Adaptive Cultural Safety Grounded by Cultural Knowledge in Large Language Models DOI: XXXXXXX.XXXXXXX Conference: the 32st ACM SIGKDD Conference on Knowledge Discovery and Data Mining; August 09–13, 2026; Jeju, Korea ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Security and privacy Human and societal aspects of security and privacy CCS: Social and professional topics Cultural characteristics CCS: Computing methodologies Natural language processing

Hankun Kang, Di Lin, Zhirong Liao, Pengfei Bai, Xinyi Zeng, Jiawei Jiang, Yuanyuan Zhu, Tieyun Qian · 2026

Read AdaCultureSafe: Adaptive Cultural Safety Grounded by Cultural Knowledge in Large Language Models DOI: XXXXXXX.XXXXXXX Conference: the 32st ACM SIGKDD Conference on Knowledge Discovery and Data Mining; August 09–13, 2026; Jeju, Korea ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Security and privacy Human and societal aspects of security and privacy CCS: Social and professional topics Cultural characteristics CCS: Computing methodologies Natural language processing by Hankun Kang, Di Lin, Zhirong Liao, Pengfei Bai, Xinyi Zeng, Jiawei Jiang, Yuanyuan Zhu, Tieyun Qian (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08275.txt.

Introduction

Kang and colleagues introduce AdaCultureSafe, a dataset for jointly testing cultural safety and knowledge in large language models. Cultural safety means writing respectful and appropriate replies across diverse groups, yet current research often treats safety and knowledge in isolation. Through AdaCultureSafe, the authors reveal a critical decoupling. Although language models hold rich knowledge of customs, they fail to use it to improve safety, leaning instead on generic safety rather than culture-specific knowledge. A knowledge-grounded method that elicits internal knowledge of customs during response generation improves safety.

Catalog record

CREATORHankun Kang, Di Lin, Zhirong Liao, Pengfei Bai, Xinyi Zeng, Jiawei Jiang, Yuanyuan Zhu, Tieyun Qian
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48590
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.08275

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AdaCultureSafe: Adaptive Cultural Safety Grounded by Cultural Knowledge in Large Language Models DOI: XXXXXXX.XXXXXXX Conference: the 32st ACM SIGKDD Conference on Knowledge Discovery and Data Mining; August 09–13, 2026; Jeju, Korea ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Security and privacy Human and societal aspects of security and privacy CCS: Social and professional topics Cultural characteristics CCS: Computing methodologies Natural language processing Hankun Kang, Di Lin, Zhirong Liao, Pengfei Bai, Xinyi Zeng, Jiawei Jiang, Yuanyuan Zhu, Tieyun Qian Abstract . With the widespread adoption of Large Language Models (LLMs), respecting indigenous cultures becomes essential for models’ culturally safety and responsible global applications. Existing studies separately consider cultural safety and cultural knowledge and neglect that the former should be grounded by the latter. This severely prevents LLMs from yielding culture-specific respectful responses. Consequently, adaptive cultural safety remains a formidable task. In this work, we propose to jointly model cultural safety and knowledge. First and foremost, cultural-safety and knowledge-paired data serve as the key prerequisite to conduct this research. However, the cultural diversity across regions and the subtlety of cultural differences pose significant challenges to the creation of such paired evaluation data. To address this issue, we propose a novel framework that integrates authoritative cultural knowledge descriptions curation, LLM-automated query generation, and heavy manual verification. Accordingly, we obtain a dataset named AdaCultureSafe containing 4.8K manually decomposed fine-grained cultural descriptions and the corresponding 48K manually verified safety- and knowledge-oriented queries . Upon the constructed dataset, we evaluate three families of popular LLMs on their cultural safety and knowledge proficiency, via which we make a critical discovery: no significant correlation exists between their cultural safety and knowledge proficiency . We then delve into the utility-related neuron activations within LLMs to investigate the potential cause of the absence of correlation, which can be attributed to the difference of the objectives of pre-training and post-alignment. We finally present a knowledge-grounded method, which significantly enhances cultural safety by enforcing the integration of knowledge into the LLM response generation process. Warning : This paper may contain harmful examples by nature. 1. Introduction LLMs present impressive capabilities across a wide range of tasks ( 42 ; 51 ; 55 ) , such as extensive knowledge ( 22 ; 11 ) , semantic understanding ( 46 ; 19 ) , and reasoning ( 53 ; 48 ; 29 ; 50 ) . Unfortunately, LLMs also raise serious safety and ethical concerns like toxicity and harmful jailbreaks ( 28 ; 20 ; 6 ) . In particular, with the widespread global usage, it is critical to ensure the adaptive cultural safety of large language models (LLMs) across diverse cultural contexts for their responsible global deployment ( 3 ; 35 ; 4 ) . In fact, as a fundamental prerequisite for adaptive cultural safety, LLMs must first understand diverse cultural knowledge to enable contextually adaptive cultural respect. Cultural safety and cultural knowledge are inherently interdependent: adaptive cultural safety frameworks cannot be meaningfully established without grounding in region-specific cultural knowledge. Even with safety constraints, LLMs may fail to capture fine-grained cross-cultural nuances and thus cannot respond adaptively, thereby causing cross - cultural disrespect and undermining their reliability for global deployment. Most existing studies focus on only one aspect: either cultural knowledge in LLMs ( 58 ; 34 ; 40 ) or the cultural safety of LLMs ( 16 ; 2 ; 37 ) . Although some pioneering efforts ( 54 ) have started to consider both cultural knowledge and cultural safety, they typically treat them as separate and independent components, without accounting for their intrinsic interdependence (see Fig. 1 (a)). This limitation severely hinders the establishment of adaptive cultural safety for LLMs in diverse global cultural contexts. To bridge this gap, we propose a unified paradigm that jointly models cultural knowledge and adaptive cultural safety with explicit consideration of their intrinsic interdependence. This requires a fine-grained dataset with paired cultural-knowledge and cultural-safety evaluation assets. However, due to cultural pluralism and subtle cross-cultural contextual differences, both deriving granular cultural descriptions and designing targeted assessment queries pose substantial technical difficulties. To overcome these, we introduce a framework integrating authoritative cultural description curation, LLM-automated query generation, and manual validation, with which we build the high-quality AdaCultureSafe dataset. Firstly, we collect cultural knowledge materials covering 22 countries across six continents from three authoritative platforms, with manual validation to ensure data quality . We scrape raw text, filter out noise, and restructure heterogeneous web content into consistent formats. As the original materials mix diverse cultural topics and limit fine-grained analysis, we further manually decompose them into 4.8K granular cultural descriptions, each dedicated to one distinct cultural topic. Second, we build paired queries for each cultural description to support cultural knowledge and safety evaluation . Following standard query designs ( 23 ; 31 ; 40 ) , we develop multiple-choice queries to assess LLMs’ cultural knowledge mastery and open-ended queries to evaluate their cultural respect ( 14 ; 41 ; 60 ) . All queries are manually validated to ensure strict alignment with the target description and factual correctness of ground-truth answers. This results in 24K cultural knowledge queries and 24K cultural safety queries, respectively. Compared with existing datasets, AdaCultureSafe supports joint evaluation of LLMs’ knowledge mastery and cultural safety compliance over diverse fine-grained cultural descriptions, as shown in Fig. 1 (b). We introduce three types of evaluation metrics: (1) Individual metrics : accuracy for knowledge mastery and respect score for cultural safety compliance; (2) Joint metric : an F1 score combining accuracy and respect score; (3) Correlation metric : the Spearman correlation between accuracy and respect score. We perform joint evaluations on three LLM families using AdaCultureSafe and identify several key observations: LLMs show cultural knowledge and safety biases across countries, and performance differs noticeably across models. More importantly, we derive the following critical finding. Cultural safety compliance shows a significantly weak correlation with corresponding cultural knowledge mastery across LLMs, with a near-zero Spearman coefficient. This demonstrates that cultural safety is not grounded in cultural knowledge: strong cultural safety does not imply proficient knowledge, nor does thorough cultural knowledge ensure reliable cultural safety. We ascribe this to the absence of inherent dependence between these two capabilities in LLMs. Furthermore, to explore the root causes of the weak correlation, we analyze utility-specific neuron activation in LLMs for cultural knowledge and safety to reveal their intrinsic mechanisms. We find that task-relevant layers contain fewer shared activated neurons for cultural knowledge than those for cultural safety. We infer that cultural knowledge is learned in pre-training in a highly specialized fashion ( 26 ; 35 ; 61 ) , leading to limited overlap, whereas cultural safety is imposed via post-training on general non-knowledge data for universal safety constraints, yielding more shared neurons. This discrepancy may explain the weak correlation between these two capabilities. Figure 1. Comparison between existing studies and our work. Existing studies are unpaired for cultural topics and ignore joint analysis on the same cultural topics, which is our focus. Finally, we propose an initial cultural knowledge-grounded framework to improve cultural safety by grounding model responses in explicit cultural knowledge. As a proof-of-concept validation on AdaCultureSafe, a representative open-source LLM (Llama3.1-8B) yields notable improvements: a 19.9% gain in respect score and a 12.7% lift

Read the complete text