CALM: Culturally Self-Aware Language Models

Lingzhi Shen , Xiaohao Cai , Yunfei Long , Imran Razzak , Guanming Chen , Shoaib Jameel, University of Southampton, Southampton, United Kingdom Queen Mary University of London, London, United Kingdom Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, United Arab Emirates · 2026

Read CALM: Culturally Self-Aware Language Models by Lingzhi Shen , Xiaohao Cai , Yunfei Long , Imran Razzak , Guanming Chen , Shoaib Jameel, University of Southampton, Southampton, United Kingdom Queen Mary University of London, London, United Kingdom Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, United Arab Emirates (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-03483.txt.

Description

Lingzhi Shen and five co-authors introduce CALM, a framework meant to give language models cultural self-awareness. Most systems treat culture as fixed background facts, but cultures shift and overlap, so static knowledge can make answers unreliable in sensitive tasks. CALM instead separates a task's meaning from explicit cultural concepts and subtler cultural signals in the text.

Contrastive learning shapes those signals into structured cultural clusters. Cross-attention links related features, and a mixture-of-experts step blends them along culture-specific lines. The result merges with the model's own knowledge to form a culturally grounded internal state. Reflective self-prompting then helps the model keep adapting. The aim is AI that notices cultural context instead of flattening it.

Catalog record

CREATORLingzhi Shen , Xiaohao Cai , Yunfei Long , Imran Razzak , Guanming Chen , Shoaib Jameel, University of Southampton, Southampton, United Kingdom Queen Mary University of London, London, United Kingdom Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, United Arab Emirates
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE111 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-03483

Browse the full library · About the Tower of Babel