CALM: Culturally Self-Aware Language Models
Lingzhi Shen , Xiaohao Cai , Yunfei Long , Imran Razzak , Guanming Chen , Shoaib Jameel, University of Southampton, Southampton, United Kingdom Queen Mary University of London, London, United Kingdom Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, United Arab Emirates · 2026
Read CALM: Culturally Self-Aware Language Models by Lingzhi Shen , Xiaohao Cai , Yunfei Long , Imran Razzak , Guanming Chen , Shoaib Jameel, University of Southampton, Southampton, United Kingdom Queen Mary University of London, London, United Kingdom Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, United Arab Emirates (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-03483.txt.
Description
Lingzhi Shen and five co-authors introduce CALM, a framework meant to give language models cultural self-awareness. Most systems treat culture as fixed background facts, but cultures shift and overlap, so static knowledge can make answers unreliable in sensitive tasks. CALM instead separates a task's meaning from explicit cultural concepts and subtler cultural signals in the text.
Contrastive learning shapes those signals into structured cultural clusters. Cross-attention links related features, and a mixture-of-experts step blends them along culture-specific lines. The result merges with the model's own knowledge to form a culturally grounded internal state. Reflective self-prompting then helps the model keep adapting. The aim is AI that notices cultural context instead of flattening it.
Catalog record
| CREATOR | Lingzhi Shen , Xiaohao Cai , Yunfei Long , Imran Razzak , Guanming Chen , Shoaib Jameel, University of Southampton, Southampton, United Kingdom Queen Mary University of London, London, United Kingdom Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, United Arab Emirates |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 111 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-03483