DaKultur : Evaluating the Cultural Awareness of Language Models for Danish with Native Speakers

Max Müller-Eberstein Mike Zhang, Elisa Bassignana Peter Brunsgaard Trolle Rob van der Goot · 2025

Read DaKultur : Evaluating the Cultural Awareness of Language Models for Danish with Native Speakers by Max Müller-Eberstein Mike Zhang, Elisa Bassignana Peter Brunsgaard Trolle Rob van der Goot (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-02403.txt.

Description

Max Müller-Eberstein and co-authors test language models on Danish culture in a 2025 paper. Models chat in many tongues yet oft miss the local sense of each. The team split tongue skill from culture skill by task. Native Danes set tasks that need Danish cultural sense and put models to them. The set holds 1,038 chats from 63 Danes of mixed age and place.

Finds cut at two roots of the gap. Auto-translated training text fails to teach or grade true culture fit. Training on native-set text more than doubled how oft Danes took a reply as fit. The full chat set ships free as DaKultur. The authors call it the first native Danish culture test bank for models.

Catalog record

CREATORMax Müller-Eberstein Mike Zhang, Elisa Bassignana Peter Brunsgaard Trolle Rob van der Goot
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-02403

Browse the full library · About the Tower of Babel