S-DAT: A Multilingual, GenAI-Driven Framework for Automated Divergent Thinking Assessment

Jennifer Haase, Paul H. P. Hanel, Sebastian Pokutta · 2025

Read S-DAT: A Multilingual, GenAI-Driven Framework for Automated Divergent Thinking Assessment by Jennifer Haase, Paul H. P. Hanel, Sebastian Pokutta (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-09068.txt.

Introduction

Jennifer Haase, Paul Hanel, and Sebastian Pokutta present an automated test of creative thinking in a 2025 paper. Divergent thinking, the knack for linking far-apart ideas, is a core part of creativity. Classic tests need human raters and work in one language at a time, which limits their reach.

Their framework, called S-DAT, uses large language models and multilingual word embeddings to score how far apart a person's word choices sit in meaning. That distance serves as a stand-in for divergent thinking. The team checked the test across eleven languages, from English and German to Hindi and Japanese. Scores held steady across languages and matched other creativity measures. The tool is free to use online.

Catalog record

CREATORJennifer Haase, Paul H. P. Hanel, Sebastian Pokutta
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-09068

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

S-DAT: A Multilingual, GenAI-Driven Framework for Automated Divergent Thinking Assessment Jennifer Haase, Paul H. P. Hanel, Sebastian Pokutta Abstract This paper introduces S-DAT (Synthetic-Divergent Association Task), a scalable, multilingual framework for automated assessment of divergent thinking (DT)—a core component of human creativity. Traditional creativity assessments are often labor-intensive, language-specific, and reliant on subjective human ratings, limiting their scalability and cross-cultural applicability. In contrast, S-DAT leverages large language models and advanced multilingual embeddings to compute semantic distance—a language-agnostic proxy for DT. We evaluate S-DAT across eleven diverse languages, including English, Spanish, German, Russian, Hindi, and Japanese (Kanji, Hiragana, Katakana), demonstrating robust and consistent scoring across linguistic contexts. Unlike prior DAT approaches, the S-DAT shows convergent validity with other DT measures and correct discriminant validity with convergent thinking. This cross-linguistic flexibility allows for more inclusive, global-scale creativity research, addressing key limitations of earlier approaches. S-DAT provides a powerful tool for fairer, more comprehensive evaluation of cognitive flexibility in diverse populations and can be freely assessed online: https://sdat.iol.zib.de/ . Keywords: Generative AI, assessment, divergent thinking, creativity, Large Language Models, 1 Introduction Large language models (LLMs) have become powerful tools in creativity research, increasingly used to support human ideation across domains such as mathematical problem-solving ( Ye et al., 2025 ) , scientific discovery ( Gottweis and Natarajan, 2025 ; Boiko et al., 2023 ) , and music composition ( Bodily and Ventura, 2024 ) . Within the growing field of computational creativity , AI systems have also demonstrated the ability to produce content considered creative, ranging from visual art ( DiPaola and McCaig, 2016 ) to product design ( Kaila et al., 2024 ) and architecture ( Roncoroni et al., 2024 ) . Beyond the generation of creative artifacts, AI is now being harnessed to assess creativity itself. This marks a fundamental shift in how we conceptualize and measure creative cognition: from human-judged, often subjective methods, toward scalable, automated assessments using computational proxies. For instance, recent tools compute semantic distance between ideas to approximate the cognitive flexibility required in divergent thinking (DT, the cognitive process of generating multiple, varied, and original ideas in response to open-ended problems)—a core component of creativity ( Olson et al., 2021 ; Organisciak et al., 2023 ; Cropley and Marrone, 2025 ) . In parallel, models such as reinforcement learning agents have been shown to autonomously explore symbolic action spaces, suggesting that creativity can be formalized as structured conceptual exploration ( Jin et al., 2022 ) . Yet, despite these advances, the measurement of creativity—particularly DT—remains constrained by longstanding challenges. Common tasks like the Alternate Uses Test (AUT, Christensen et al., 1960 ) or story generation exercises are cognitively demanding and time-intensive for participants ( Mohamed and Maker, 2011 ; Chaudhuri et al., 2025 ) , and typically require labor-intensive human scoring via frameworks like the Consensual Assessment Technique (CAT, Amabile et al., 1996 ). Moreover, most established tools are designed in English and rely on language-specific embeddings such as GloVe ( Olson et al., 2021 ) , limiting their accessibility for non-English-speaking populations and undermining their validity in cross-cultural research. Recent advances in generative AI (GenAI), particularly in multilingual and context-aware embeddings, offer promising alternatives. Approaches leveraging semantic distance—defined as the dissimilarity between word meanings in high-dimensional vector space—are increasingly used to approximate DT across languages ( Kenett, 2019 ; Hass, 2017 ; Heinen and Johnson, 2018 ) . Notably, multilingual adaptations of creativity tasks have begun to emerge ( Patterson et al., 2023 ; Luchini et al., 2025 ) , yet they rely on models not optimized for fine-grained semantic comparison. For instance, models such as XLM-RoBERTa prioritize general language understanding, which may introduce noise in creativity assessments, especially across diverse scripts and linguistic structures. Furthermore, high-burden tasks like AUT or creative story writing restrict the number of trials and may introduce confounds such as task fatigue or writing ability. Simpler, low-effort tasks—such as the Divergent Association Task (DAT), which prompts participants to generate semantically unrelated words—provide a more efficient and accessible format for assessing DT ( Olson et al., 2021 ) . However, the original DAT relies on English-only static embeddings and does not support multilingual administration or cross-linguistic comparability. In this paper, we propose S-DAT, a multilingual, GenAI-powered framework for the automated assessment of DT. Our approach builds on the DAT format, but leverages transformer-based embedding models to compute semantic distance across a wide range of scripts and languages. Rather than relying on translation or language-specific calibration, S-DAT operates natively in multiple languages by drawing on Unicode-based encodings and broad tokenization. From both a scientific and ethical perspective, S-DAT addresses the need for fairer, more inclusive tools in creativity research. By eliminating reliance on English and minimizing participant burden, it enables large-scale, cross-linguistic studies without privileging specific cultural or linguistic groups. In doing so, S-DAT contributes to a broader shift toward equitable, globally relevant AI research—aligned with current debates on language bias and representational fairness in AI systems ( Hou and Huang, 2025 ; Gallegos et al., 2024 ) . To develop and validate S-DAT, we benchmarked eight multilingual embedding models, identifying IBM’s granite-embedding-278m-multilingual model as the most robust for semantic distance scoring across eleven languages and scripts. We calibrated the resulting scores against the original DAT ( Olson et al., 2021 ) and validated S-DAT using human-rated tasks such as the AUT and Bridge-the-Associative-Gap Task. Our results demonstrate that S-DAT offers consistent and reliable scoring across diverse linguistic settings, providing a scalable and ethically grounded tool for DT assessment. 2 Background and Motivation 2.1 Divergent Thinking as an Essential Aspect of Creativity Creativity, defined as the generation of novel and useful ideas ( Runco and Jaeger, 2012 ; Plucker, 2004 ) , relies heavily on DT ( Guilford, 1950 ; Runco, 2010 ) , which is typically assessed using tasks like the AUT ( Christensen et al., 1960 ) or DAT ( Olson et al., 2021 ) . DT is a foundational indicator of creative potential. Meta-analyses confirm a modest link to creativity, with correlations around r =.27 ( da Costa et al., 2015 ) and shared variance as low as 3% ( Said Metwaly et al., 2024 ) . These rather moderate statistics also signal a critical limitation: DT is not synonymous with creativity. It captures one aspect—ideational fluency and variety—but does not encompass other essential components such as idea evaluation, contextual relevance, or implementation. Indeed, creativity often emerges from a dynamic interplay between divergent and convergent thinking. While DT expands the space of possibilities, convergent thinking involves narrowing those possibilities down to a viable, coherent solution using logic and critical reasoning ( Cropley, 2006 ; Runco and Acar, 2012 ) . Guilford’s foundational research captured this contrast, coining the terms “divergent production” and “convergent production” to describe how people either explore new channels of thought or draw upon conventional solutions when solving problems ( Guilford, 1967 ) . Both modes are essential: creativity requires not just the generation of ideas, but also the ability to refine, select, and develop them. Against this backdrop, we position our tool development not as a comprehensive measure of creativity, but as a focused proxy for one essential aspect: the ability to think in semantically diverse

Read the complete text