One Does Not Simply Meme Alone: Evaluating Co-Creativity Between LLMs and Humans in the Generation of Humor

Zhikun Wu, Thomas Weber, Florian Müller · 2025

Read One Does Not Simply Meme Alone: Evaluating Co-Creativity Between LLMs and Humans in the Generation of Humor by Zhikun Wu, Thomas Weber, Florian Müller (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-11433.txt.

Introduction

Zhikun Wu, Thomas Weber, and Florian Müller test humans and AI as meme-making partners in a 2025 paper. Memes demand humor tuned to culture, a hard test for co-creativity. Three groups of fifty people each took part: humans alone, humans chatting with a top language model, and the model working solo. Crowd judges rated the memes on creativity, funniness, and share-worthiness.

Working with the model produced more ideas and felt easier. Yet the joint memes did not beat unaided human ones. Memes the model made entirely alone scored best of all on average. The odd result invites care: help that boosts output can still flatten the spark, and taste may favor the unedited machine joke.

Catalog record

CREATORZhikun Wu, Thomas Weber, Florian Müller
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-11433

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

One Does Not Simply Meme Alone: Evaluating Co-Creativity Between LLMs and Humans in the Generation of Humor Zhikun Wu, Thomas Weber, Florian Müller Abstract . Collaboration has been shown to enhance creativity, leading to more innovative and effective outcomes. While previous research has explored the abilities of Large Language Models (LLMs) to serve as co-creative partners in tasks like writing poetry or creating narratives, the collaborative potential of LLMs in humor-rich and culturally nuanced domains remains an open question. To address this gap, we conducted a user study to explore the potential of LLMs in co-creating memes—a humor-driven and culturally specific form of creative expression. We conducted a user study with three groups of 50 participants each: a human-only group creating memes without AI assistance, a human-AI collaboration group interacting with a state-of-the-art LLM model, and an AI-only group where the LLM autonomously generated memes. We assessed the quality of the generated memes through crowdsourcing, with each meme rated on creativity, humor, and shareability. Our results showed that LLM assistance increased the number of ideas generated and reduced the effort participants felt. However, it did not improve the quality of the memes when humans were collaborated with LLM. Interestingly, memes created entirely by AI performed better than both human-only and human-AI collaborative memes in all areas on average. However, when looking at the top-performing memes, human-created ones were better in humor, while human-AI collaborations stood out in creativity and shareability. These findings highlight the complexities of human-AI collaboration in creative tasks. While AI can boost productivity and create content that appeals to a broad audience, human creativity remains crucial for content that connects on a deeper level. Conference: 30th International Conference on Intelligent User Interfaces; March 24–27, 2025; Cagliari, Italy 30th International Conference on Intelligent User Interfaces (IUI ’25), March 24–27, 2025, Cagliari, Italy DOI: 10.1145/3708359.3712094 ISBN: 979-8-4007-1306-4/25/03 CCS: Human-centered computing Empirical studies in HCI Figure 1. Top 4 Memes Generated by AI, Humans, and Human-AI Collaboration Across Humor, Creativity, and Shareability Metric. † † cc-license: by 1. Introduction From co-authoring articles to discussing vacation plans or pair programming, collaborating with other people is a core part of our daily lives in many ways. While we could perform all these activities on our own, the diverse perspectives and problem-solving strategies ( Geen, 1994 ) , increased motivation in groups ( Geen, 1994 ) and continuous feedback ( Wigglesworth and Storch, 2012 ) help to support creative processes ( Abra, 1994 ) . Prior work showed that such collaborative work increases the performance of project teams ( Chiocchio et al., 2012 ) , improves quality ( Williams, 2000 ) , and, in particular, enhances creativity ( Mamykina et al., 2002 ) in numerous domains. With the rise of Large Language Models (LLMs), there is a growing trend of replacing human collaboration partners with such systems in typically creative activities in areas such as art ( Jiang et al., 2024 ; Zhu et al., 2018 ) , music ( Ding et al., 2024 ; Gardner et al., 2023 ; Doh et al., 2023 ) , and literature ( Yuan et al., 2022 ; Wang et al., 2024 ; Venkatraman et al., 2024 ; Hitsuwari et al., 2022 ) . In these areas, LLMs have demonstrated remarkable capabilities in generating content, often matching or even surpassing human performance in tasks like divergent thinking, which involves producing numerous and varied ideas ( Hubert et al., 2024 ) . However, much of the prior work on the creative aspect of LLMs focuses on their outputs as standalone creations, often neglecting their potential as true co-creative partners. In these studies, the researchers presented LLMs with various tasks that typically require creativity and evaluated the result produced by the LLM ( Hubert et al., 2024 ; Guzik et al., 2023 ; Gorenz and Schwarz, 2024 ; Gómez-Rodríguez and Williams, 2023 ) . These assessments focus on attributes like originality and fluency, where LLMs demonstrate strong performance on metrics such as the Torrance Test of Creative Thinking ( Hubert et al., 2024 ; Guzik et al., 2023 ) . While these works offer important insights into the possibilities of such models for creative tasks, such approaches fail to capture the iterative nature of human co-creativity. Unlike simple task delegation, co-creativity involves iterative co-creation, where humans and AI systems actively refine ideas through dialog and feedback loops, aligning with established frameworks of collaborative creativity ( Mamykina et al., 2002 ; Aragon and Williams, 2011 ) . Recently, research has started to investigate this co-creative process in the joint creative work of humans and LLMs in a number of domains ( Hitsuwari et al., 2022 ; Wan et al., 2024 ; Liu et al., 2024 ; He et al., 2024 ) and found that LLMs can contribute novel suggestions, enrich human ideas and enhance the joint creative output ( Lu et al., 2024 ; Ali and Eshaq, 2023 ) . Additionally, one important aspect has not yet been investigated in the area of co-creative collaboration with LLMs: humor. Humor is an interesting area because it is one of the most sophisticated and complex forms of human creativity. Humor strengthens social bonds, addresses difficult topics, and offers new perspectives on everyday situations ( Adiga and K, 2024 ) . It relies on surprise, contrast, cultural context, and emotional resonance ( Tanaka et al., 2022 ) . What we think is funny depends on our personal cultural, linguistic and political background ( Davies, 1990 ) . With the rise of online social networks and increasing globalization, parts of this context such as pop culture are aligning across borders, resulting in humor that incorporates elements that are personal and local as well as elements that are globally valid ( Shifman et al., 2014 ) . A well-known example of such humor, that incorporates global and local contexts, are internet memes ( Lau, 2016 ) , often in the form of captioned images. Such memes, as a cultural phenomenon, have emerged as a universal language of the internet and are used to express emotions, convey messages or appropriation and recontextualization familiar elements ( Willmore and Hocking, 2017 ) . This also made them relevant for research as a means of evaluating creative humor ( Vásquez and Aslan, 2021 ) . However, while prior studies have explored the autonomous generation of memes by LLMs ( Wang and Lee, 2024 ) , there exists no prior work in examining how human-AI collaboration with a multimodal LLM affects the creativity, humor, and shareability of memes. In this paper, we add to the body of work on human-AI co-creativity by exploring the potential of LLMs as co-creative partners for generating humor.While ’collaboration’ in HCI traditionally entails shared goals and mutual interdependence between multiple human collaborators ( Mamykina et al., 2002 ; Aragon and Williams, 2011 ) , we follow prior work that defines co-creativity in terms of iterative, dialog-based refinement of ideas ( Zhu et al., 2018 ; Guzdial and Riedl, 2019 ) . In such collaborative systems, the AI can serve as a valuable, but not necessarily equal, partner in the creative process. Consequently, we investigate how people interact with a “humor assistant” in the creation of

Read the complete text