Pun Intended: Multi-Agent Translation of Wordplay with Contrastive Learning and Phonetic-Semantic Embeddings for CLEF JOKER 2025 Task 2
Russell Taylor, Benjamin Herbert, Michael Sana · 2025
Read Pun Intended: Multi-Agent Translation of Wordplay with Contrastive Learning and Phonetic-Semantic Embeddings for CLEF JOKER 2025 Task 2 by Russell Taylor, Benjamin Herbert, Michael Sana (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-06506.txt.
Introduction
Russell Taylor, Benjamin Herbert, and Michael Sana translate puns from English to French with a team of AI agents, in a 2025 paper. Wordplay defeats most translation systems. A pun's sound and sense must both survive. The team entered a shared task on humor translation. Their method runs in three stages. First, top language models draft translations. Feedback comes from a new contrastive dataset built for the purpose.
Second, a guided reasoning pipeline adds sound-and-meaning embeddings. Those embeddings help find French words that echo the original's trick. Third, generator and judge agents loop together. Bad puns are scored and regenerated with comments. The aim is creativity, not literal matching. Their best runs took first and second place in the contest. Native French experts judged the entries by hand. The work links translation studies with language technology. It shows models can aim at jokes deliberately.
Catalog record
| CREATOR | Russell Taylor, Benjamin Herbert, Michael Sana |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-06506
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Pun Intended: Multi-Agent Translation of Wordplay with Contrastive Learning and Phonetic-Semantic Embeddings for CLEF JOKER 2025 Task 2 Russell Taylor, Benjamin Herbert, Michael Sana Abstract Translating wordplay across languages presents unique challenges that have long confounded both professional human translators and machine translation systems. This research proposes a novel approach for translating puns from English to French by combining state-of-the-art large language models with specialized techniques for wordplay generation. Our methodology employs a three-stage approach. First, we establish a baseline using multiple frontier large language models with feedback based on a new contrastive learning dataset. Second, we implement a guided chain-of-thought pipeline with combined phonetic-semantic embeddings. Third, we implement a multi-agent generator-discriminator framework for evaluating and regenerating puns with feedback. Moving beyond the limitations of literal translation, our methodology’s primary objective is to capture the linguistic creativity and humor of the source text wordplay, rather than simply duplicating its vocabulary. Our best runs earned first and second place in the CLEF JOKER 2025 Task 2 competition where they were evaluated manually by expert native French speakers. This research addresses a gap between translation studies and computational linguistics by implementing linguistically-informed techniques for wordplay translation, advancing our understanding of how language models can be leveraged to handle the complex interplay between semantic ambiguity, phonetic similarity, and the implicit cultural and linguistic awareness needed for successful humor. [ orcid=0009-0007-0702-2375, [email protected], ] *1 [orcid=0009-0009-0179-3835, [email protected], ] [orcid=0009-0007-6608-7347, [email protected], ] keywords Computational humor ,pun generation ,machine translation ,phonetic-semantic embeddings ,large language models (LLMs) ,multi-agent evaluation ,contrastive learning ,natural language processing (NLP) † † copyrightyear: 2025 † † copyright: Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). † † venue: CLEF 2025 Working Notes, 9 – 12 September 2025, Madrid, Spain † † address: Georgia Institute of Technology, North Ave NW, Atlanta, GA 30332 † † corresp: Corresponding author. 1 Introduction Training language models to translate puns is difficult for several reasons: First, most language models are designed to identify linguistic and semantic patterns and probabilistically eliminate outliers Baziotis et al. 2023 . But puns rely on both semantic ambiguities and linguistic discontinuities in order to produce humor. It is precisely the presence of some linguistic incongruity that makes a pun surprising or clever Aarons 2017 . And without it, computational approaches to humor often fail. Second, neural machine translation models have advanced rapidly in recent years and have achieved impressive results on machine translation tasks. But these models are traditionally trained using loss functions and evaluation metrics that reward direct, literal translations. There often does not exist a homonym in a target language that has precisely the same meanings as a homonym in a source language. So, a machine translation model may effortlessly choose a gloss, and inadvertently destroy the wordplay. Third, generating a pun in a new language requires broad awareness of both the linguistic and cultural nuances of the target milieu. Producing original humor in any context is a difficult task, even for humans. Most jokes that people tell are simply repeated versions of jokes they have heard. Remarkably few talented or well-trained humans are able to produce truly original humor Miller 2019 . Fourth, translating humor has long been recognized by professional translators as a task so difficult, that it is often dismissed as impossible Low 2011 . However, with the rapid advancement of frontier large language models (LLMs), which are trained on datasets that contain enormous amounts of cultural and linguistic data, including the semantic and linguistic incongruities of humor, the potential for quality machine-translated puns is greater than ever before. This paper proposes to take advantage of both the latest advances in LLMs and the latest state-of-the-art approaches for single-language pun generation, and apply them to the task of translating puns from English into French. This paper will address the following research questions: 1. How well do the latest large language models, supplemented by a discriminator model trained using contrastive learning, compare to the previous state-of-the-art for translating puns from English to French? 2. How well does a guided chain-of-thought pipeline with trained phonetic-semantic embeddings compare to the previous state-of-the-art for translating puns from English to French? 3. How well does a multi-agent generator-discriminator pipeline with feedback compare to the previous state-of-the-art for translating puns from English to French? 2 Related Work The literature relevant to this task includes research on linguistic approaches to humor, approaches to professional human translation of wordplay, machine translation of wordplay, wordplay generation, and evaluation of generated wordplay. 2.1 Linguistics of Humor The linguistics of humor is a rich field at the intersection of pragmatics, semantics, sociolinguistics, and cognitive linguistics. Several major theories attempt to explain how humor operates in language. The General Theory of Verbal Humor (GTVH), proposed by Attardo and Raskin, aims to describe the linguistic functions that result in humor. Central to the theory is the concept of script opposition, where two incompatible frames of reference are juxtaposed. This incongruous juxtaposition creates surprise and therefore humor Attardo and Raskin 1991 . Veisbergs argues that GTVH allows for identifying which joke elements are essential, and shows how shifts in the language or logical mechanism can still preserve humor as long as script opposition is retained Veisbergs 1997 . The primary alternative approach to GTVH in the literature is Relevance Theory. While GTVH is rooted in structuralist linguistics, Relevance Theory is based in pragmatics and cognitive linguistic approaches. It suggests that humor involves violations of relevance expectations, often leading to reinterpretation or cognitive reprocessing. In support of this approach, Yus specifically argues that pun translation is successful when it results in a similar level of surprise and reinterpretation Yus 2003 . Aarons argues that successful puns require both ambiguity (script overlap) and incongruity (script oppositeness). But while GTVH can be useful for describing humor linguistically, it does not imply that users of humor are aware of the linguistic features at play. Aarons argues that tacit linguistic knowledge is required by both the speaker and hearers of puns in order for the pun to succeed Aarons 2017 . Based on this insight, we believe it will be important to make use of the tacit linguistic knowledge of LLMs, as opposed to more specialized neural machine translation models. 2.2 Professional Human Translation of Wordplay The most widely cited framework for translating puns, proposed by Delabastita in 1996, identifies eight strategies that translators might employ Delabastita 1996 . A volume of essays published the following year, entitled Traductio: Essays on Punning and Translation , explores these approaches from many different perspectives and domains Delabastita 1997 . While this work has been influential, it does not provide a step-by-step process for translating puns. Low fills this gap with an insightful essay that argues persuasively against the defeatist attitude present among many translators that pun translation is often impossible Low 2011 . He proposes a systematic methodology for translating puns that he represents through the visual of polygons. He begins with what he describes as a ”square” translation of the pun, where the first and second meanings of the homonym are simply translated directly, and the four corners of the square represent the two source language meanings