Automatically Detecting Amusing Games in Wordle
Ronaldo Luo, Gary Liang, Cindy Liu, Adam Kabbara · 2025
Read Automatically Detecting Amusing Games in Wordle by Ronaldo Luo, Gary Liang, Cindy Liu, Adam Kabbara (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-05415.txt.
Introduction
Ronaldo Luo and six co-authors ask whether a computer can tell which Wordle games Reddit users will find funny. Their paper from twenty twenty-five scrapes tens of thousands of user reactions to shared games. A language model labels each reaction as amused or not, with few-shot prompts. Human spot checks say the labels track real judgment well enough. Game features are then mined for a signal of fun.
The features do predict the labels, though weakly. Amusement at a word game thus has a measurable shape. The team probes which traits drive the effect. Close calls and odd letter patterns are the kind of fare such hunts surface. The authors frame humor here as a creative residue that leaves numeric traces. The study is small and playful, with a method other game scholars could reuse.
Catalog record
| CREATOR | Ronaldo Luo, Gary Liang, Cindy Liu, Adam Kabbara |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-05415
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Automatically Detecting Amusing Games in Wordle Ronaldo Luo, Gary Liang, Cindy Liu, Adam Kabbara Abstract We explore automatically predicting which Wordle games Reddit users find amusing. We scrape approximately 80k reactions by Reddit users to Wordle games from Reddit, classify the reactions as expressing amusement or not using OpenAI’s GPT-3.5 using few-shot prompting, and verify that GPT-3.5’s labels roughly correspond to human labels. We then extract features from Wordle games that can predict user amusement. We demonstrate that the features indeed provide a (weak) signal that predicts user amusement as predicted by GPT-3.5. Our results indicate that user amusement at Wordle games can be predicted computationally to some extent. We explore which features of the game contribute to user amusement. We find that user amusement is predictable, indicating a measurable aspect of creativity infused into Wordle games through humor. Introduction In this paper, we explore computationally predicting user amusement at games of Wordle. We scrape user reactions to games of Wordle from the r/Wordle subreddit, and use few-shot GPT-3.5 classification in order to rate the reactions to specific games as expressing amusement or not. We verify that GPT-3.5 roughly corresponds to human perceptions of amusement expressions. We extract features from the game that we predicted would correspond to amusement: we count inherently funny words, as well as indicators of skill/luck. We show that our features weakly predict amusement reaction by users as predicted by GPT-3.5. To the extent that the humor arises from users engaging with the game creatively, we report a measurement of the amount of creativity (rather than pure problem-solving) in the game (although of course humor can be a legitimate target for problem-solving). Prior work [ \citeauthoryearZaidi and Guerzhoy2024 ] show that perception of move brilliance in chess can be predicted using features of the game trees. We focus on amusement rather than perception of brilliance, although those might be related. Rather than rely on annotations in chess ( "!!" for “brilliant move”), we must rely on GPT-3.5 assessment of text comments. This work, like us, measures human perception of game moves. Dataset We scrape a dataset of 80,000 combinations of Wordle games posted to r/Wordle and replies to those Wordle games. The replies often, though not always, are reactions to the Wordle game in the original post. Five authors manually annotated 15 reactions from the scraped data whether they expressed amusement or not on a scale of 1-5. We then reviewed our separate annotation to converge on a common standard. After, the five authors separately annotated 85 more reactions. We achieved a weak to moderate agreement (see Table 1 ) on the variable I(rating>2) . Rachel Mason Clara George Alex GPT Rachel 1.000000 0.312346 0.431938 0.372142 0.462562 0.398427 Mason 0.312346 1.000000 0.657948 0.828974 0.489270 0.158416 Clara 0.431938 0.657948 1.000000 0.572435 0.562232 0.242574 George 0.372142 0.828974 0.572435 1.000000 0.562232 0.158416 Alex 0.462562 0.489270 0.562232 0.562232 1.000000 0.268354 GPT 0.398427 0.158416 0.242574 0.158416 0.268354 1.000000 Table 1: Cohen’s Kappa for (pseudonymous) authors and few-shot GPT. GPT prompt asked “amusing or not”, authors 1-5 ratings thresholded at 2. The table shows weak to moderate agreement GPT-3.5-turbo was used using few-shot classification to classify 80,000 comments. GPT-3.5-turbo achieved weak-to-moderate agreement with the authors (see Table 1 ). The prompt is displayed in the Appendix. Method Feature: Luck or Skill For each game, we compute indicators of luck and skill, which we hypothesize are related to amusement, as well as the inherent funniness of words. The indicators of skill and luck are based on computing the reduction in the number of guesses that are still logically possible after a play and the length of the game. At each game state, one can compute the number of guesses that are consistent with the current state. We compute average/maximum reduction in the number of possible guesses after a play, the magnitude of the last reduction (to 0) in the number of possible guesses after a play, and the maximum/average/last Levenshtein distance and distance in GloVe [ \citeauthoryearPennington, Socher, and Manning2014 ] space between guesses. The motivation for the latter two is that it may be harder for humans to guess a word that is further away from the previous guesses. Feature: Intrinsically Funny Words A linear regression model with L2 regularization is trained to predict the “intrinsic funniness” of words. The data used to train the model are 4997 words (4858 words after feature extraction) with humor rating ranging from 27.31 to 100 [ \citeauthoryearEngelthaler and Hills2018 ] . To train the model, each word in the dataset is represented by 19 different features: cosine distance to category-defining vector (CDV) of six categories (i.e. sex, party, insult, profanity, body function and animals), the Boolean value of whether the word contains the letter k , the log frequency of word, the log average letter probability, the log average phoneme probability of the word, ratio of log average letter probability and log average phoneme probability, the Boolean value of whether the word contains the phoneme /u/ , the cosine distance to CDV of eight words ending with consonant+ "le" , the valence (how appealing or undesirable the word makes people feel) \times arousal (amount of emotional activation of word), valence \times arousal \times dominance (how controlling the word’s referent is), arousal \times dominance, valence, arousal, and concreteness (how tangible the word is). Those features are shown in [ \citeauthoryearWestbury and Hollis2019 ] to have significant linear relationship with funniness. First, the category defining vectors (CDVs) of six categories (i.e. sex, party, insult, profanity, body function and animals) that are related to funniness are computed [ \citeauthoryearWestbury and Hollis2019 ] . Those vectors are calculated by first getting 19 words most related to those categories as described in the Appendix A of [ \citeauthoryearWestbury and Hollis2019 ] and finding their average word2vec embedding; then we find cosine similarity between words within the dataset and the computed average embedding to find the average embedding of the first 100 words with greatest similarity [ \citeauthoryearWestbury and Hollis2019 ] . The CDV of the Cons+ "le" words are the average of word2vec embeddings of the words gaggle, jiggle, tinkle, waddle, wiggle, wriggle, gobble and nibble. The reasoning for using that is described in [ \citeauthoryearWestbury and Hollis2019 ] : Cons+”le” words with humor rating above 2 SD that do not carry an evident semantic relation to humor. The frequency of a word is determined using data from [ \citeauthoryearTatman2017 ] . The letter frequency of a word determined using data from [ \citeauthoryearpracticalcryptography.com2024 ] . The pronunciation of a word is gathered from Carnegie Mellon University (CMU) Pronouncing Dictionary [ \citeauthoryearCarnegie Mellon University1993 ] and the frequency of each phoneme is used from data in [ \citeauthoryearCMLOEGCMLUIN2012 ] . The valence, arousal, dominance, and concreteness of a word are gathered from computational estimated of [ \citeauthoryearHollis, Westbury, and Lefsrud2017 ] . After training a linear regression model using cross-validation, the root mean squared test error in predicting the funniness of words is 7.6717 (over a range of 72.3 of possible scores) and R^{2} of 0.37022, implying we have a reasonable approximation of word funniness. The histogram and scatter plot for the distribution of original and predicted humor rating is