Improvisational Games as a Benchmark for Social Intelligence of AI Agents: The Case of Connections

Gaurav Rajesh ParikhDepartment of Computer ScienceDuke University308 Research DriveDurham, NC 27708 [email protected], Angikar GhosalGraduate School of BusinessStanford University655 Knight WayStanford, CA 94305 [email protected] · 2026

Read Improvisational Games as a Benchmark for Social Intelligence of AI Agents: The Case of Connections by Gaurav Rajesh ParikhDepartment of Computer ScienceDuke University308 Research DriveDurham, NC 27708 [email protected], Angikar GhosalGraduate School of BusinessStanford University655 Knight WayStanford, CA 94305 [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-00284.txt.

Introduction

Gaurav Parikh and Angikar Ghosal introduce Connections, an improvisational wordplay game, as a benchmark for social intelligence in AI agents. Playing it draws on knowledge retrieval, summarization, and awareness of other agents' cognitive states, going beyond memory and deduction alone. Through communication in a constrained setting, agents must gauge what other agents understand and show social awareness in collaborative play. The game thus tests social intelligence that pure reasoning benchmarks miss.

Catalog record

CREATORGaurav Rajesh ParikhDepartment of Computer ScienceDuke University308 Research DriveDurham, NC 27708 [email protected], Angikar GhosalGraduate School of BusinessStanford University655 Knight WayStanford, CA 94305 [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31971
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.00284

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Improvisational Games as a Benchmark for Social Intelligence of AI Agents: The Case of Connections Gaurav Rajesh ParikhDepartment of Computer ScienceDuke University308 Research DriveDurham, NC 27708 [email protected], Angikar GhosalGraduate School of BusinessStanford University655 Knight WayStanford, CA 94305 [email protected] Abstract We formally introduce a improvisational wordplay game called Connections to explore reasoning capabilities of AI agents. Playing Connections combines skills in knowledge retrieval, summarization and awareness of cognitive states of other agents. We show how the game serves as a good benchmark for social intelligence abilities of language model based agents that go beyond the agents’ own memory and deductive reasoning and also involve gauging the understanding capabilities of other agents. Finally, we show how through communication with other agents in a constrained environment, AI agents must demonstrate social awareness and intelligence in games involving collaboration. 1 Introduction In Season 6, Episode 4 of ‘The Big Bang Theory’ 16 , the characters Sheldon Cooper and Leonard Hofstadter lose a game of Pictionary to characters Amy Fowler and Penny, because Sheldon’s clues being undecipherable to his teammates, despite the clues “making sense” to Sheldon himself, who is depicted as a very intelligent physics savant. Clearly, games that involved communication with team-members in a constrained fashion (not spelling out the word explicitly) require intelligence that go beyond one’s own vocabulary and semantic connections, it involves understanding how to effectively communicate via shared world knowledge and mutual understanding. It is known 26 that both semantic categories and relations are represented by spatially overlapping cortical patterns, however the exact way in which people perceive semantic relations are highly variable 4 and can depend on socio-cultural, educational and occupational factors. However, in such scenarios, understanding the ways in other agents perceive semantic relations and communicating accordingly is an important aspect of social intelligence. We now demonstrate the game “Connections”, a popular form of oral game-play with multiple variants played in different formats globally with no clear origin. Similar games that involve deductive reasoning along with gauging the mental states of other participants, including ‘Mafia’, 7 have been long popular as party games played by young adults. The game Connections requires the ability to satisfy structural game constraints and most importantly the awareness of capabilities of other agents for effective game-play. We now describe the rules of the game, and formalize it in later sections. In Connections, one player (the Setter) decides on a word and other players(Guessers) collectively attempt to discover this word. Initially, a single letter is revealed to players. Game play progresses when any player comes up with any clue that may be answered by the starting letter. The clue may be unrelated to the Setter’s word but should be answered by a word with the same prefix. A connection occurs if another player is able to pick up the clue and simultaneously guess the word based on the clue without the setter blocking the clue by also guessing the word based on the clue correctly. Every time a guesser player is able to guess the clue by a different guesser player without being blocked, a letter is revealed. In each round, every player (apart from the one giving a clue) can make only one guess, including the setter. As more of the word is revealed over time, guessing words and making clues becomes more constrained. Ultimately the game should culminate with a final clue that the setter is unable to block (as it is the word the setter had in mind). This leads to the termination of the game. The guessers win if they together guess the word within a certain number of clues (e.g., 50 ), else the setter wins. Consider this example - three players sitting in a circle with Player 0 assigned as the Setter to start the game. The Setter thinks of a word and writes it down without showing the word to other players. The word is “Catamaran”. • Setter: “The first letter is C ” • Player 1: “Garfield like?” • Setter: “Not a Cat ” [Example of clue blocking] • Player 2: “Induces a pause in a sentence” • Player 1 and Player 2 (simultaneously): “ C omma” [Successful Connection] • Setter: “The next letter is A ” • Player 1: “Language in Western Europe” • Player 1 (simultaneously): “ CA talan” • Player 2 (simultaneously): “ CA stillian” [Guessor Wrong] • Player 1: “Rug, sometimes flying” • Player 1 and Player 2 (simultaneously): “ CA rpet” [Successful Connection] • Setter: “The next letter is T ” • Player 2: “Baby butterfly” • Player 1 and Player 2 (simultaneously): “ CAT erpillar”[Successful Connection] • Setter: “The next letter is A ” • Player 1: “Speeds a chemical reaction” • Player 1 and Player 2 (simultaneously): “ CATA lyst”[Successful Connection] • Setter: “The next letter is M ” • Player 1: “Type of boat" • Player 1 and Player 2 (simultaneously): “ CATAMARAN ” [End of game play with revelation of the word] Normally played by a group of people, we showcase the effects of game-play by LLM agents to explore cognition, contextual understanding, and reasoning capabilities of large language models. A wide range of benchmarks have been proposed for measuring the capabilities of Large Language Models 5 . Summarization ( 10 ; 25 ; 21 ) question answering ( 11 ) , subject matter expertise and test taking, as well as the understanding of social knowledge and social cues ( 6 ) . However, there is limited work on the ability of Large Language Models to show awareness to reason about the abilities of other players and adapt. Playing a game like Connections requires a variety of different reasoning capabilities, requiring both the ability to summarize, respond to questions, have both general and subject knowledge expertise. Most important, however, is the ability of the agent to interact with and gauge the ability of other game players. Not only is the player trying to come up with a clever clue, there is a delicate balance between coming up with clues that are easy enough that other players may get them, yet tricky enough so that the Setter does not block the clue. Beyond just obtaining clues and answers via lookup in clue-answer databases, agents must be capable of generating clues taking into account the knowledge and ability of other players. Our goal in this work is to showcase that LLM agents have the capacity to play such a game and reason about the abilities of other players in order to successfully collaborate. 2 Formal Description Consider a vocabulary of words \mathfrak{U} with words \mathfrak{u}_{i}\in\mathfrak{U} . The words are made of letters chosen from an alphabet set \aleph with size L , with characters \mathsf{c}_{1},\mathsf{c}_{2},\dots,\mathsf{c}_{L} . Word \mathfrak{u}_{i} has length \mathfrak{t}_{i} , with characters \mathsf{s}_{i1},\mathsf{s}_{i2},\dots\mathsf{s}_{i\mathfrak{t}_{i}} . For simplicity, we use the English alphabet with length 26 . Consider a set of n+1 players, with indices 0,1,\dots,n where n\geq 2 . Player 0 is denoted as the Setter . Let us focus on the simpler game first (word is chosen and then fixed). Different players have different working vocabularies that they can think of candidate words from. Let the working vocabularies for player j be \mathfrak{U}_{j} , where all

Read the complete text