SNEAK: Evaluating Strategic Communication and Information Leakage in Large Language Models

Adar Avsian, Larry Heck · 2026

Read SNEAK: Evaluating Strategic Communication and Information Leakage in Large Language Models by Adar Avsian, Larry Heck (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-29846.txt.

Introduction

Avsian and Heck build SNEAK, a benchmark for secret-aware talk by language models. Multi-agent settings often demand messages that inform allies but hide facts from rivals. Each test gives a model a category, a word list, and a secret word. The model must hint at the secret without giving it away. An ally agent and a rival agent score utility and leakage. Humans beat all tested models by up to four times.

Catalog record

CREATORAdar Avsian, Larry Heck
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51973
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.29846

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SNEAK: Evaluating Strategic Communication and Information Leakage in Large Language Models Adar Avsian, Larry Heck Abstract Large language models (LLMs) are increasingly deployed in multi-agent settings where communication must balance informativeness and secrecy. In such settings, an agent may need to signal information to collaborators while preventing an adversary from inferring sensitive details. However, existing LLM benchmarks primarily evaluate capabilities such as reasoning, factual knowledge, or instruction following, and do not directly measure strategic communication under asymmetric information. We introduce SNEAK (Secret-aware Natural language Evaluation for Adversarial Knowledge), a benchmark for evaluating selective information sharing in language models. In SNEAK, a model is given a semantic category, a candidate set of words, and a secret word, and must generate a message that indicates knowledge of the secret without revealing it too clearly. We evaluate generated messages using two simulated agents with different information states: an ally , who knows the secret and must identify the intended message, and a chameleon , who does not know the secret and attempts to infer it from the message. This yields two complementary metrics: utility , measuring how well the message communicates to collaborators, and leakage , measuring how much information it reveals to an adversary. Using this framework, we analyze the trade-off between informativeness and secrecy in modern language models and show that strategic communication under asymmetric information remains a challenging capability for current systems. Notably, human participants outperform all evaluated models by a large margin, achieving up to 4 × \times higher scores. 1 Introduction Large language models (LLMs) are increasingly deployed in settings that require interaction with other agents, including collaborative assistants, multi-agent systems, and strategic dialogue environments ( 36 ; 40 ; 29 ; 44 ; 12 ; 1 ) . In many of these settings, communication occurs under heterogeneous information states: different participants possess different knowledge, expertise, or access to underlying information. This creates a central challenge for language models: how to communicate information that is useful for an intended recipient while controlling how much of the underlying concept becomes identifiable more broadly. This challenge arises in many real-world settings. In pedagogy, instructors often provide hints that guide a student toward a solution without revealing the answer outright ( 32 ; 25 ) . This reflects a well-studied trade-off known as the assistance dilemma : too little guidance leads to unproductive struggle, while too much guidance can undermine learning by removing the need for independent reasoning ( 4 ) . Similar trade-offs appear in domains such as consulting, where a firm conveys expertise without fully specifying a solution prior to engagement, and in investor communication, where founders share progress while limiting detailed disclosure of strategy or internal metrics. In each case, the goal is not simply to convey information, but to control identifiability: a message should make the underlying concept sufficiently clear for its intended purpose, without making it fully recoverable. Increasing the specificity of a message improves its usefulness, but also makes the underlying information easier to infer ( 10 ) . Despite its importance, this capability is not captured by existing language model benchmarks. Most evaluations focus on whether models can produce correct outputs—measuring knowledge, reasoning, or instruction following ( 28 ; 20 ; 46 ; 30 ; 11 ) . They do not test whether models can control how much information they reveal when communicating with other agents. As a result, an important aspect of language use in multi-agent settings remains underexplored. In this work, we introduce SNEAK (Secret-aware Natural language Evaluation for Adversarial Knowledge), a benchmark for evaluating selective information sharing in language models. The task is inspired by the party game The Chameleon ( 5 ) and studies a simple but fundamental communication problem: can a model produce a message that is informative to an informed collaborator while remaining ambiguous to an uninformed observer? To measure this, SNEAK evaluates generated messages using two complementary behavioral criteria: utility , which captures how well a message communicates to an ally, and leakage , which captures how much information it reveals to an observer without access to the secret. Figure 1 provides an overview of the benchmark setup and evaluation framework. Using this framework, we analyze how modern language models navigate the trade-off between informativeness and identifiability. Our results show that current models often struggle to balance these objectives: messages that are highly useful to collaborators also tend to reveal substantial information more broadly. Under the same evaluation protocol, human participants achieve up to 4 \times higher scores than some evaluated LLMs, highlighting a substantial remaining gap in selective communication ability. At the same time, the benchmark exhibits significant headroom, suggesting that controlled information sharing remains a challenging and underdeveloped capability for current systems. The dataset and evaluation scripts will be released upon publication. Figure 1: Overview of the SNEAK benchmark. A message-generating language model (left) plays the role of an ally by observing the category, candidate set, and secret word and produces a message. A second ally (center), who knows the secret, hears the message and must determine whether it corresponds to the secret. The chameleon (right), who does not know the secret, hears the message and must infer the secret word from the candidate set. Our contributions are as follows: • We introduce SNEAK , a benchmark for evaluating selective information sharing in language models, together with a dataset of communication games spanning diverse semantic domains. • We propose a behavioral evaluation framework that decomposes communication into utility and leakage , enabling objective, reproducible evaluation. • We show that modern LLMs achieve high utility but struggle with information leakage, exhibiting a utility–leakage trade-off and falling short of human performance. 2 The SNEAK benchmark 2.1 Task definition SNEAK is an asymmetric communication task designed to evaluate selective information sharing in LLMs. Inspired by the party game The Chameleon ( 5 ) , a model must generate a message about a secret word such that collaborators who know the secret can recognize that the model knows it, while adversaries who do not know the secret cannot reliably infer it. To enable controlled evaluation, SNEAK abstracts this interaction into a one-shot setting with a single generated message and a set of decoys, allowing for consistent and reproducible measurement of utility and leakage. Game setup Each benchmark instance consists of a semantic category c , a set of words drawn from that category W=\{w_{1},\dots,w_{|W|}\}, and a secret word w_{s}\in W . A message-generating model f_{\theta} observes (c,W,w_{s}) and produces a short natural language message m_{\theta}=f_{\theta}(c,W,w_{s}). To evaluate m_{\theta} , we consider two agents with different information states. The chameleon (adversary) does not know the secret. Given (c,W,m_{\theta}) , it predicts a distribution over candidate words: P_{\text{cham}}(w\mid c,W,m_{\theta}),\quad w\in W. This distribution represents the adversary’s belief about the secret. The ally (collaborator) knows the secret word w_{s} and must identify which message corresponds to it. The ally is given (c,W,w_{s}) and a set of messages M=\{m_{\theta}\}\cup M_{\text{decoy}}, where M_{\text{decoy}} is a set of decoy messages that are generated without access to the secret. The ally predicts a distribution over messages: P_{\text{ally}}(m\mid c,W,w_{s},M),\quad m\in M. Metrics Selective communication requires balancing two competing objectives: a message should be recognizable to collaborators who

Read the complete text