Synopsis: Secure and private trend inference from encrypted semantic embeddings

Madelyne Xiao, Palak Jain, Micha Gorelick, Sarah Scheffler · 2025

Read Synopsis: Secure and private trend inference from encrypted semantic embeddings by Madelyne Xiao, Palak Jain, Micha Gorelick, Sarah Scheffler (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-23880.txt.

Introduction

Madelyne Xiao and co-authors build a system for studying trends in encrypted chats without reading anyone's messages, in a 2025 paper. End-to-end encryption bars providers from seeing content, which protects users but blocks research on misinformation and political talk. Their system, Synopsis, works on donated messages that are turned into numeric embeddings, never raw text.

Privacy tools and secure joint computation are combined so the protected query path is the only way in; no party can view the stored embeddings. On a set of about thirty-four thousand Hindi WhatsApp messages, queries ran in roughly thirty seconds. Answers through the fine-grained interface topped ninety-four percent accuracy on benchmark tasks, the team reports.

Catalog record

CREATORMadelyne Xiao, Palak Jain, Micha Gorelick, Sarah Scheffler
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE104 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-23880

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Synopsis: Secure and private trend inference from encrypted semantic embeddings Madelyne Xiao, Palak Jain, Micha Gorelick, Sarah Scheffler Abstract WhatsApp and many other commonly used communication platforms guarantee end-to-end encryption (E2EE), which requires that service providers lack the cryptographic keys to read communications on their own platforms. WhatsApp’s privacy-preserving design makes it difficult to study important phenomena like the spread of misinformation or political messaging, as users have a clear expectation and desire for privacy and little incentive to forfeit that privacy in the process of handing over raw data to researchers, journalists, or other parties. We introduce Synopsis , a secure architecture for analyzing messaging trends in consensually-donated E2EE messages using message embeddings. Since the goal of this system is investigative journalism workflows, Synopsis must facilitate both exploratory and targeted analyses—a challenge for systems using differential privacy (DP) ( 1 , 2 ) , and, for different reasons, a challenge for private computation approaches based on cryptography. To meet these challenges, we combine techniques from the local and central DP models and wrap the system in malicious-secure multi-party computation to ensure the DP query architecture is the only way to access messages, preventing any party from directly viewing stored message embeddings. Evaluations on a dataset of Hindi-language WhatsApp messages (34,024 messages represented as 500-dimensional embeddings) demonstrate the efficiency and accuracy of our approach. Queries on this data run in about 30 seconds, and the accuracy of the fine-grained interface exceeds 94% on benchmark tasks. 1. Introduction WhatsApp is the dominant messaging app in the majority world, with nearly three billion monthly active users in 2024 and reported market share in 2022 of 98.9% in Brazil and 97.1% in India ( 3 ) . Given its prevalence, journalists and researchers frequently seek to analyze messaging behavior on WhatsApp, especially during politically charged times like elections and other important events. It is difficult, even in ideal circumstances, for researchers to gain access to social media messaging data, but it is especially difficult in the case of WhatsApp due to WhatsApp’s use of end-to-end encryption (E2EE) ( 4 , 5 ) . In E2EE, the messaging service provider does not possess the cryptographic keys to read message contents; these are held solely by the “end” users of the communication. The privacy of this communication makes it both more difficult and more important to identify trends in these communications. In many recent elections, WhatsApp communications played a major role in both mainstream campaigning and also in the spread of misinformation ( 6 , 7 , 8 , 9 ) . Researchers have surfaced two major angles by which analysis of WhatsApp activity is possible. The first approach to researching WhatsApp activity (both for scientific and journalistic purposes) is using publicly accessible data or group chats with public invitation URLs ( 10 , 11 , 12 ) , under the assumption that these public groups have minimal privacy expectations. However, there is reason to believe that behavior in private groups differs significantly from that in public groups, where observer effects and self-censorship likely played a non-trivial role. Since the majority of WhatsApp messages are sent as direct messages or in small private groups rather than in public groups ( 13 , 14 ) , analysis of WhatsApp activity that is limited to public groups is likely to be non-representative of the full spectrum of on-platform activity, and excludes private communications. A second possible solution to issues of access and observation of WhatsApp activity is data donation . While some donations are limited to individual messages and function more like a tipline ( 15 , 16 ) , some newer approaches to data donation are longer-term. Under the terms of consensual donation agreements brokered by researchers and data stewards, donors make an informed decision to provide researchers with ongoing automated access to some or all of their messaging data. This sort of data has already proven useful in studies about platforms and political speech online ( 17 , 18 , 19 ) . However, data donation also poses privacy concerns. A naive approach to data donation simply gives the researcher full access to all messages the donor has sent or received on WhatsApp. This text messaging data is high-sensitivity for several reasons: First, the dataset includes text messages that may have been donated by the receiver of a message without the message sender’s consent. Second, the text messages were not previously available to any third parties including the service provider due to end-to-end encryption, so their analysis by a researcher reflects a significant change from the status quo. Third, the dataset is likely to include a significant amount of information in miscellaneous text messages that is not relevant to any particular journalistic investigation. And fourth, the dataset will likely contain sensitive political discussions of the messages involved, and may carry legal risk to both the senders/receivers of the messages, the data donors, and the researchers, depending on the local laws regarding political content. This raises the following question: What is the right way to provide privacy to donated E2EE messages while still enabling research? In the naive approach to data donation, the data donor (an “end” of the end-to-end encryption) relays all messages she receives to a researcher for analysis. The researcher retains the raw or lightly-redacted message data, analyzes it, and possibly releases partially-redacted versions of the dataset to others. Indeed, this approach is used by some researchers researching WhatsApp texts ( 19 , 18 ) and internet browsing behavior ( 20 , 21 ) . However, privacy protections for full donated messages against researchers or journalists are thin, and messages can be used for purposes other than aggregate analysis. The redaction methods of these systems use pattern-based detection to remove phone numbers, addresses, or names ( 19 , 22 ) . However, this “sanitization” approach is naturally brittle to non-standard ways of describing sensitive information. More importantly, pattern-based redaction by definition does not apply to non-pattern-based notions of sensitive information (see e.g. ( 23 , 24 ) ), among other issues. Simple AI tools or reliance on converting messages to “embedding” vectors are also not sufficient to protect privacy ( 25 ) ; these embedding vectors are often reversible to the exact message itself ( 26 , 27 , 28 , 29 ) . However, these embedding can be helpful with analysis as embedding models can be selected to help with multi-lingual datasets, multi-modal datasets or with datasets with colloquial or short-form writing. A different approach is required for processing messages in aggregate. Our system, Synopsis, accomplishes this goal by enabling journalists to look for trends in message data without ever accessing individual texts or being in a position to leak information about them. This also gives platform users the ability to donate their data for the public good without exposing the contents of their messages. Journalists are able to write natural language queries and see counts of how many semantically similar messages, or whether that count has reached a threshold, are present in the donated corpus. In addition to its benefits for private group analysis, our aggregate privacy-preserving approach also provides an alternative to direct publication of scraped data from public groups,

Read the complete text