P rivacy Sim : Evaluating LLM Simulation of User Privacy Behavior

James Flemings, Murali Annvaram · 2026

Read P rivacy Sim : Evaluating LLM Simulation of User Privacy Behavior by James Flemings, Murali Annvaram (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12147.txt.

Description

James Flemings and Murali Annavaram test whether language models can mimic individual privacy choices with PrivacySIM. Models increasingly stand in for people, but their grasp of personal privacy calls is poorly understood. PrivacySIM scores models against real answers from 1,000 users across five published privacy studies. It tests persona facets of demographics, past experience, and stated privacy views. Persona prompts beat no-persona prompts, yet even the best model hits only 40.4 percent accuracy, and stated views predict poorly since views often diverge from real behavior.

Catalog record

CREATORJames Flemings, Murali Annvaram
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE131544
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.12147

Browse the full library · About the Tower of Babel