Can Large Language Models Really Recognize Your Name?

Dzung Pham, Peter Kairouz, Niloofar Mireshghallah, Eugene Bagdasarian, Chau Minh Pham, Amir Houmansadr · 2025

Read Can Large Language Models Really Recognize Your Name? by Dzung Pham, Peter Kairouz, Niloofar Mireshghallah, Eugene Bagdasarian, Chau Minh Pham, Amir Houmansadr (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-14549.txt.

Description

Dzung Pham and co-authors test in 2025 whether large language models can spot human names well enough for privacy work. Privacy tools lean on models to find and hide personal data, and names are a core type. Names that sound like common words can fool the models even in short texts.

The team built a test set of more than twelve thousand real but ambiguous names in many short clips. Across twelve top models, recall for those names fell by twenty to forty percent versus clearer names. Trap texts that mix data with commands made the miss rate far worse in one work tool. The gap raises fairness fears for privacy cover.

Catalog record

CREATORDzung Pham, Peter Kairouz, Niloofar Mireshghallah, Eugene Bagdasarian, Chau Minh Pham, Amir Houmansadr
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-14549

Browse the full library · About the Tower of Babel