Web-Browsing LLMs Can Access Social Media Profiles and Infer User Demographics
Meysam Alizadeh, Fabrizio Gilardi, Zeynab Samei, Mohsen Mosleh · 2025
Read Web-Browsing LLMs Can Access Social Media Profiles and Infer User Demographics by Meysam Alizadeh, Fabrizio Gilardi, Zeynab Samei, Mohsen Mosleh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-12372.txt.
Introduction
Meysam Alizadeh and co-authors present a 2025 study on privacy risks from web-browsing language models. New models can leave their fixed training data, search the live web, and reason over what they find. The team asked whether such a model, given only a user name, could open a social media profile and guess facts about the person behind it.
They tested the models on a made-up set of 48 accounts on X and on survey data from 1,384 people in many countries. The models did reach profile pages and guessed traits such as age group and sex with fair accuracy. Accounts with few posts drew more biased guesses. The authors warn the skill could serve ads or influence work. They urge firms to block the skill in public tools while keeping it for vetted research.
Catalog record
| CREATOR | Meysam Alizadeh, Fabrizio Gilardi, Zeynab Samei, Mohsen Mosleh |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 86 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-12372
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Web-Browsing LLMs Can Access Social Media Profiles and Infer User Demographics Meysam Alizadeh, Fabrizio Gilardi, Zeynab Samei, Mohsen Mosleh Abstract Large language models (LLMs) have traditionally relied on static training data, limiting their knowledge to fixed snapshots. Recent advancements, however, have equipped LLMs with web-browsing capabilities, enabling real-time information retrieval and multi-step reasoning over live web content. While prior studies have demonstrated LLMs’ ability to access and analyze websites, their capacity to directly retrieve and analyze social media data remains unexplored. Here, we evaluate whether web-browsing LLMs can infer demographic attributes of social media users given only their usernames. Using a synthetic dataset of 48 X (Twitter) accounts and a survey dataset of 1,384 international participants, we show that these models can access social media content and predict user demographics with reasonable accuracy. Analysis of the synthetic dataset further reveals how LLMs parse and interpret social media profiles, which may introduce gender and political biases against accounts with minimal activity. While this capability holds promise for computational social science in the post-API era, it also raises risks of misuse—particularly in information operations and targeted advertising—underscoring the need for safeguards. We recommend that LLM providers restrict this capability in public-facing applications, while preserving controlled access for verified research purposes. 1 Introduction Social media platforms generate vast amounts of user-generated text, which social science researchers analyze to understand public opinion, online behavior, and the spread of misinformation [ 3 , 6 ] . Traditionally, computational methods for social media analysis relied on specialized classifiers or machine learning models trained on manually crafted features [ 2 , 33 , 36 ] . However, over the past few years, Large Language Models (LLMs) have begun to transform how we approach these tasks. These models offer new capabilities for automating content analysis and have been proposed as tools for enhancing survey research and online experiments in the social sciences [ 6 ] . At the same time, their use raises important concerns related to research ethics and the protection of human subjects, particularly regarding transparency, consent, and data privacy [ 29 , 32 ] . Empirical studies have shown that LLMs excel at a wide range of social media data analysis tasks. For example, these models can accurately classify posts according to categories such as hate speech, clickbait, or political stance [ 10 , 19 , 42 ] . In addition to basic classification, LLMs can annotate text by identifying entities, sentiment polarity, or semantic roles, supporting more nuanced investigations of online discourse [ 15 ] . They also demonstrate strong performance in detection tasks, such as fact-checking misleading headlines or spotting automated bot accounts [ 11 , 13 ] . Taken together, these advances imply that, given sufficient data, LLMs are capable of handling the majority of tasks commonly encountered in computational social science research [ 46 ] . Despite these methodological gains, a major barrier has emerged: the so-called “Post-API era” [ 14 ] . In recent years, many social media platforms have imposed stricter limits or fees on programmatic access to their data. Where researchers once could stream or download large volumes of tweets or posts through free public APIs, they now face paywalls, truncated data feeds, or complete shutdowns of API endpoints [ 7 ] . As a result, although LLMs offer a powerful analytical toolkit—capable of distilling insights from vast text corpora—scholars often struggle to acquire data. This growing mismatch between advanced analytic capabilities and restricted data access poses a serious challenge for the field, hampering efforts to replicate findings, benchmark new methods, and monitor real-time social phenomena [ 7 ] . LLMs have traditionally operated on static corpora of text, limiting their knowledge to fixed training snapshots. In recent years, however, LLMs have been augmented with built-in capabilities to retrieve information from the live web and to perform multi-step reasoning over those search results. While previous research show LLMs capability in accessing and analyzing websites content [ 27 ] , the extent to which they can access social media data and infer user demographics (i.e., user profiling) is unexplored. If LLMs prove capable of zero-data profiling users, this ability presents a double-edged sword. On one hand, it offers a valuable tool for researchers to continue advancing computational social science despite increasingly restricted data access. On the other hand, it raises concerns about misuse, as the same capability could be exploited by malicious actors for surveillance, information manipulation [ 27 ] , or highly targeted marketing and influence campaigns [ 2 ] . In this study, we investigate the ability of LLMs to infer demographic attributes of social media users based solely on their usernames. Specifically, we use a synthetic dataset of 48 dummy X (Twitter) accounts and an existing survey dataset of 1,384 international participants. We then prompt a range of closed- and open-source LLMs to infer four key demographic variables—age, gender, socioeconomic status, and political orientation—using only the accounts’ X handles as input. Our main research questions are: RQ1: Can web-browsing LLMs access social media users data (e.g. posts, bio, profile picture, etc.)? RQ2: If such access is possible, how accurately can these LLMs infer users’ demographic attributes based solely on their usernames? Our empirical analysis across two datasets demonstrates that web-browsing LLMs, including GPT-4o, GPT-o3, and Llama-3-8B-Web, can consistently access and retrieve content from X (Twitter) accounts. Although our pilot study suggests that this capability generalizes to other social media platforms, a systematic investigation of this broader applicability falls outside the scope of the present article. We further find that these models can infer user demographics with moderate to high accuracy. Even when evaluated on our synthetic account dataset—which we consider a lower bound on predictive performance due to limited account age and sparse data—model accuracies across demographic categories remain broadly comparable to those reported in prior feature-based and LLM-based studies. To probe the mechanisms underlying these inferences, we conducted controlled experiments by systematically removing key profile elements (e.g., profile pictures, biographies, and follow lists). The results provide insights on how LLMs rely on user names (i.e. first and last names) and profile pictures to infer gender and political orientation, which introduces some gender and political biases in the synthetic dataset. However, such biases were largely vanished in our second dataset, comprising a more diverse and active international sample, suggesting a potential bias against accounts with minimal activity. Our findings indicate that web-browsing LLMs can be readily employed to retrieve and profile social media users based solely on their usernames or profile links. While this capability holds considerable promise for computational social science—particularly in the post-API era [ 14 ] —and offers potential benefits such as automated data validation [ 1 ] , it also raises substantial privacy and security concerns. Key issues include the risks of large-scale automated user profiling, including potential misuse by malicious actors such as state-sponsored influence campaigns, and susceptibility to adversarial threats, such as prompt injection attacks [ 4 ] . 2 Related work User modeling User modeling refers to the process of analyzing or predicting user characteristics based on various forms of data, including user profiles, personality indicators, behavioral trends, and preferences. These insights are instrumental in tailoring and improving systems