Assessing Capabilities of Large Language Models in Social Media Analytics: A Multi-task Quest
Ramtin Davoudi, Kartik Thakkar, Nazanin Donyapour, Tyler Derr, Hamid Karimi · 2026
Read Assessing Capabilities of Large Language Models in Social Media Analytics: A Multi-task Quest by Ramtin Davoudi, Kartik Thakkar, Nazanin Donyapour, Tyler Derr, Hamid Karimi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18955.txt.
Description
Davoudi and four colleagues present the first broad evaluation of modern language models on social media analytics. They test authorship verification, post generation, and user attribute inference on a Twitter data set. For authorship checks, they sample widely and test on fresh tweets from January 2024 onward to limit seen data bias. A user study gauges how real users judge model posts written in their own style. Attribute labels use standard job taxonomies, and the work sets reproducible benchmarks for the field.
Catalog record
| CREATOR | Ramtin Davoudi, Kartik Thakkar, Nazanin Donyapour, Tyler Derr, Hamid Karimi |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 75779 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.18955