Assessing Capabilities of Large Language Models in Social Media Analytics: A Multi-task Quest

Ramtin Davoudi, Kartik Thakkar, Nazanin Donyapour, Tyler Derr, Hamid Karimi · 2026

Read Assessing Capabilities of Large Language Models in Social Media Analytics: A Multi-task Quest by Ramtin Davoudi, Kartik Thakkar, Nazanin Donyapour, Tyler Derr, Hamid Karimi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18955.txt.

Description

Davoudi and four colleagues present the first broad evaluation of modern language models on social media analytics. They test authorship verification, post generation, and user attribute inference on a Twitter data set. For authorship checks, they sample widely and test on fresh tweets from January 2024 onward to limit seen data bias. A user study gauges how real users judge model posts written in their own style. Attribute labels use standard job taxonomies, and the work sets reproducible benchmarks for the field.

Catalog record

CREATORRamtin Davoudi, Kartik Thakkar, Nazanin Donyapour, Tyler Derr, Hamid Karimi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE75779
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.18955

Browse the full library · About the Tower of Babel