Event-Aware Sentiment Factors from LLM-Augmented Financial Tweets: A Transparent Framework for Interpretable Quant Trading

Yueyi Wang, Qiyao Wei · 2025

Read Event-Aware Sentiment Factors from LLM-Augmented Financial Tweets: A Transparent Framework for Interpretable Quant Trading by Yueyi Wang, Qiyao Wei (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-07408.txt.

Introduction

Yueyi Wang and Qiyao Wei present a finance paper from 2025 on trading signals drawn from social media. Posts about firms carry mood, but raw mood is noisy and hard to trade on. The pair asked if sorting posts by the kind of event they report makes the signal clearer.

They used a large language model to tag posts with event labels. They kept posts with strong mood and matched them to stock returns over the next one to seven days. Some event labels gave steady negative returns strong enough to trade against. The signal passed standard checks for real effects. All code and steps are public, so others can repeat the work. The authors say mood in posts is a useful, if noisy, clue for markets.

Catalog record

CREATORYueyi Wang, Qiyao Wei
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-07408

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Event-Aware Sentiment Factors from LLM-Augmented Financial Tweets: A Transparent Framework for Interpretable Quant Trading Yueyi Wang, Qiyao Wei Abstract In this study, we wish to showcase the unique utility of large language models (LLMs) in financial semantic annotation and alpha signal discovery. Leveraging a corpus of company-related tweets, we use an LLM to automatically assign multi-label event categories to high-sentiment-intensity tweets. We align these labeled sentiment signals with forward returns over 1-to-7-day horizons to evaluate their statistical efficacy and market tradability. Our experiments reveal that certain event labels consistently yield negative alpha, with Sharpe ratios as low as -0.38 and information coefficients exceeding 0.05, all statistically significant at the 95% confidence level. This study establishes the feasibility of transforming unstructured social media text into structured, multi-label event variables. A key contribution of this work is its commitment to transparency and reproducibility; all code and methodologies are made publicly available. Our results provide compelling evidence that social media sentiment is a valuable, albeit noisy, signal in financial forecasting and underscore the potential of open-source frameworks to democratize algorithmic trading research. † † affiliationnotice: Equal contribution 1 Introduction Traditional financial models have historically relied on structured data from fundamental analysis and technical price patterns to explain market movements. However, a substantial body of literature in behavioral finance has challenged this paradigm, demonstrating that investor sentiment—the collective mood and psychological state of market participants—can act as a significant, independent driver of asset prices ( Coibion et al. 2020 ) . This recognition has fueled the search for novel information sources capable of systematically capturing this sentiment. Among the most promising of these are alternative data streams, particularly the high-frequency, unstructured text generated on social media platforms ( Velasquez 2024 ) . Table 1: Summary of key related works in sentiment analysis for stock prediction. This table outlines seminal and recent studies, detailing their sentiment sources, methodologies, and principal findings. The last two rows highlight the SESTM framework by ( Ke et al. 2019 ) and our proposed LLM-based event-tagged sentiment factor. Study (Author, Year) Sentiment Source Key Methodologies Dataset Used (if specified) Key Finding Market(s) Studied ( Bollen et al. 2011 ) Twitter OpinionFinder sentiment analysis, GPOMS mood analysis (Calm, Happy, etc.) Public Twitter feed data The ’Calm’ dimension of public mood was found to be a significant predictor of the daily up and down changes in the DJIA index. US (DJIA) ( Antweiler & Frank 2004 ) Yahoo! Finance Message board analysis, Naïve Bayes classifier Messages from Yahoo! Finance boards for 45 companies in the DJIA and DJII Found that online messages contain valuable predictive information. Disagreement among posters predicted higher trading volume, while high message volume was a negative predictor of returns. US (DJIA, DJII) ( Greyling & Rossouw 2022 ) Twitter Naïve Bayes, KNN, SVM, various emotion indicators Approximately 3 million stock-related tweets Tweet-based sentiment is a strong predictor of intraday market trends, with model accuracies exceeding 50%. Developed (FR, DE, JP, ES, UK, US), Emerging (IN, PL) ( Sprenger et al. 2014 ) Twitter Sentiment lexicons, machine learning (Support Vector Machine) Tweets containing cashtags for companies in the S&P 100 index The volume of tweets and the sentiment they contain can predict abnormal stock returns and trading volume. US (S&P 100) ( Ranco et al. 2015 ) Twitter Custom sentiment classifier, event study methodology A 15-month dataset of tweets concerning the 30 companies in the DJIA Found that sentiment polarity at tweet volume peaks can imply the direction of cumulative abnormal returns, achieving modest gains (1-2%) over subsequent days. US (DJIA) ( Tan & Tas 2021 ) Twitter Not specified in the provided abstract Not specified A positive and significant impact of Twitter sentiment on stock returns was identified. Not Specified ( Gu & Kurov 2020 ) Twitter Analysis of information content in tweets Stock-related tweets Found that Twitter posts contain new, relevant information that is quickly incorporated into stock prices, influencing returns and trading volume. Not Specified ( Ke et al. 2019 ) Financial News (Dow Jones) SESTM: Predictive topic screening, supervised topic model, logistic regression 7 years of Dow Jones news headlines (2010–2017) Constructed interpretable topic-based sentiment factors predictive of next-day returns; linked factor performance to news categories. US (S&P 500 constituents) [This Paper] Twitter LLM-based multi-label event tagging, net-tone scoring, alpha factor backtesting 100K+ timestamped finance-related tweets (2017) Identified interpretable LLM-labeled events (e.g. rumor, retail buzz, boycott) with robust negative alpha across multiple holding periods and strong IC. US Equities Twitter (now X) has emerged as a principal data source for this endeavor, offering an unprecedented, real-time lens into public discourse surrounding publicly traded companies ( Deodhar & Rao 2021 ) . Early research successfully established a foundational link: that aggregated sentiment polarity (i.e., the net positive or negative tone) from tweets could predict subsequent stock returns. However, these simple sentiment metrics suffer from critical limitations. They are often noisy, their predictive power can decay rapidly as they are arbitraged away, and most importantly, they lack explanatory depth. A simple polarity score can tell us what the market is feeling (positive or negative), but it fails to capture why —the underlying semantic context or real-world event driving the sentiment. This paper addresses this explanatory gap by introducing a novel framework that integrates Large Language Models (LLMs) with quantitative factor modeling to move beyond coarse sentiment and extract interpretable, event-driven factors from social media. Our central thesis is that the true value of social media data lies not just in its emotional intensity but in its rich semantic structure. We posit that by using an LLM to automatically assign multi-label event categories to high-intensity tweets—such as identifying discussions related to rumor/speculation , retail investor hype , or brand boycotts —we can construct more robust and interpretable predictive signals. Our approach builds on and extends the SESTM framework proposed by ( Ke et al. 2019 ) , which introduced a supervised topic modeling pipeline for extracting sentiment from text via predictive word screening and latent topic estimation. While their method relied on statistical modeling of topic distributions over financial news, we adapt this idea to the more volatile and informal domain of social media by incorporating LLMs as semantic enrichers. Specifically, we replace hand-tuned lexicons and unsupervised topic inference with a language model–assisted multi-label classification pipeline that yields not only directional tone but also what the market is reacting to . Contributions This study makes several specific contributions to the literature on computational finance and sentiment analysis: 1. A Novel LLM-Based Factor Framework: We design and implement a new framework for transforming unstructured social media text into structured, interpretable, multi-label event variables suitable for quantitative analysis. This demonstrates the feasibility of using LLMs for large-scale financial semantic annotation. 2. Discovery of Interpretable Alpha Signals: We show that factors constructed from LLM-inferred event labels have significant predictive power. Specifically, we identify that certain event categories, such as ”rumor/speculation,” act as powerful contrarian indicators, consistently yielding negative alpha with Sharpe ratios as low as -0.38. 3. Orthogonality to Market Risk: Through residual analysis, we demonstrate that the predictive power of these event-based factors is orthogonal to market beta, confirming that they represent a source of genuine alpha rather than exposure

Read the complete text