Exploring the Effectiveness and Interpretability of Texts in LLM-based Time Series Models

Zhengke Sun, Hangwei Qian, Ivor Tsang · 2025

Read Exploring the Effectiveness and Interpretability of Texts in LLM-based Time Series Models by Zhengke Sun, Hangwei Qian, Ivor Tsang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-08808.txt.

Description

Zhengke Sun, Hangwei Qian, and Ivor Tsang ask whether the text fed into language-model forecasters actually helps them predict time series. Such models pair numbers with prompts or textual prototypes, claiming the words add understanding. The authors suspected the two modalities might not line up.

Experiments with textual prompts and prototypes showed text often failed to improve forecasting accuracy. Visualizations of the learned representations suggested they carry little interpretable meaning for the series. To measure the gap, the authors propose a Semantic Matching Index scoring how well text and series correspond. Their conclusion is cautionary: current frameworks show misalignment and weak interpretability, and the field should check text's contribution rather than assuming it.

Catalog record

CREATORZhengke Sun, Hangwei Qian, Ivor Tsang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-08808

Browse the full library · About the Tower of Babel