Exploring the Effectiveness and Interpretability of Texts in LLM-based Time Series Models
Zhengke Sun, Hangwei Qian, Ivor Tsang · 2025
Read Exploring the Effectiveness and Interpretability of Texts in LLM-based Time Series Models by Zhengke Sun, Hangwei Qian, Ivor Tsang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-08808.txt.
Description
Zhengke Sun, Hangwei Qian, and Ivor Tsang ask whether the text fed into language-model forecasters actually helps them predict time series. Such models pair numbers with prompts or textual prototypes, claiming the words add understanding. The authors suspected the two modalities might not line up.
Experiments with textual prompts and prototypes showed text often failed to improve forecasting accuracy. Visualizations of the learned representations suggested they carry little interpretable meaning for the series. To measure the gap, the authors propose a Semantic Matching Index scoring how well text and series correspond. Their conclusion is cautionary: current frameworks show misalignment and weak interpretability, and the field should check text's contribution rather than assuming it.
Catalog record
| CREATOR | Zhengke Sun, Hangwei Qian, Ivor Tsang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-08808