Prompting Underestimates LLM Capability for Time Series Classification
Dan Schumacher, Erfan Nourbakhsh, Rocky Slavin, Anthony Rios · 2026
Read Prompting Underestimates LLM Capability for Time Series Classification by Dan Schumacher, Erfan Nourbakhsh, Rocky Slavin, Anthony Rios (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-03464.txt.
Description
Dan Schumacher and three co-authors show that asking language models direct questions can hide what those models actually know about time series. Time series are sequences measured over time, like heart signals or stock prices. Prompt-based tests made the models look near chance at sorting such series into classes, which raised doubts about their internal grasp of time patterns.
The team instead probed the models' internal states with simple linear probes. Average scores jumped from near chance to levels matching or beating specialist models. Useful class signals appeared in early layers and grew stronger with visual inputs. The lesson is about testing itself: a weak prompt can make a capable model look ignorant, so evaluations should check representations too.
Catalog record
| CREATOR | Dan Schumacher, Erfan Nourbakhsh, Rocky Slavin, Anthony Rios |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-03464