Revisiting Prompt Sensitivity in Large Language Models for Text Classification: The Role of Prompt Underspecification
Branislav Pecher, Michal Spiegel, Robert Belanec, Jan Cegin · 2026
Read Revisiting Prompt Sensitivity in Large Language Models for Text Classification: The Role of Prompt Underspecification by Branislav Pecher, Michal Spiegel, Robert Belanec, Jan Cegin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04297.txt.
Description
Vague prompts, not fragile models, may explain much prompt sensitivity. Branislav Pecher and 3 co-authors revisit prompt sensitivity in language model text classification in a 2026 paper. Many studies measure sensitivity using prompts that barely specify the task or the allowed outputs.
Underspecified prompts showed higher performance variance and weaker internal signals for the right labels. Prompts with specific instructions suffered far less from both problems. Probing the models' internals suggested the underlying task representations were stabler than behavior implied. Before blaming the model for inconsistency, the authors advise, check whether the prompt ever told it what to do.
Catalog record
| CREATOR | Branislav Pecher, Michal Spiegel, Robert Belanec, Jan Cegin |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-04297