Which Words Matter Most in Zero-Shot Prompts?
Nikta Gohari Sadr, Sangmitra Madhusudan, Hassan Sajjad and Ali Emami · 2025
Read Which Words Matter Most in Zero-Shot Prompts? by Nikta Gohari Sadr, Sangmitra Madhusudan, Hassan Sajjad and Ali Emami (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-03418.txt.
Description
Nikta Gohari Sadr and co-authors grade which words in a prompt drive model gains in a 2025 paper. Stock lines like "let's think step by step" lift model scores, yet no one knew which words earn the lift. Their ZIP score swaps, swaps kin, or drops each word and reads the shift. Four top models, seven stock prompts, and many task kinds fed the sweep. A truth set of prompts with known key words grades the tool.
Task kind sets the word ranks: math loves the step phrase, thought tasks love "think." Nouns top most rank lists. Closed models match human sense of key words more than open ones. Word weight runs inverse to model strength: prompts help most where models lag. ZIP hit 90 percent truth grades against a rival's 60.
Catalog record
| CREATOR | Nikta Gohari Sadr, Sangmitra Madhusudan, Hassan Sajjad and Ali Emami |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-03418