Which Words Matter Most in Zero-Shot Prompts?

Nikta Gohari Sadr, Sangmitra Madhusudan, Hassan Sajjad and Ali Emami · 2025

Read Which Words Matter Most in Zero-Shot Prompts? by Nikta Gohari Sadr, Sangmitra Madhusudan, Hassan Sajjad and Ali Emami (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-03418.txt.

Description

Nikta Gohari Sadr and co-authors grade which words in a prompt drive model gains in a 2025 paper. Stock lines like "let's think step by step" lift model scores, yet no one knew which words earn the lift. Their ZIP score swaps, swaps kin, or drops each word and reads the shift. Four top models, seven stock prompts, and many task kinds fed the sweep. A truth set of prompts with known key words grades the tool.

Task kind sets the word ranks: math loves the step phrase, thought tasks love "think." Nouns top most rank lists. Closed models match human sense of key words more than open ones. Word weight runs inverse to model strength: prompts help most where models lag. ZIP hit 90 percent truth grades against a rival's 60.

Catalog record

CREATORNikta Gohari Sadr, Sangmitra Madhusudan, Hassan Sajjad and Ali Emami
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-03418

Browse the full library · About the Tower of Babel