Token Coordinated Prompt Attention is Needed for Visual Prompting
Zichen Liu, Xu Zou, Gang Hua, Jiahuan Zhou * · 2025
Read Token Coordinated Prompt Attention is Needed for Visual Prompting by Zichen Liu, Xu Zou, Gang Hua, Jiahuan Zhou * (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-02406.txt.
Description
Zichen Liu, Xu Zou, Gang Hua, and Jiahuan Zhou present a new part for vision models in two thousand twenty-five. Such models are often tuned with a small set of learned prompts shared by all image tokens. The shared setup treats each token the same, though tokens play quite distinct roles.
Their part, called Token Coordinated Prompt Attention, splits prompts into two kinds. One kind works only with the class token, which sums up the whole image. The other kind works with patch tokens, and a matching rule gives each patch its own prompt. Tests on many standard sets show clear gains over the shared-prompt approach.
Catalog record
| CREATOR | Zichen Liu, Xu Zou, Gang Hua, Jiahuan Zhou * |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-02406