Token Coordinated Prompt Attention is Needed for Visual Prompting

Zichen Liu, Xu Zou, Gang Hua, Jiahuan Zhou * · 2025

Read Token Coordinated Prompt Attention is Needed for Visual Prompting by Zichen Liu, Xu Zou, Gang Hua, Jiahuan Zhou * (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-02406.txt.

Description

Zichen Liu, Xu Zou, Gang Hua, and Jiahuan Zhou present a new part for vision models in two thousand twenty-five. Such models are often tuned with a small set of learned prompts shared by all image tokens. The shared setup treats each token the same, though tokens play quite distinct roles.

Their part, called Token Coordinated Prompt Attention, splits prompts into two kinds. One kind works only with the class token, which sums up the whole image. The other kind works with patch tokens, and a matching rule gives each patch its own prompt. Tests on many standard sets show clear gains over the shared-prompt approach.

Catalog record

CREATORZichen Liu, Xu Zou, Gang Hua, Jiahuan Zhou *
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-02406

Browse the full library · About the Tower of Babel