Unlocking Few-Shot Capabilities in LVLMs via Prompt Conditioning and Head Selection

Adhemar de Senneville, Xavier Bou, Jérémy Anger, Rafael Grompone, Gabriele Facciolo · 2026

Read Unlocking Few-Shot Capabilities in LVLMs via Prompt Conditioning and Head Selection by Adhemar de Senneville, Xavier Bou, Jérémy Anger, Rafael Grompone, Gabriele Facciolo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-24181.txt.

Description

de Senneville and co-authors show that large vision-language models hide strong classification skills inside their heads. Such models do well at captioning and question answering, yet lag CLIP methods at image classification. Prompt conditioning alone can improve how separable their visual features are. Their method, Head Ensemble Classifiers, ranks the most discriminative vision and text heads. It then combines them into a classifier that needs no training. Across 12 datasets, it reaches state-of-the-art zero-shot and few-shot scores, they report.

Catalog record

CREATORAdhemar de Senneville, Xavier Bou, Jérémy Anger, Rafael Grompone, Gabriele Facciolo
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65597
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.24181

Browse the full library · About the Tower of Babel