Bi-Level Prompt Optimization for Multimodal LLM-as-a-Judge
Bo Pan, Xuan Kan, Kaitai Zhang, Yan Yan, Shunwen Tan, Zihao He, Zixin Ding, Junjie Wu, Liang Zhao · 2026
Read Bi-Level Prompt Optimization for Multimodal LLM-as-a-Judge by Bo Pan, Xuan Kan, Kaitai Zhang, Yan Yan, Shunwen Tan, Zihao He, Zixin Ding, Junjie Wu, Liang Zhao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-11340.txt.
Description
Language models now judge generated images, but prompt tuning for judges is starved of examples. Bo Pan and eight co-authors study auto prompt tuning for multimodal judging, where context limits cap the visual examples a model can see during trial-and-error refinement. That bottleneck has left multimodal judging underexplored.
Their BLPO frame converts images to text while preserving tests-relevant visual cues, then jointly refines the judge prompt and the image-to-text prompt under limited context budgets. Tests on four data sets and three judge models show the method works. The work makes prompt tuning practical for multimodal judges, where naive text-only methods cannot see enough of the task.
Catalog record
| CREATOR | Bo Pan, Xuan Kan, Kaitai Zhang, Yan Yan, Shunwen Tan, Zihao He, Zixin Ding, Junjie Wu, Liang Zhao |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-11340