Flex -Judge: Think Once, Judge Anywhere
Jongwoo Ko, Sungnyun KimSungwoo ChoSe-Young Yun KAIST AI {jongwoo.ko, ksn4397, peter8526, yunseyoung}@kaist.ac.kr https://github.com/jongwooko/flex-judge · 2025
Read Flex -Judge: Think Once, Judge Anywhere by Jongwoo Ko, Sungnyun KimSungwoo ChoSe-Young Yun KAIST AI {jongwoo.ko, ksn4397, peter8526, yunseyoung}@kaist.ac.kr https://github.com/jongwooko/flex-judge (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18601.txt.
Introduction
Jongwoo Ko, Sungnyun Kim, Sungwoo Cho, and Se-Young Yun present Flex-Judge, a multimodal evaluator trained mostly on text reasoning. Their 2025 paper deals with reward signals that align generative models with human preferences.
Language models used as judges cut the cost of human annotation. Yet they usually need much modality-specific training data and generalize poorly. Flex-Judge instead learns from a small set of textual reasoning examples. Structured explanations, the authors argue, encode decision patterns that transfer across modalities and formats. In tests it judged images and videos well despite its text-only training. The result suggests reasoning, not data volume, is the key ingredient.
Catalog record
| CREATOR | Jongwoo Ko, Sungnyun KimSungwoo ChoSe-Young Yun KAIST AI {jongwoo.ko, ksn4397, peter8526, yunseyoung}@kaist.ac.kr https://github.com/jongwooko/flex-judge |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-18601
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Flex -Judge: Think Once, Judge Anywhere Jongwoo Ko, Sungnyun KimSungwoo ChoSe-Young Yun KAIST AI {jongwoo.ko, ksn4397, peter8526, yunseyoung}@kaist.ac.kr https://github.com/jongwooko/flex-judge Abstract Human-generated reward signals are critical for aligning generative models with human preferences, guiding both training and inference-time evaluations. While large language models (LLMs) employed as proxy evaluators, i.e., LLM-as-a-Judge, significantly reduce the costs associated with manual annotations, they typically require extensive modality-specific training data and fail to generalize well across diverse multimodal tasks. In this paper, we propose Flex -Judge , a reasoning-guided multimodal judge model that leverages minimal textual reasoning data to robustly generalize across multiple modalities and evaluation formats. Our core intuition is that structured textual reasoning explanations inherently encode generalizable decision-making patterns, enabling an effective transfer to multimodal judgments, e.g., with images or videos. Empirical results demonstrate that Flex -Judge, despite being trained on significantly fewer text data, achieves competitive or superior performance compared to state-of-the-art commercial APIs and extensively trained multimodal evaluators. Notably, Flex -Judge presents broad impact in modalities like molecule, where comprehensive evaluation benchmarks are scarce, underscoring its practical value in resource-constrained domains. Our framework highlights reasoning-based text supervision as a powerful, cost-effective alternative to traditional annotation-intensive approaches, substantially advancing scalable multimodal model-as-a-judge. 1 Introduction Human-generated reward signals play a crucial role in both training and deploying generative models. They are commonly used to fine-tune models toward human-aligned behavior through preference optimization [ 54 , 47 ] or reinforcement learning [ 87 , 58 ] . At inference time, they also guide inference-time decisions, e.g., best-of- N selection [ 24 ] , output reranking [ 43 ] , or filtering based on quality or safety criteria, making them essential tools for test-time control. As models become more capable and are applied across diverse modalities and tasks, the need for high-quality, consistent human feedback continues to grow. However, scaling human feedback process is highly resource-intensive and challenging to generalize across different domains, highlighting a critical demand for more scalable and cost-effective alternatives that can reliably approximate human judgments [ 85 , 68 ] . A promising alternative to manual feedback collection is to use large language models (LLMs) as proxy evaluators—an approach known as LLM-as-a-Judge [ 85 ] . These models emulate human preferences via instruction-following prompts and have shown strong agreement with human ratings across tasks such as summarization [ 58 , 57 ] and dialogue [ 29 ] . In addition to reducing annotation costs, they can serve as reusable, modular evaluators and are often comparable to human judges in consistency. However, existing approaches are largely restricted to text-only scenarios [ 36 ] and often require substantial amounts of paired preference data [ 29 ] to generalize across evaluation types, such as single-score grading, pairwise comparison, or batch-level assessments. Extending this paradigm to multimodal domains ( e.g., vision-language generation or image caption ranking) presents unique challenges. Although some efforts have adapted LLM-as-a-Judge models into vision-language evaluators [ 11 ] , they typically require extensive modality-specific annotations [ 73 ] and frequently fail to generalize across diverse formats without re-training or fine-tuning on each new task [ 32 ] . Moreover, the lack of publicly available multimodal preference datasets makes it difficult to systematically evaluate and train such models, often resulting in heavy reliance on proprietary models or benchmarks. Motivated by the these challenges, we ask a key question: Can just a small amount of textual reasoning data serve to train a cost-efficient, modality-agnostic judge model? Our core intuition is that textual reasoning chains, such as evaluative explanations or comparisons behind preference judgments, encode structured and interpretable rationale that can be transferred across modalities and evaluation formats. That is, models trained to make judgments by reasoning about why one answer is preferred over another may learn more generalizable decision rules. In addition, recent advances in multimodal large language models (MLLMs) suggest that their impressive generalization capabilities predominantly arise from their pretrained textual reasoning abilities. Figure 1 : Conceptual overview of Flex -Judge. We train a multimodal judge model using a small amount of text-only reasoning data. Unlike previous approaches that require modality-specific supervision, Flex -Judge leverages structured text-only rationale behind judgments to enable generalization across modalities. Once trained, Flex -Judge can be applied to various evaluation tasks, including vision-language tasks, audio quality scoring, and molecular structure, without the need for additional task-specific or modality-specific annotations. Contribution & Organization. Inspired by this, we propose Flex -Judge , a multimodal judge model trained solely on a small corpus of high-quality text reasoning data. Our central finding is that: we do not need large-scale multimodal annotations to train an effective MLLM judge—just a small amount of good reasoning data is enough. This text-only supervision is not only cheaper but also avoids the need for complex annotation tools or multimodal data curation, while achieving strong generalization across diverse modalities and evaluation settings. Refer to Figure 1 for the preview of this work. Our key contributions are: • Modality-agnostic Efficient Approach (Section 2 ): We propose Flex -Judge, a simple and cost-effective method that uses 1K-sized text-only reasoning data to generalize across modalities without modality-specific training. This facilitates zero-shot evaluation on unseen modalities with minimal annotation and compute overhead. • Comparison with State-of-the-art (Section 3 ): We evaluate Flex -Judge on image, video, and audio reward benchmarks against commercial APIs [ 1 , 59 ] , large vanilla MLLMs, and open-source judges trained on costly multimodal datasets [ 32 , 73 ] . Despite its simplicity and efficiency, Flex -Judge (7B model) outperforms open-source judges, even exceeding Gemini and GPT-4o on several MJ-Bench and GenAI-Bench subtasks. In-depth analyses are presented in Section 5 . • Broader Impact (Section 4 ): We demonstrate real-world applications of Flex -Judge in the molecular domain by introducing Flex -Mol-LLaMA, the first judge model designed for molecular modality [ 27 ] . We showcase its utility in two key scenarios: (1) serving as a best-of-N selector for inference-time scaling, and (2) constructing training data for direct preference optimization (DPO) [ 54 ] . In both cases, reward-guided molecular MLLM achieves significant improvements, highlighting the practical solution in domains where modality-specific reward models are infeasible. 2 Approach 2.1 Motivation Problem Statement. Evaluating outputs across multiple modalities using foundation models is increasingly important, especially as generative models expand beyond language to include image, video, or audio [ 4 , 16 , 76 ] . While both proprietary LMs and open-source evaluators are widely used to assess the generative models’ response quality, two main challenges remain: • Concern of Commercial API: Issues regarding transparency, controllability, and affordability persist when utilizing proprietary LMs for evaluation tasks [ 29 ] . API model changes can silently degrade evaluation quality, raising concerns about the reliability of LLM-as-a-Judge with closed-source models [ 9 ] . For instance, Xiong et al. 2024 re-evaluated GPT-4V on the MLLM-as-a-Judge benchmark [ 11 ] and found a significant drop in evaluation performance. • Limited Support for Diverse Modalities: While judge models for language [ 29 ] and vision-language tasks [ 32 , 73 ] have advanced significantly thanks to the availability of assessment data, evaluating other modalities, e.g., audio [ 15 , 16 ] , thermal heatmaps [ 80 ] , 3D point clouds [