Explicit Logic Channel for Validation and Enhancement of MLLMs on Zero-Shot Tasks
Mei Chee Leong, Ying Gu, Hui Li Tan, Liyuan Li, Nancy Chen · 2026
Read Explicit Logic Channel for Validation and Enhancement of MLLMs on Zero-Shot Tasks by Mei Chee Leong, Ying Gu, Hui Li Tan, Liyuan Li, Nancy Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-11689.txt.
Introduction
Leong and co-authors add an Explicit Logic Channel beside frontier multimodal models to check their zero-shot work. Big multimodal models often serve as black boxes on new tasks, hard to validate. The new channel reasons in the open, mixing a language model, a vision model, and probabilistic logic. It handles factual, counterfactual, and relational questions over clear visual evidence. A Consistency Rate compares the two channels and picks models, even with no labeled answers. Joining the channels then lifts zero-shot scores past the model alone.
Catalog record
| CREATOR | Mei Chee Leong, Ying Gu, Hui Li Tan, Liyuan Li, Nancy Chen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68367 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.11689
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Explicit Logic Channel for Validation and Enhancement of MLLMs on Zero-Shot Tasks Mei Chee Leong, Ying Gu, Hui Li Tan, Liyuan Li, Nancy Chen Abstract Frontier Multimodal Large Language Models (MLLMs) exhibit remarkable capabilities in Visual-Language Comprehension (VLC) tasks. However, they are often deployed as zero-shot solution to new tasks in a black-box manner. Validating and understanding the behavior of these models become important for application to new task. We propose an Explicit Logic Channel, in parallel with the black-box model channel, to perform explicit logical reasoning for model validation, selection and enhancement. The frontier MLLM, encapsulating latent vision-language knowledge, can be considered as an Implicit Logic Channel. The proposed Explicit Logic Channel, mimicking human logical reasoning, incorporates a LLM, a VFM, and logical reasoning with probabilistic inference for factual, counterfactual, and relational reasoning over the explicit visual evidence. A Consistency Rate (CR) is proposed for cross-channel validation and model selection, even without ground-truth annotations. Additionally, cross-channel integration further improves performance in zero-shot tasks over MLLMs, grounded with explicit visual evidence to enhance trustworthiness. Comprehensive experiments conducted for two representative VLC tasks, i.e . , MC-VQA and HC-REC, on three challenging benchmarks, with 11 recent open-source MLLMs from 4 frontier families. Our systematic evaluations demonstrate the effectiveness of proposed ELC and CR for model validation, selection and improvement on MLLMs with enhanced explainability and trustworthiness. 1 Introduction Figure 1 : Illustration of Explicit Logic Channel (ELC) for MLLM model validation and selection (upper) and performance enhancement (lower) for novel VLC application in zero-shot setting without the need of ground-truth annotation. In ELC, we combine LLM, VFM and Logical reasoning to derive a prediction on explicit and concrete visual evidence and logical validation for the VLC task. Recently, MLLMs have advanced significantly, reflected by the frequent release of frontier models from leading AI organizations and the expansion of vision-language (VL) benchmarks in both scale and diversity [ 76 , 19 , 73 , 35 , 41 ] , as well as numerous applications [ 44 , 59 ] . Despite these advances, recent research increasingly highlight the limitations of MLLMs in reliability, factuality, explainability, and logical reasoning [ 14 , 5 , 24 , 63 , 52 , 72 , 32 ] . Due to data privacy concerns, large model sizes, and the closed-source nature of models, frontier MLLMs are often used as black-boxes for zero-shot inference on new tasks. Therefore, it is crucial to be able to identify reliable models and improve prediction accuracy without fine-tuning for new tasks [ 31 , 75 , 62 , 75 , 74 ] . Vision-Language tasks, such as VQA and VG (Visual Grounding), in general, require a model to make a decision to a text query on visual information, needing a high-level understanding and concrete visual evidence to support the response. Recently, significant progresses have been achieved for enhancing the visual-language consistency and reliability, such as Grounded VQA [ 77 , 25 , 8 , 10 , 9 ] and VideoQA [ 65 , 15 , 37 ] . The advancements can be classified into three categories: Dataset, Training, and Metric. First, new datasets with additional annotations of related visual information are proposed, including attention region [ 8 ] , object [ 9 ] , and scene-graph [ 45 ] . Second, extensions of architecture and grounding objective function are proposed to force the model also providing grounded visual cue with the text answer on the new datasets with additional annotations [ 29 , 30 ] . Third, corresponding to the formats of the extended datasets, new metrics are proposed which evaluate the performance on not only the text answer but also the visual information on the additional annotations [ 25 , 53 , 54 ] . These efforts focus on enhancing self-explanation of models on their responses. They might not be applicable for model validation in zero-shot applications without gt annotations. As MLLMs are pre-trained on vast VL corpora, they are assumed to have implicitly learned human-like reasoning, forming an Implicit Logic Channel (ILC) that operates as a block-box. However, human makes decisions on explicit facts, relationships and logical rules [ 60 ] . To validate the correctness of ILC, we introduce a novel Explicit Logic Channel (ELC), that runs in parallel with ILC. In ELC, a LLM is prompted to extract concept-level, task-related facts and relations from the input text. A VFM then grounds these facts explicitly in the image. Novel Logic Reasoning approaches are proposed to perform probabilistic inference on the grounded facts and relations and make the decision with explicit visual evidence. We further propose a Consistency Rate (CR) between the ILC and ELC, enabling model validation, justification, and selection, even without ground-truth (gt) annotations. The explicit visual evidence enhances user trust in predictions, while inconsistent samples are flagged for efficient manual inspection. In addition, based on auto-selected consistent sample set, we propose an aligned fusion to combine both channels for task performance enhancement without need of gt annotation and model fine-tuning. To evaluate the effectiveness of ELC and CR for zero-shot VLC tasks, we conduct experiments on two representative tasks, i.e . , MC-VQA and HC-REC, using three recent challenging benchmarks, i.e . , NegBench, HC-RefCOCOg and HC-RefLoCo. We examine 11 frontier open-source MLLMs across four leading families, i.e . , Gemma, LLaVA, InternVL and QwenVL. Our experimental results show that, (a) the metric CR is strongly correlated with accuracy and provides reliable evaluation without gt annotation; (b) ELC with CR enables effective model validation and selection for VLC tasks without gt annotations; (c) the aligned fusion of ILC and ELC further improves VLC performance while offering explicit logical justification for enhanced trustworthiness. Our main contributions include: (1) A general and adaptable Explicit Logic Channel with foundation models and Logic Reasoning, enabling validation, selection and enhancement of MLLMs on novel VLC tasks without gt annotation; (2) A logic consistency metric CR for model performance evaluation without requiring ground-truth; (3) A comprehensive study across 11 frontier MLLMs from four leading families, demonstrating the effectiveness of explicit logic consistency analysis for zero-shot VL applications. 2 Related work LVLMs. Large Vision-Language Models (LVLMs) have grown rapidly in recent years [ 40 , 69 ] . A major category comprises joint embedding-based VLMs, where visual and textual inputs are encoded separately and projected into a shared latent space. Contrastive learning is then used to align the embedded image-text pairs. Representative VLMs, particularly CLIP cluster models [ 51 , 61 ] , and those developed on BLIP [ 36 ] and ALIGN [ 26 ] , are pre-trained on massive VL corpora. Another major category is MLLMs, which adopt a pre-trained LLM as the backbone [ 70 ] . Visual features are extracted by a vision encoder, projected into the LLM’s token space, and inserted into the token sequence for auto-regressive prediction. Recent MLLMs include LLaVA [ 43 ] , GPT-4V [ 68 ] , Gemini [ 21 ] , InternVL [ 11 ] , and Qwen-VL [ 4 ] . In this work, we perform evaluations on 11 frontier MLLMs from four leading families. The open-source models with less 10B parameters make them practical for real-world applications. VLC benchmarks. Benchmarks for evaluating