VOILA: Value-of-Information Guided Fidelity Selection for Cost-Aware Multimodal Question Answering

Rahul Atul Bhope, K. R. Jayaram, Vinod Muthusamy, Ritesh Kumar, Vatche Isahagian, Nalini Venkatasubramanian · 2026

Read VOILA: Value-of-Information Guided Fidelity Selection for Cost-Aware Multimodal Question Answering by Rahul Atul Bhope, K. R. Jayaram, Vinod Muthusamy, Ritesh Kumar, Vatche Isahagian, Nalini Venkatasubramanian (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03007.txt.

Description

Choosing how much visual detail to fetch for each question is the problem Rahul Atul Bhope and 5 co-authors solve in a 2026 paper. Multimodal systems usually retrieve high-fidelity images at fixed quality, paying significant costs even when a cheaper version would answer correctly. Their framework, VOILA, selects fidelity before the model runs.

A gradient-boosted regressor first predicts correctness at each fidelity from question features alone. An isotonic calibrator then refines those probabilities. The system picks the cheapest fidelity with the best expected utility. Evaluation covered five datasets and six vision-language models of widely varying size. Costs fell by half or more while keeping most full-resolution accuracy. The results argue pre-retrieval selection is vital under resource limits.

Catalog record

CREATORRahul Atul Bhope, K. R. Jayaram, Vinod Muthusamy, Ritesh Kumar, Vatche Isahagian, Nalini Venkatasubramanian
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE98 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-03007

Browse the full library · About the Tower of Babel