Token-Efficient Multimodal Reasoning via Image Prompt Packaging Joong Ho Choi, Jiayang Zhao, Avani Appalla, Himansh Mukesh, Dhwanil Vasani, Boyi Qian Abstract . Deploying large multimodal language models at scale is constrained by token-based inference costs, yet the cost-performance behavior of visual prompting strategies remains poorly characterized. We introduce Image Prompt Packaging (IPPg), a prompting paradigm that embeds structured text directly into images to reduce text token overhead, and benchmark it across five datasets, three frontier models (GPT-4.1, GPT-4o, Claude 3.5 Sonnet), and two task families (VQA and code generation). We derive a cost formulation decomposing savings by token type and show IPPg achieves 35.8–91.0% inference cost reductions. Despite token compression of up to 96%, accuracy remains competitive in many settings, though outcomes are highly model- and task-dependent: GPT-4.1 achieves simultaneous accuracy and cost gains on CoSQL, while Claude 3.5 incurs cost increases on several VQA benchmarks. Systematic error analysis yields a failure-mode taxonomy: spatial reasoning, non-English inputs, and character-sensitive operations are most vulnerable, while schema-structured tasks benefit most. A 125-configuration rendering ablation reveals accuracy shifts of 10–30 percentage points, establishing visual encoding choices as a first-class variable in multimodal system design. 1. Introduction Multimodal fusion is central to modern AI systems, yet the practical economics of multimodal inference remain underexplored. Token-based billing dominates the cost structure of commercial LLM APIs, and structured inputs—verbose schema descriptions, long financial prompts, dense receipts—can consume thousands of text tokens per query. As multimodal workloads scale, the question of how to reduce this overhead without sacrificing task accuracy becomes a first-order deployment concern. Despite the commercial significance of this problem, there exists no systematic benchmark characterizing the cost-performance behavior of visual prompting strategies across diverse domains, model families, and task types, including healthcare VQA, financial reasoning, document extraction, Python code generation, and multi-agent text-to-SQL. To address this, we propose Image Prompt Packaging (IPPg), a cost-aware prompting framework that embeds structured text directly into images and routes inputs through the visual tokenization channel, eliminating text token costs for the injected content. IPPg is architecture-agnostic and requires no model modifications, making it straightforward to evaluate across commercial APIs. We benchmark IPPg across five datasets and three frontier models using two controlled experimental paradigms—(i) text+image vs. text-in-image and (ii) text vs. text-as-image—designed to isolate how visual encoding affects semantic fidelity, tokenization efficiency, and downstream accuracy. Our key contributions are • We introduce IPPg and benchmark it across five datasets, three frontier models, and two task families—VQA and code generation—including multi-agent and two-call repair settings. • We derive a cost formulation that decomposes inference cost into image- and text-token components under provider-specific tokenization schemes (tile-based for OpenAI, pixel-linear for Claude), and report performance-per-dollar and cost-per-correct-answer across all configurations, metrics that better reflect commercial deployment constraints than raw token counts. • Through error analysis across all five datasets, we construct a failure-mode taxonomy for visual text encoding, identifying spatial reasoning, non-English inputs, character-sensitive string manipulation, order-sensitive arithmetic, and multi-table relational reasoning as consistent bottlenecks, findings that generalize across model families and carry implications for MLLM design beyond IPPg. • We conduct the first systematic rendering ablation for text-as-image prompting, evaluating 125 font \times color \times size combinations across three VQA datasets, demonstrating accuracy shifts of 10–30 percentage points and identifying empirically grounded configuration guidelines and model-specific accuracy-cost Pareto frontiers for practitioners. 2. Related Work In multimodal learning, information across modalities is typically combined using Early Fusion or Late Fusion frameworks. Early Fusion projects modality-specific inputs into a shared embedding space, allowing a single transformer to process mixed sequences of image and text tokens without separate modality-specific encoders or decoders ( anil2023gemini ; betker2023improving ) . This approach supports unified cross-modal reasoning but often incurs high representational complexity. In contrast, Late Fusion trains independent models per modality and aggregates their predictions, reducing per-model complexity while potentially failing to capture fine-grained inter-modal interactions ( mmlf2024multimodal ) . However, both Early and Late Fusion approaches are susceptible to modality bias, where models over-rely on dominant modalities while under-utilizing others, leading to degraded performance when certain inputs are missing or unreliable. This bias can arise from asymmetric modality backbones, dataset imbalances, training objectives, and differing convergence dynamics across modalities ( zheng2025mllms ) . Recent work formalizes this phenomenon through metrics such as the Modality Dominance Index (MDI) and Attention Efficiency Index (AEI), revealing a strong tendency for multimodal LLMs to prioritize textual inputs during inference at the expense of visual or auditory information ( wu2025when ) . Some Modalities Are More Equal Than Others shows that MLLMs often fail to prioritize the queried modality under audio–visual or text–visual misalignment, frequently defaulting to textual cues even when they are misleading. These findings suggest that modality dominance is not purely semantic, but is strongly shaped by tokenizer efficiency and channel-specific inductive biases ( chen2025modalitiesequalothersdecoding ) . IPPg operationalizes this insight as an inference-time intervention: by deliberately routing textual content through the visual channel, it stress-tests modality dominance empirically across diverse tasks, yielding the first large-scale behavioral map of when visual encoding helps or hurts. To mitigate modality bias, prior work has proposed training-time interventions. For example, modality collapse in multimodal VAEs has been attributed to conflicting gradients across modalities, motivating gradient-conflict detection and resolution techniques adapted from multi-task learning ( javaloy2022mitigating ) . Other approaches introduce explicit basis reallocation or cross-modal knowledge distillation to disentangle representations and alleviate rank bottlenecks in multimodal encoders ( chaudhuri2025closer ) . Encoding fidelity—the extent to which semantic content is preserved under cross-modal conversion—remains under-explored. In particular, embedding textual prompts directly into images and relying solely on the vision channel, rather than jointly using text and image modalities, raises open questions about semantic degradation and its downstream impact on LLM reasoning. Recently, two noteworthy papers have explored multi-modality in related directions. DeepSeek-OCR uses a 16\times convolutional compressor and DeepSeek-3B-MoE decoder that reconstructs text, HTML, and figure annotations with minimal loss, enabling language models to attend to images of text more cost-efficiently ( Wei2025DeepSeekOCRCO ) . However, this is an architectural contribution requiring model modification; we are interested in a pure prompt-time strategy compatible with any off-the-shelf MLLM. Another paper shows that textual inputs can be compressed by feeding them as images to reduce token usage while preserving performance on long-context retrieval and document summarization benchmarks ( Li2025TextOP ) . However, their evaluation is restricted to text-only-to-image conversion on two benchmarks with two models, neither of which involves genuine multimodal inputs. They also report only token-level compression without accounting for commercial cost structures where input and output tokens are priced asymmetrically. Our benchmark extends this in scope (five datasets, three models, multimodal tasks), cost modeling (provider-specific tokenization, performance-per-dollar), and rendering analysis (125 configurations vs. resolution only). Token-based billing and throughput constraints dominate the cost structure of commercial LLMs, yet are largely overlooked in existing multimodal fusion research, limiting practical scalability. Because LLM APIs bill by token counts, languages that need more tokens to express the same content end up costing users more. ( ahia2023languages ) illustrates that heavily segmented, non-Latin scripts, especially mid-resourced Indic languages, can be nearly five times more expensive than English, while Indo-European, Latin-script languages remain the cheapest. Recent work on typographic attacks and visual text distraction has shown that embedded text can, in some cases, mislead or override visual reasoning in vision-language models ( cheng2024unveilingtypographicdeceptionsinsights ) . Beyond issues of relevance and distractibility, recent studies also reveal fundamental limitations of current vision-language models in fine-grained text understanding. For instance, Li et al. find that even strong VLMs struggle with tasks such as font recognition, indicating that semantic and stylistic understanding of text remains a challenging open problem despite advances in broader multimodal reasoning ( li2025texturesemanticsvisionlanguagemodels ) . While many earlier evaluation protocols implicitly encouraged models to disregard embedded text, Waseda et al. show that realistic image understanding often requires joint reasoning over both visual objects and textual cues, highlighting the need for context-aware text handling in multimodal systems ( waseda2025readignoreunifiedbenchmark ) . To address this, Cheng et al. introduce a large-scale typographic dataset to systematically study the distractibility of LVLMs by text in images, and demonstrate that more informative text prompts can partially mitigate the resulting performance degradation ( cheng2024unveilingtypographicdeceptionsinsights ) . Our work provides a comprehensive examination of encoding fidelity by embedding textual prompts of simple, clear Arial font directly into images and routing them through the vision channel across a broad range of domains and tasks. In doing so, we explicitly connect semantic preservation to real-world commercial constraints, including token-based pricing and inference cost. 3. Design In our ablation study, we selected GPT-4.1 ( openai_chatgpt4.1 ) , GPT-4o ( openai_chatgpt4o_omni ) , and Claude 3.5 Sonnet ( claude_sonnet_3.5 ) to ensure broad, vendor-agnostic coverage across the leading edge of commercial MLLMs. We use the Python Image Library (PIL) with a default DPI of 72 to inject the text prompt into the image using the Arial font. For different image sizes, we automatically adjust the injected prompt text to follow the original width of the image. To ensure fairness across experiments, we employ a vanilla LLM configuration with no tool calls or external skills enabled. For tasks that require a specific output format, we keep the system prompt to state the output format for alignment, while we inject the user prompt into the image. We then provide the model both the system prompt and the rendered image. 3.1. Cost Profiling Table 1 . Per-token pricing by model ($/token). All models satisfy p_{\mathrm{img}}=p_{i} . Model p_{i} p_{o} p_{o}/p_{i} GPT-4o ( openai_pricing ) 2.50\times 10^{-6} 1.00\times 10^{-5} 4 GPT-4.1 ( openai_pricing ) 2.00\times 10^{-6} 8.00\times 10^{-6} 4 Claude 3.5 Sonnet ( anthropic_claude_vision ) 3.00\times 10^{-6} 1.50\times 10^{-5} 5 Let n_{i} and n_{o} denote the numbers of input and output text tokens, and let n_{\mathrm{img}}^{\mathrm{base}} and n_{\mathrm{img}}^{\mathrm{IPPg}} denote the numbers of image tokens for the baseline image and the IPPg image (with embedded text), respectively. Let p_{i} , p_{o} , and p_{\mathrm{img}} be the per-token prices for input text, output text, and image tokens. Table 1 summarizes the per-token pricing for each model (as of January 2026); across providers, image tokens are priced identically to input text tokens, i.e., p_{\mathrm{img}}=p_{i} . To isolate the effect of IPPg on inference cost, we condition on a fixed task prompt and decoding configuration and assume that both methods incur the same text token counts. Specifically, n_{i}^{\mathrm{baseline}}=n_{i}^{\mathrm{IPPg}} and n_{o}^{\mathrm{baseline}}=n_{o}^{\mathrm{IPPg}} , so any cost difference arises solely from the image token counts ( n_{\mathrm{img}}^{\mathrm{base}} versus n_{\mathrm{img}}^{\mathrm{IPPg}} ). The baseline approach (text + image) incurs cost: (1) \mathrm{Cost}_{\mathrm{baseline}}=p_{i}\,n_{i}+p_{\mathrm{img}}\,n_{\mathrm{img}}^{\mathrm{base}}+p_{o}\,n_{o}. Our IPPg approach (text embedded in image) incurs cost: (2) \mathrm{Cost}_{\mathrm{IPPg}}=p_{\mathrm{img}}\,n_{\mathrm{img}}^{\mathrm{IPPg}}+p_{o}\,n_{o}. Let \Delta n_{\mathrm{img}}=n_{\mathrm{img}}^{\mathrm{IPPg}}-n_{\mathrm{img}}^{\mathrm{base}} denote the additional image tokens incurred by embedding text into the image. Under the assumption p_{\mathrm{img}}=p_{i} , IPPg is strictly cheaper than the baseline if and only if (3) \Delta n_{\mathrm{img}}